When will a Large Language Model beat me at chess?
32
100Ṁ1519
2031
2%
2025
4%
2026
35%
2027
69%
2028
84%
2029
87%
2030

At the end of each year, I’ll play a game of chess against an LLM. Resolves YES if I lose, NO if I win, and 50% for a draw. On which years will I win?

Some more details: I’m rated around 1900 FIDE, 2100 USCF. The game will be played at a rapid time control. I’ll select the LLM from the top 3 of the leaderboard (https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard), or another benchmark if I believe it to be a better measure of general reasoning capabilities. On each move, I’ll provide the LLM with the game state in fen and pgn notation, and I’ll follow along on lichess. If the LLM makes 3 illegal moves, I’ll consider it a victory. Distinctions like Nd2 vs Nbd2 won’t count towards this, but I’ll ask the LLM for clarification. The LLM will play white.

  • Update 2025-12-02 (PST) (AI summary of creator comment): The market will now be resolved according to the outcome of this linked market about which language model will win.

Get
Ṁ1,000
to start trading!
Sort by:

I will now be resolving this according to the market below; I won’t be playing a separate game at the end of the year for this market.

bought Ṁ95 NO

Related Market:

© Manifold Markets, Inc.TermsPrivacy