By model and setting

Each model and reasoning setting appears once. If a model produced more than one player program for this game, the row stands for all of them: Programs counts the working attempts out of the counted attempts, Score and Raw rating average the programs (weighted by attempts; the small range is the lowest and highest program rating), and the combined record adds up their matches. Score is relative within this game (0–100). Scores here are working-program strength: failed generation attempts are left out and count as 0 only in a model's headline score.

GB2-03: Shogi - Reasoning Variants
Rank Model Reasoning Score Programs Raw rating Combined record (W / D / L)
1GPT-6.1 SolXHigh98.21 working of 1 attempt2467.6486 / 1 / 7
2GPT-6 AstraXHigh97.71 working of 1 attempt2409.5479 / 9 / 6
3Claude Opus 5.5XHigh97.11 working of 1 attempt2353.4479 / 2 / 13
4GPT-6.1 SolMedium96.61 working of 1 attempt2312.1475 / 4 / 15
5Pareto 26.10Provider96.41 working of 1 attempt2299.4475 / 2 / 17
6Claude Fable 5.1XHigh95.42 working of 2 attempts2231.5 program range 2226–2237937 / 6 / 45
7Claude Sonnet 5.5XHigh95.11 working of 1 attempt2211.4468 / 0 / 26
8GPT-6 AstraMedium94.81 working of 1 attempt2197.0464 / 5 / 25
9Claude Opus 5XHigh94.842195.51856 / 18 / 102
10GPT-6 SolXHigh94.41 working of 1 attempt2174.1462 / 4 / 28
11Pareto 26.10 PreviewProvider93.81 working of 1 attempt2144.3458 / 5 / 31
12Claude Fable 5.1Low93.31 working of 1 attempt2120.5456 / 3 / 35
13Claude Opus 5.5Medium92.61 working of 1 attempt2090.9442 / 23 / 29
14Claude Fable 5.1Medium92.31 working of 1 attempt2080.3447 / 10 / 37
15Gemini 4 ArgonHigh92.31 working of 1 attempt2080.3430 / 44 / 20
16Kimi K3.1 ProLow88.81 working of 1 attempt1959.4429 / 5 / 60
17Kimi K3.1 ProHigh88.71 working of 1 attempt1957.76 / 0 / 0
18Grok 4.7XHigh88.01 working of 1 attempt1937.3385 / 84 / 25
19Kimi K3.1 ProMax87.31 working of 1 attempt1918.7392 / 62 / 40
20Claude Fable 5XHigh86.91 working of 1 attempt1907.5395 / 51 / 48
21Claude Opus 5Medium86.741903.21662 / 32 / 282
22GPT-6.1 SolLow86.01 working of 1 attempt1886.0401 / 29 / 64
23MiMo-V2.6-ProEnabled85.91 working of 1 attempt1884.0414 / 2 / 78
24Gemini 4 ArgonLow85.81 working of 1 attempt1880.2404 / 21 / 70
25GLM-5.3 FlashXMax84.91 working of 1 attempt1859.8406 / 6 / 82

Individual player programs

Each row is one accepted player program for GB2-03: Shogi; a model can have more than one. Score is the 0–100 result in this game, and its rating and W / D / L record show how it played. Scores are working-program strength: failed generation attempts have no row and count only in a model's headline score.

249 player programs.

ModelReasoningStatusScoreRatingW / D / LMatchesOpponentsNotesGenerated
GPT-6.1 SolE-27bd4aa164eef135XHighRated Interval validated98.22468486 / 1 / 7494 / 494247—2026-10-01First try
GPT-6 AstraE-18e6aa627f4b1222XHighRated Interval validated97.72409479 / 9 / 6494 / 494247—2026-09-05First try
Claude Opus 5.5E-0ac738bb34b1e7c8XHighRated Interval validated97.12353479 / 2 / 13494 / 494247—2026-09-22First try
GPT-6.1 SolE-fb177ebd31849b47MediumRated Interval validated96.62312475 / 4 / 15494 / 494247—2026-10-01First try
Pareto 26.10E-3f0521308d4debcbProviderRated Interval validated96.42299475 / 2 / 17494 / 494247—2026-10-21First try
Claude Fable 5.1E-b53393b05159fc95XHighRated Interval validated95.52237469 / 3 / 22494 / 494247—2026-09-08First try
Claude Fable 5.1E-9f7c077c66189b69XHighRated Interval validated95.32226468 / 3 / 23494 / 494247—2026-09-03First try
Claude Opus 5E-7caa6c5081d57676XHighRated Interval validated rev d852e28695.22221466 / 6 / 22494 / 494247—2026-07-25First try
Claude Sonnet 5.5E-4a7793fa8a4833beXHighRated Interval validated95.12211468 / 0 / 26494 / 494247—2026-09-30First try
GPT-6 AstraE-4633465f951f8caeMediumRated Interval validated94.82197464 / 5 / 25494 / 494247—2026-09-05First try
GPT-6 SolE-049711eb0d28bfa8XHighRated Interval validated94.42174462 / 4 / 28494 / 494247—2026-09-22First try
Claude Opus 5E-38759212c025e8ebXHighRated Interval validated rev d852e28694.32170462 / 3 / 29494 / 494247—2026-07-25First try
Pareto 26.10 PreviewE-74f4f6139b879936ProviderRated Interval validated93.82144458 / 5 / 31494 / 494247—2026-10-09First try
Claude Fable 5.1E-529bc866427d95d5LowRated Interval validated93.32121456 / 3 / 35494 / 494247—2026-09-03First try
Claude Opus 5.5E-8b93ed37e8717e57MediumRated Interval validated92.62091442 / 23 / 29494 / 494247—2026-09-22First try
Claude Fable 5.1E-5c6dabbae6a319cfMediumRated Interval validated92.32080447 / 10 / 37494 / 494247—2026-09-03First try
Gemini 4 ArgonE-674c6806d0094ec2HighRated Interval validated92.32080430 / 44 / 20494 / 494247—2026-10-21Repaired
Kimi K3.1 ProE-16979a0a53d883feLowRated Interval validated88.81959429 / 5 / 60494 / 494247—2026-10-24First try
Kimi K3.1 ProE-21a068da70788af2HighLimited data88.719586 / 0 / 06 / 36630 faults2026-10-24First try
Grok 4.7E-7127b4821bb35d1fXHighRated Interval validated88.01937385 / 84 / 25494 / 494247—2026-09-30First try
Kimi K3.1 ProE-de0460316cadfcbcMaxRated Interval validated87.31919392 / 62 / 40494 / 494247—2026-10-24First try
Ox AlphaE-82c718cb6269d828MaxRated Interval validated87.31919422 / 2 / 70494 / 494247—2026-08-22Repaired
Claude Opus 5E-d8babc5495b1a188MediumRated Interval validated87.01910416 / 10 / 68494 / 494247—2026-07-25First try
Claude Fable 5E-54089f474d2eb1afXHighRated Interval validated86.91907395 / 51 / 48494 / 494247—2026-09-03First try
Claude Opus 5E-bd02f4c2907d0a7cMediumRated Interval validated86.41897415 / 6 / 73494 / 494247—2026-07-25First try