Game profile
Tumbleweed
Tumbleweed is a hex-grid territory game where players grow visible stacks and final control is determined by line-of-sight strength.
Scores here compare player programs using DuelLab's encoded rules for Tumbleweed; they are not a broad measure of human play strength.
By model and setting
GB2-08: Tumbleweed by model and setting
Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and uncertainty combine those contributing programs.
| Rank | Model | Reasoning | Score | Raw Elo | W / D / L | Uncertainty |
|---|---|---|---|---|---|---|
| 1 | XHigh | 100.0 | 2039.8 | 87 / 1 / 4 | 8.1 | |
| 2 | Low | 98.9 | 2018.0 | 165 / 0 / 7 | 0.0 | |
| 3 | High | 91.3 | 1945.9 | 148 / 2 / 20 | 0.0 | |
| 4 | Medium | 87.2 | 1917.1 | 80 / 1 / 13 | 7.5 | |
| 5 | Low | 85.5 | 1890.8 | 142 / 0 / 26 | 0.0 | |
| 6 | Medium | 84.3 | 1878.7 | 140 / 2 / 26 | 0.0 | |
| 7 | Medium | 84.1 | 1888.4 | 156 / 0 / 26 | 8.4 | |
| 8 | XHigh | 83.6 | 1883.3 | 77 / 0 / 13 | 8.7 | |
| 9 | XHigh | 81.0 | 1857.8 | 75 / 0 / 17 | 8.1 | |
| 10 | None | 75.1 | 1801.6 | 69 / 10 / 13 | 8.1 | |
| 11 | Medium | 74.2 | 1794.8 | 72 / 0 / 12 | 10.5 | |
| 12 | None | 73.8 | 1792.9 | 58 / 0 / 20 | 12.5 | |
| 13 | XHigh | 73.8 | 1788.8 | 58 / 12 / 22 | 8.1 | |
| 14 | XHigh | 72.3 | 1777.8 | 119 / 0 / 39 | 12.2 | |
| 15 | Medium | 71.2 | 1755.9 | 88 / 21 / 33 | 0.0 | |
| 16 | XHigh | 70.2 | 1756.3 | 63 / 0 / 23 | 9.9 | |
| 17 | None | 70.1 | 1757.3 | 57 / 3 / 18 | 12.5 | |
| 18 | None | 69.0 | 1741.3 | 61 / 7 / 32 | 6.0 | |
| 19 | None | 67.7 | 1724.8 | 190 / 14 / 54 | 3.0 | |
| 20 | Medium | 64.1 | 1696.9 | 55 / 16 / 19 | 8.7 | |
| 21 | Enabled | 63.1 | 1688.7 | 49 / 8 / 27 | 10.5 | |
| 22 | Historical | 60.1 | 1666.7 | 59 / 21 / 48 | 18.4 | |
| 23 | Minimal | 59.4 | 1652.4 | 53 / 4 / 33 | 8.7 | |
| 24 | Medium | 59.4 | 1652.2 | 53 / 20 / 17 | 8.7 | |
| 25 | XHigh | 59.0 | 1649.4 | 52 / 11 / 23 | 9.9 | |
| 26 | Medium | 55.4 | 1612.4 | 35 / 42 / 21 | 6.5 | |
| 27 | Medium | 52.2 | 1632.7 | 11 / 5 / 2 | 71.0 | |
| 28 | XHigh | 51.5 | 1577.3 | 43 / 13 / 30 | 9.9 | |
| 29 | Medium | 51.1 | 1574.6 | 67 / 46 / 53 | 10.8 | |
| 30 | High | 50.9 | 1561.7 | 115 / 97 / 86 | 0.0 | |
| 31 | None | 50.2 | 1571.8 | 45 / 54 / 29 | 18.5 | |
| 32 | High | 45.3 | 1507.7 | 130 / 187 / 137 | 0.0 | |
| 33 | None | 45.2 | 1515.1 | 8 / 73 / 15 | 7.0 | |
| 34 | Max | 44.5 | 1570.5 | 25 / 10 / 7 | 85.3 | |
| 35 | None | 44.0 | 1506.5 | 36 / 5 / 43 | 10.5 | |
| 36 | Reasoning | 43.1 | 1496.2 | 20 / 44 / 26 | 8.7 | |
| 37 | None | 43.1 | 1497.1 | 43 / 86 / 43 | 10.2 | |
| 38 | None | 41.5 | 1482.1 | 25 / 34 / 27 | 9.9 | |
| 39 | Medium | 41.5 | 1478.0 | 27 / 53 / 23 | 5.3 | |
| 40 | Minimal | 41.5 | 1535.5 | 3 / 13 / 0 | 77.5 | |
| 41 | High | 41.1 | 1476.2 | 31 / 26 / 37 | 7.5 | |
| 42 | Medium | 41.0 | 1471.6 | 28 / 57 / 27 | 3.3 | |
| 43 | Medium | 40.7 | 1472.2 | 18 / 48 / 30 | 7.0 | |
| 44 | Medium | 37.0 | 1432.5 | 36 / 37 / 45 | 2.1 | |
| 45 | High | 36.8 | 1497.4 | 12 / 17 / 13 | 85.3 | |
| 46 | Medium | 36.4 | 1429.5 | 33 / 37 / 34 | 5.0 | |
| 47 | Enabled | 36.3 | 1427.2 | 9 / 71 / 28 | 4.1 | |
| 48 | None | 36.3 | 1429.4 | 3 / 76 / 17 | 7.0 | |
| 49 | Medium | 36.2 | 1426.3 | 9 / 79 / 20 | 4.1 | |
| 50 | None | 36.0 | 1425.0 | 3 / 83 / 20 | 4.6 | |
| 51 | High | 35.9 | 1425.2 | 15 / 59 / 28 | 5.5 | |
| 52 | None | 35.8 | 1430.8 | 1 / 68 / 3 | 14.8 | |
| 53 | None | 35.5 | 1419.9 | 3 / 82 / 21 | 4.6 | |
| 54 | Enabled | 35.3 | 1417.7 | 0 / 88 / 18 | 4.6 | |
| 55 | Enabled | 35.2 | 1417.7 | 7 / 81 / 16 | 5.0 | |
| 56 | Medium | 35.0 | 1417.7 | 9 / 65 / 22 | 7.0 | |
| 57 | None | 35.0 | 1416.8 | 4 / 80 / 16 | 6.0 | |
| 58 | Max | 34.7 | 1468.6 | 0 / 16 / 1 | 74.1 | |
| 59 | Enabled | 34.6 | 1412.9 | 6 / 81 / 13 | 6.0 | |
| 60 | Medium | 34.6 | 1422.0 | 1 / 55 / 10 | 17.3 | |
| 61 | None | 34.2 | 1409.5 | 0 / 87 / 11 | 6.5 | |
| 62 | Medium | 34.1 | 1408.5 | 5 / 75 / 18 | 6.5 | |
| 63 | None | 34.1 | 1407.8 | 11 / 72 / 15 | 6.5 | |
| 64 | High | 33.9 | 1409.9 | 3 / 61 / 18 | 11.1 | |
| 65 | None | 33.9 | 1403.7 | 4 / 86 / 20 | 3.7 | |
| 66 | High | 33.8 | 1408.6 | 11 / 120 / 41 | 10.0 | |
| 67 | XHigh | 33.8 | 1406.8 | 1 / 69 / 22 | 8.1 | |
| 68 | None | 33.5 | 1407.8 | 0 / 66 / 12 | 12.5 | |
| 69 | Medium | 33.5 | 1409.5 | 4 / 128 / 12 | 14.8 | |
| 70 | XHigh | 33.4 | 1453.4 | 2 / 12 / 4 | 71.0 | |
| 71 | Medium | 33.3 | 1460.1 | 0 / 12 / 3 | 81.2 | |
| 72 | High | 33.1 | 1405.6 | 2 / 65 / 3 | 15.6 | |
| 73 | XHigh | 33.0 | 1403.0 | 2 / 55 / 19 | 13.2 | |
| 74 | Reasoning | 32.4 | 1396.0 | 0 / 66 / 14 | 11.8 | |
| 75 | High | 32.3 | 1380.0 | 12 / 129 / 43 | 0.0 | |
| 76 | None | 32.3 | 1389.5 | 6 / 181 / 21 | 5.0 | |
| 77 | High | 32.2 | 1391.3 | 4 / 66 / 22 | 8.1 | |
| 78 | None | 32.2 | 1391.9 | 2 / 64 / 22 | 9.2 | |
| 79 | None | 32.2 | 1452.7 | 0 / 10 / 4 | 85.3 | |
| 80 | None | 32.1 | 1387.6 | 6 / 179 / 29 | 4.4 | |
| 81 | High | 32.0 | 1392.7 | 0 / 63 / 17 | 11.8 | |
| 82 | Enabled | 31.4 | 1385.0 | 2 / 66 / 20 | 9.2 | |
| 83 | Medium | 31.3 | 1384.2 | 7 / 52 / 29 | 9.2 | |
| 84 | None | 31.3 | 1374.3 | 5 / 244 / 35 | 0.0 | |
| 85 | None | 31.1 | 1379.5 | 2 / 66 / 30 | 6.5 | |
| 86 | Enabled | 31.0 | 1370.9 | 60 / 95 / 150 | 0.0 | |
| 87 | Minimal | 30.5 | 1364.2 | 16 / 226 / 92 | 0.0 | |
| 88 | None | 30.1 | 1368.3 | 1 / 87 / 18 | 4.6 | |
| 89 | None | 30.0 | 1369.5 | 5 / 55 / 35 | 7.3 | |
| 90 | Enabled | 29.6 | 1355.6 | 14 / 224 / 94 | 0.0 | |
| 91 | Minimal | 29.0 | 1350.4 | 14 / 225 / 92 | 0.0 | |
| 92 | Medium | 28.8 | 1362.3 | 7 / 51 / 20 | 12.5 | |
| 93 | Medium | 28.6 | 1360.7 | 0 / 60 / 18 | 12.5 | |
| 94 | Low | 28.5 | 1346.5 | 5 / 105 / 47 | 0.0 | |
| 95 | High | 28.3 | 1343.0 | 17 / 93 / 68 | 0.0 | |
| 96 | Max | 27.9 | 1339.1 | 2 / 101 / 67 | 0.0 | |
| 97 | Enabled | 27.9 | 1370.0 | 0 / 71 / 19 | 33.2 | |
| 98 | Medium | 27.2 | 1334.2 | 13 / 209 / 90 | 0.0 | |
| 99 | High | 26.8 | 1329.9 | 6 / 100 / 56 | 0.0 | |
| 100 | Medium | 26.6 | 1329.0 | 11 / 92 / 50 | 0.0 | |
| 101 | Low | 26.4 | 1398.1 | 0 / 11 / 17 | 85.3 | |
| 102 | Medium | 25.1 | 1323.7 | 3 / 55 / 32 | 8.7 | |
| 103 | XHigh | 24.2 | 1316.0 | 2 / 51 / 35 | 9.2 | |
| 104 | High | 24.2 | 1316.0 | 0 / 57 / 29 | 9.9 | |
| 105 | Reasoning | 23.7 | 1311.6 | 2 / 54 / 30 | 9.9 | |
| 106 | Low | 22.8 | 1292.5 | 0 / 99 / 51 | 0.0 | |
| 107 | Low | 20.5 | 1270.6 | 3 / 89 / 58 | 0.0 | |
| 108 | Medium | 20.1 | 1277.9 | 2 / 40 / 40 | 11.1 | |
| 109 | Enabled | 13.7 | 1217.2 | 7 / 13 / 60 | 11.8 | |
| 110 | None | 0.0 | 1083.9 | 4 / 12 / 74 | 8.7 |
Underlying results
Individual player programs
Each row is one accepted player program for GB2-08: Tumbleweed. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.
| Player ID | Model | Reasoning | Status | Score | Elo | Confidence | W / D / L | Rated / attempted | Opponents | Capped draws | Faults / players | Generation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| E-12891afa894223fd | Claude Fable 5 | XHigh | Rated | 100.0 | 2040 | — | 87 / 1 / 4 | 92 / 92 | 43 | 1 | 0 / 1 | Repaired · 2026-07-02 |
| E-9ccf296d44d35675 | Claude Fable 5 | Medium | Rated | 74.2 | 1795 | — | 72 / 0 / 12 | 84 / 84 | 41 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-01b57d5e6655f927 | Claude Opus 4.5 | Thinking field omitted | Rated | 70.1 | 1757 | — | 57 / 3 / 18 | 78 / 78 | 39 | 3 | 0 / 1 | First try · 2026-07-02 |
| E-355427eb0d526f34 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-6a0c04b4335bfea0 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-72233463ddce5549 | Claude Opus 4.5 | Medium effort + 16,000 thinking tokens | Rated | 84.3 | 1879 | — | 140 / 2 / 26 | 168 / 168 | 69 | 2 | 0 / 1 | First try · 2026-07-21 |
| E-877eec51affacb3a | Claude Opus 4.5 | High effort + 32,000 thinking tokens | Rated | 28.3 | 1343 | — | 17 / 93 / 68 | 178 / 178 | 61 | 93 | 0 / 1 | First try · 2026-07-21 |
| E-22dc6fe5ae5fb8b1 | Claude Opus 4.8 | XHigh | Rated | 70.2 | 1756 | — | 63 / 0 / 23 | 86 / 86 | 41 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-c2dade0b97891d8a | Claude Opus 4.8 | Medium | Rated | 34.1 | 1409 | — | 5 / 75 / 18 | 98 / 98 | 48 | 75 | 0 / 1 | First try · 2026-07-02 |
| E-c9d7578e8375d994 | Claude Opus 4.8 | Thinking field omitted | Rated | 73.8 | 1793 | — | 58 / 0 / 20 | 78 / 78 | 39 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-35a5bf9b35d5e1e8 | Claude Opus 5 | Medium | Rated | 76.2 | 1813 | — | 72 / 0 / 18 | 90 / 90 | 45 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-43cc1c89fa5720b3 | Claude Opus 5 | Thinking disabled | Rated | 79.9 | 1838 | — | 124 / 14 / 20 | 158 / 158 | 60 | 14 | 0 / 1 | First try · 2026-07-25 |
| E-5a7942274854aaa6 | Claude Opus 5 | Thinking disabled | Rated | 55.4 | 1611 | — | 66 / 0 / 34 | 100 / 100 | 50 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-a40851c4f03704e5 | Claude Opus 5 | XHigh | Rated | 83.1 | 1882 | — | 65 / 0 / 13 | 78 / 78 | 33 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-e73b6fb78880341d | Claude Opus 5 | Medium | Rated | 92.0 | 1964 | — | 84 / 0 / 8 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-f5914ca845403384 | Claude Opus 5 | XHigh | Rated | 61.4 | 1674 | — | 54 / 0 / 26 | 80 / 80 | 36 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-01c56a1fc7407264 | Claude Sonnet 5 | Medium | Rated | 31.3 | 1384 | — | 7 / 52 / 29 | 88 / 88 | 42 | 52 | 0 / 1 | First try · 2026-08-09 |
| E-c2e7d7e507756f84 | Claude Sonnet 5 | Thinking disabled | Rated | 41.5 | 1482 | — | 25 / 34 / 27 | 86 / 86 | 42 | 34 | 0 / 1 | First try · 2026-08-09 |
| E-df0550ce48a0b895 | Claude Sonnet 5 | XHigh | Rated | 83.6 | 1883 | — | 77 / 0 / 13 | 90 / 90 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-c36a98e057c264eb | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 33.9 | 1404 | — | 4 / 86 / 20 | 110 / 110 | 48 | 86 | 0 / 1 | First try · 2026-07-11 |
| E-efd7b75d5cd3b538 | North Mini Code | Enabled | Rated | 28.8 | 1368 | — | 0 / 44 / 16 | 60 / 60 | 30 | 44 | 0 / 1 | First try · 2026-07-02 |
| E-4375cf96eeb624e2 | DeepSeek V4 Flash | Reasoning disabled | Rated | 35.0 | 1417 | — | 4 / 80 / 16 | 100 / 100 | 48 | 80 | 0 / 1 | Repaired · 2026-07-02 |
| E-43aba68125a9abc5 | DeepSeek V4 Flash | High | Rated | 35.8 | 1431 | — | 2 / 63 / 7 | 72 / 72 | 36 | 63 | 0 / 1 | First try · 2026-07-02 |
| E-a7310645c3b96434 | DeepSeek V4 Flash | XHigh | Rated | 33.8 | 1407 | — | 1 / 69 / 22 | 92 / 92 | 46 | 69 | 0 / 1 | Repaired · 2026-07-02 |
| E-d28ef17ff6995c62 | DeepSeek V4 Flash | High | Rated | 31.3 | 1388 | — | 2 / 65 / 5 | 72 / 72 | 36 | 65 | 0 / 1 | Repaired · 2026-07-01 |
| E-3a5b5c4507a989d3 | DeepSeek V4 Pro | XHigh | Rated | 33.0 | 1403 | — | 2 / 55 / 19 | 76 / 76 | 37 | 55 | 0 / 1 | Repaired · 2026-07-02 |
| E-c296a7abab6975d7 | DeepSeek V4 Pro | Reasoning disabled | Rated | 45.2 | 1515 | — | 8 / 73 / 15 | 96 / 96 | 47 | 73 | 0 / 1 | First try · 2026-07-02 |
| E-b335c9f92035f80b | Gemini 3.1 Flash Lite | High | Rated | 32.2 | 1391 | — | 4 / 66 / 22 | 92 / 92 | 45 | 66 | 0 / 1 | Repaired · 2026-07-02 |
| E-cc6fb78c96472032 | Gemini 3.1 Flash Lite | Medium | Rated | 37.0 | 1432 | — | 36 / 37 / 45 | 118 / 118 | 59 | 37 | 0 / 1 | First try · 2026-07-02 |
| E-5aa593158b0d8b3a | Gemini 3.5 Flash | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-bd0bbefbbd252fc5 | Gemini 3.5 Flash | Medium | Rated | 28.6 | 1361 | — | 0 / 60 / 18 | 78 / 78 | 39 | 60 | 0 / 1 | Repaired · 2026-07-02 |
| E-fa332e578ae97122 | Gemini 3.5 Flash | High | Rated | 24.2 | 1316 | — | 0 / 57 / 29 | 86 / 86 | 43 | 57 | 0 / 1 | Repaired · 2026-07-02 |
| E-284d554eca16e6f6 | Gemini 3.5 Flash Lite | Minimal | Rated | 29.5 | 1355 | — | 7 / 112 / 47 | 166 / 166 | 61 | 112 | 0 / 1 | First try · 2026-07-24 |
| E-2a14d2f80ade1bda | Gemini 3.5 Flash Lite | High | Rated | 26.8 | 1330 | — | 6 / 100 / 56 | 162 / 162 | 58 | 100 | 0 / 2 | First try · 2026-07-24 |
| E-2f2aa5b1beafd6e6 | Gemini 3.5 Flash Lite | Medium | Rated | 26.8 | 1330 | — | 7 / 109 / 44 | 160 / 160 | 60 | 109 | 0 / 1 | First try · 2026-07-24 |
| E-9b50de854a87d3c6 | Gemini 3.5 Flash Lite | Medium | Rated | 27.6 | 1339 | — | 6 / 100 / 46 | 152 / 152 | 56 | 100 | 0 / 1 | First try · 2026-07-24 |
| E-af119b49b8f1d63d | Gemini 3.5 Flash Lite | Minimal | Rated | 28.6 | 1346 | — | 7 / 113 / 45 | 165 / 165 | 60 | 113 | 0 / 1 | First try · 2026-07-24 |
| E-620b5ca2bcd82419 | Gemini 3.6 Flash | High | Rated | 72.9 | 1771 | — | 107 / 18 / 25 | 150 / 150 | 58 | 18 | 0 / 1 | First try · 2026-07-24 |
| E-657c523bc9e9f80c | Gemini 3.6 Flash | Minimal | Rated | 31.0 | 1369 | — | 7 / 111 / 48 | 166 / 166 | 61 | 111 | 0 / 1 | Repaired · 2026-07-24 |
| E-ab7ee826f8050f04 | Gemini 3.6 Flash | Medium | Rated | 71.2 | 1756 | — | 88 / 21 / 33 | 142 / 142 | 59 | 21 | 0 / 1 | First try · 2026-07-24 |
| E-c694a36a5e4e3f09 | Gemini 3.6 Flash | Minimal | Rated | 30.0 | 1359 | — | 9 / 115 / 44 | 168 / 168 | 62 | 115 | 0 / 1 | First try · 2026-07-24 |
| E-efad9f3f4e9183a0 | Gemini 3.6 Flash | High | Rated | 29.0 | 1352 | — | 8 / 79 / 61 | 148 / 148 | 58 | 79 | 0 / 1 | First try · 2026-07-24 |
| E-8546650b7690a81a | Gemma 4 31B | Reasoning disabled | Rated | 35.5 | 1420 | — | 3 / 82 / 21 | 106 / 106 | 51 | 82 | 0 / 1 | First try · 2026-07-02 |
| E-eabc996d553eebe0 | GPT 4.1 | None | Rated | 34.1 | 1408 | — | 11 / 72 / 15 | 98 / 98 | 46 | 72 | 0 / 1 | First try · 2026-07-02 |
| E-04ae9f2b42e0e036 | GPT 5 | Medium | Rated | 28.8 | 1362 | — | 7 / 51 / 20 | 78 / 78 | 37 | 51 | 0 / 1 | First try · 2026-07-02 |
| E-ae3a897b3420bcfb | GPT 5 | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ebca8ea756b4a4ad | GPT 5 | High | Rated | 35.9 | 1425 | — | 15 / 59 / 28 | 102 / 102 | 51 | 59 | 0 / 1 | First try · 2026-07-02 |
| E-07ad6c481bf678a2 | GPT-5.4 | None | Rated | 30.0 | 1370 | — | 5 / 55 / 35 | 95 / 95 | 42 | 55 | 0 / 1 | Repaired · 2026-08-09 |
| E-431ff31b9cd599e1 | GPT-5.4 | XHigh | Rated | 59.0 | 1649 | — | 52 / 11 / 23 | 86 / 86 | 42 | 11 | 0 / 1 | First try · 2026-08-09 |
| E-6b601c15cf117b79 | GPT-5.4 | Medium | Rated | 41.5 | 1478 | — | 27 / 53 / 23 | 103 / 103 | 47 | 53 | 0 / 1 | First try · 2026-08-09 |
| E-b5171a15f0048555 | GPT-5.4 Mini | Medium | Rated | 36.4 | 1429 | — | 33 / 37 / 34 | 104 / 104 | 49 | 37 | 0 / 1 | First try · 2026-07-02 |
| E-bb8ac98c284a38ce | GPT-5.4 Mini | None | Rated | 33.5 | 1408 | — | 0 / 66 / 12 | 78 / 80 | 39 | 66 | 2 / 1 | First try · 2026-07-02 |
| E-024aff0a983df40d | GPT-5.4 Nano | None | Rated | 31.4 | 1383 | — | 0 / 82 / 16 | 98 / 98 | 48 | 82 | 0 / 1 | First try · 2026-07-09 |
| E-26fa12e871bd8f3a | GPT-5.4 Nano | Medium | Rated | 25.5 | 1330 | — | 4 / 46 / 32 | 82 / 82 | 40 | 46 | 0 / 1 | Repaired · 2026-07-02 |
| E-e361d8cbba2abd67 | GPT-5.4 Nano | Medium | Rated | 76.8 | 1819 | — | 63 / 0 / 21 | 84 / 84 | 41 | 0 | 0 / 1 | Repaired · 2026-07-09 |
| E-fd5a36e5fd795426 | GPT-5.4 Nano | None | Rated | 54.7 | 1611 | — | 43 / 4 / 27 | 74 / 74 | 37 | 4 | 0 / 1 | Repaired · 2026-07-02 |
| E-0d83a3c5c5e66085 | GPT-5.5 | Medium | Rated | 55.4 | 1612 | — | 35 / 42 / 21 | 98 / 98 | 48 | 42 | 0 / 1 | First try · 2026-07-02 |
| E-3e859a6b27767128 | GPT-5.5 | XHigh | Rated | 73.8 | 1789 | — | 58 / 12 / 22 | 92 / 92 | 42 | 12 | 0 / 1 | First try · 2026-07-02 |
| E-c42fbee03a029c83 | GPT-5.5 | None | Rated | 36.3 | 1429 | — | 3 / 76 / 17 | 96 / 96 | 46 | 76 | 0 / 1 | First try · 2026-07-02 |
| E-283f17e4d25ffd65 | GPT-5.6 Luna | Medium | Rated | 25.1 | 1324 | — | 3 / 55 / 32 | 90 / 90 | 42 | 55 | 0 / 1 | First try · 2026-08-09 |
| E-b761803f2b99649c | GPT-5.6 Luna | None | Rated | 0.0 | 1084 | — | 4 / 12 / 74 | 90 / 90 | 43 | 12 | 0 / 1 | First try · 2026-08-09 |
| E-ca2978e1aca13fec | GPT-5.6 Luna | XHigh | Rated | 24.2 | 1316 | — | 2 / 51 / 35 | 88 / 88 | 42 | 51 | 0 / 1 | First try · 2026-08-09 |
| E-55079a10c13f4211 | GPT-5.6 Sol | Medium | Rated | 59.4 | 1652 | — | 53 / 20 / 17 | 90 / 90 | 42 | 20 | 0 / 1 | First try · 2026-08-09 |
| E-58adff67f80afed1 | GPT-5.6 Sol | XHigh | Rated | 81.0 | 1858 | — | 75 / 0 / 17 | 92 / 92 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-9c0688f3432e6295 | GPT-5.6 Sol | None | Rated | 75.1 | 1802 | — | 69 / 10 / 13 | 92 / 92 | 42 | 10 | 0 / 1 | First try · 2026-08-09 |
| E-44cace55a6126cdf | GPT-5.6 Terra | None | Rated | 32.2 | 1392 | — | 2 / 64 / 22 | 88 / 90 | 44 | 64 | 2 / 1 | First try · 2026-07-10 |
| E-b061663dc342c859 | GPT-5.6 Terra | XHigh | Rated | 51.5 | 1577 | — | 43 / 13 / 30 | 86 / 86 | 42 | 13 | 0 / 1 | Repaired · 2026-07-10 |
| E-d004e78844cdd202 | GPT-5.6 Terra | Medium | Rated | 40.7 | 1472 | — | 18 / 48 / 30 | 96 / 96 | 47 | 48 | 0 / 1 | First try · 2026-07-10 |
| E-11d1ae7d9526f835 | Ling 3.0 Flash | Baseline track (legacy evidence incomplete) | Rated | 31.9 | 1381 | — | 0 / 126 / 14 | 140 / 144 | 52 | 126 | 0 / 1 | First try · 2026-07-24 |
| E-28bcc8394e411616 | Ling 3.0 Flash | Baseline track (legacy evidence incomplete) | Rated | 30.6 | 1368 | — | 5 / 118 / 21 | 144 / 144 | 55 | 118 | 0 / 1 | Repaired · 2026-07-24 |
| E-87d69837bf65e78b | LongCat 2.0 | None | Rated | 30.9 | 1376 | — | 1 / 93 / 10 | 104 / 104 | 49 | 93 | 0 / 1 | First try · 2026-07-24 |
| E-d724da56cbc06da7 | LongCat 2.0 | Enabled | Rated | 5.3 | 1124 | — | 1 / 46 / 117 | 164 / 164 | 59 | 46 | 0 / 1 | First try · 2026-07-24 |
| E-df8e0fab4bf8bb33 | LongCat 2.0 | None | Rated | 33.6 | 1403 | — | 5 / 88 / 11 | 104 / 104 | 49 | 88 | 0 / 1 | First try · 2026-07-24 |
| E-ef389910f6cc07cc | LongCat 2.0 | Enabled | Rated | 56.7 | 1618 | — | 59 / 49 / 33 | 141 / 141 | 58 | 49 | 0 / 1 | First try · 2026-07-24 |
| E-20b4e41aba8e4f47 | Muse Spark 1.2 | Minimal | Rated | 59.4 | 1652 | — | 53 / 4 / 33 | 90 / 90 | 42 | 4 | 0 / 1 | First try · 2026-08-13 |
| E-502a038b3a2d63ef | Muse Spark 1.2 | Medium | Rated | 64.1 | 1697 | — | 55 / 16 / 19 | 90 / 90 | 42 | 16 | 0 / 1 | First try · 2026-08-13 |
| E-d169e7b29be70652 | Minimax M3 | Reasoning enabled | Rated | 35.2 | 1418 | — | 7 / 81 / 16 | 104 / 104 | 47 | 81 | 0 / 1 | Repaired · 2026-07-02 |
| E-e67e41d4491d7ad3 | Minimax M3 | Reasoning disabled | Rated | 44.0 | 1506 | — | 36 / 5 / 43 | 84 / 84 | 42 | 5 | 0 / 1 | First try · 2026-07-02 |
| E-ba85be2fa53925f5 | Mistral Medium 3.5 | None | Rated | 30.1 | 1368 | — | 1 / 87 / 18 | 106 / 106 | 53 | 87 | 0 / 1 | First try · 2026-07-02 |
| E-251b5d53a5f89562 | Kimi K2.7 Code | Reasoning enabled | Rated | 63.1 | 1689 | — | 49 / 8 / 27 | 84 / 84 | 39 | 8 | 0 / 1 | Repaired · 2026-07-02 |
| E-151c4ee6a2d1838e | Kimi K3 | High | Rated | 32.3 | 1380 | — | 12 / 129 / 43 | 184 / 184 | 71 | 129 | 0 / 1 | First try · 2026-07-24 |
| E-3e1be56b9d966ded | Kimi K3 | Low | Rated | 98.9 | 2018 | — | 165 / 0 / 7 | 172 / 172 | 67 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-506d972b5c69a00d | Nex N2 Pro | Reasoning disabled | Rated | 34.2 | 1410 | — | 0 / 87 / 11 | 98 / 98 | 48 | 87 | 0 / 1 | Repaired · 2026-07-11 |
| E-92332f4d765b2297 | Nex N2 Pro | Reasoning enabled | Rated | 13.7 | 1217 | — | 7 / 13 / 60 | 80 / 80 | 38 | 13 | 0 / 1 | Repaired · 2026-07-02 |
| E-15cf0dede27b7e1b | Nemotron 3 Ultra 550B A55B | Medium | Rated | 35.0 | 1418 | — | 9 / 65 / 22 | 96 / 96 | 48 | 65 | 0 / 1 | Repaired · 2026-07-02 |
| E-2e3c01d0103fc439 | Nemotron 3 Ultra 550B A55B | High | Rated | 34.0 | 1409 | — | 8 / 62 / 22 | 92 / 92 | 45 | 62 | 0 / 1 | Repaired · 2026-07-11 |
| E-8c24e8bcbe9b1228 | Nemotron 3 Ultra 550B A55B | High | Rated | 33.7 | 1409 | — | 3 / 58 / 19 | 80 / 80 | 38 | 58 | 0 / 1 | First try · 2026-07-02 |
| E-ada32b27ea6ffedd | Nemotron 3 Ultra 550B A55B | Reasoning disabled | Rated | 35.8 | 1431 | — | 1 / 68 / 3 | 72 / 72 | 36 | 68 | 0 / 1 | First try · 2026-07-02 |
| E-2270b9df7d2b32cc | O3 | High | Rated | 75.2 | 1794 | — | 114 / 1 / 35 | 150 / 150 | 58 | 1 | 0 / 1 | First try · 2026-07-03 |
| E-335ae90fdc702bd6 | O3 | Low | Rated | 28.5 | 1347 | — | 5 / 105 / 47 | 157 / 157 | 61 | 105 | 0 / 1 | First try · 2026-07-21 |
| E-35de956c8305ff90 | O3 | Medium | Rated | 41.0 | 1472 | — | 28 / 57 / 27 | 112 / 112 | 55 | 57 | 0 / 1 | First try · 2026-07-02 |
| E-9fbb8e6c69f575f4 | O3 | High | Rated | 25.5 | 1319 | — | 6 / 82 / 56 | 144 / 144 | 58 | 82 | 0 / 1 | First try · 2026-07-03 |
| E-afa6c09eebc859c4 | O3 | High | Rated | 35.2 | 1410 | — | 10 / 104 / 46 | 160 / 160 | 60 | 104 | 0 / 1 | First try · 2026-07-02 |
| E-24a75273941e6ea3 | GPT-OSS 120B | High | Rated | 33.9 | 1410 | — | 3 / 61 / 18 | 82 / 82 | 39 | 61 | 0 / 1 | Repaired · 2026-07-02 |
| E-6e65dec497ff2de3 | GPT-OSS 120B | Medium | Rated | 36.2 | 1426 | — | 9 / 79 / 20 | 108 / 108 | 51 | 79 | 0 / 1 | Repaired · 2026-07-02 |
| E-f6e9da46c61ad315 | GPT-OSS 120B | Low | Rated | 20.5 | 1271 | — | 3 / 89 / 58 | 150 / 150 | 62 | 89 | 0 / 1 | First try · 2026-07-21 |
| E-0fab95afbec0dd98 | Laguna S 2.1 | Enabled | Rated | 29.1 | 1351 | — | 7 / 111 / 48 | 166 / 166 | 63 | 111 | 0 / 1 | First try · 2026-07-24 |
| E-4030acdbccf3ca03 | Laguna S 2.1 | None | Rated | 31.7 | 1383 | — | 3 / 90 / 13 | 106 / 106 | 50 | 90 | 0 / 1 | Repaired · 2026-07-24 |
| E-e90a3ce84847ba43 | Laguna S 2.1 | None | Rated | 32.6 | 1392 | — | 3 / 89 / 16 | 108 / 108 | 51 | 89 | 0 / 1 | First try · 2026-07-24 |
| E-f72c72b8f264c57a | Laguna S 2.1 | Enabled | Rated | 30.0 | 1360 | — | 7 / 113 / 46 | 166 / 166 | 63 | 113 | 0 / 1 | First try · 2026-07-24 |
| E-64624689e7cbd439 | Qwen3.7 Max | Reasoning enabled | Rated | 36.3 | 1427 | — | 9 / 71 / 28 | 108 / 108 | 50 | 71 | 0 / 1 | Repaired · 2026-07-02 |
| E-a667eb7d15f7f43e | Qwen3.7 Max | Reasoning disabled | Rated | 31.1 | 1379 | — | 2 / 66 / 30 | 98 / 98 | 48 | 66 | 0 / 1 | First try · 2026-07-02 |
| E-6c2a9942e92223c8 | Qwen3.7 Plus | Reasoning enabled | Rated | 35.3 | 1418 | — | 0 / 88 / 18 | 106 / 106 | 50 | 88 | 0 / 1 | First try · 2026-07-02 |
| E-58e68aa5bf529b8a | Qwen3.8 Max | Medium | Limited data | 52.2 | 1633 | — | 11 / 5 / 2 | 18 / 18 | 7 | 5 | 0 / 1 | First try · 2026-08-08 |
| E-e77a22943f077d4d | Qwen3.8 Max | Minimal | Limited data | 41.5 | 1536 | — | 3 / 13 / 0 | 16 / 16 | 7 | 13 | 0 / 1 | First try · 2026-08-08 |
| E-eef649e110a96b98 | Qwen3.8 Max | XHigh | Limited data | 33.4 | 1453 | — | 2 / 12 / 4 | 18 / 18 | 8 | 12 | 0 / 1 | First try · 2026-08-18 |
| E-273045858e4a7f82 | Ox Alpha | High | Rated | 35.5 | 1484 | — | 3 / 7 / 4 | 14 / 14 | 7 | 7 | 0 / 1 | First try · 2026-08-22 |
| E-27b1ec2d9d5762a4 | Ox Alpha | Max | Rated | 54.9 | 1671 | — | 14 / 0 / 0 | 14 / 14 | 7 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-4e4d3135cae0253d | Ox Alpha | Low | Rated | 25.9 | 1393 | — | 0 / 5 / 9 | 14 / 14 | 7 | 5 | 0 / 1 | First try · 2026-08-22 |
| E-6b99e270ec28f9cf | Ox Alpha | Low | Rated | 27.0 | 1403 | — | 0 / 6 / 8 | 14 / 14 | 7 | 6 | 0 / 1 | First try · 2026-08-22 |
| E-8094ab91b5be5ad0 | Ox Alpha | High | Rated | 43.7 | 1563 | — | 8 / 3 / 3 | 14 / 14 | 7 | 3 | 0 / 1 | First try · 2026-08-22 |
| E-a87ab54ca8c5ca34 | Ox Alpha | High | Rated | 31.3 | 1444 | — | 1 / 7 / 6 | 14 / 14 | 7 | 7 | 0 / 1 | Repaired · 2026-08-22 |
| E-ec8f506d56ff547e | Ox Alpha | Max | Rated | 35.1 | 1481 | — | 3 / 7 / 4 | 14 / 14 | 7 | 7 | 0 / 1 | First try · 2026-08-22 |
| E-f84aa60bad19339a | Ox Alpha | Max | Rated | 43.3 | 1560 | — | 8 / 3 / 3 | 14 / 14 | 7 | 3 | 0 / 1 | First try · 2026-08-22 |
| E-8b265019ada47f24 | Step 3.7 Flash | High | Rated | 32.0 | 1393 | — | 0 / 63 / 17 | 80 / 80 | 38 | 63 | 0 / 1 | Repaired · 2026-07-02 |
| E-c38fe2712e69333b | Step 3.7 Flash | Low | Rated | 22.8 | 1293 | — | 0 / 99 / 51 | 150 / 150 | 62 | 99 | 0 / 1 | First try · 2026-07-21 |
| E-56487337fad4192f | Hy3 Preview | None | Rated | 36.0 | 1425 | — | 3 / 83 / 20 | 106 / 106 | 51 | 83 | 0 / 1 | First try · 2026-07-02 |
| E-81a5e5ef15f371dc | Hy3 Preview | High | Rated | 41.1 | 1476 | — | 31 / 26 / 37 | 94 / 94 | 46 | 26 | 0 / 1 | First try · 2026-07-02 |
| E-68669040dc891a7d | Inkling | None | Rated | 69.0 | 1741 | — | 61 / 7 / 32 | 100 / 100 | 48 | 7 | 0 / 1 | Repaired · 2026-07-24 |
| E-9f74dab09049a473 | Inkling | Medium | Rated | 26.6 | 1329 | — | 11 / 92 / 50 | 153 / 153 | 58 | 92 | 0 / 1 | First try · 2026-07-24 |
| E-d21921560d198b28 | Inkling | Max | Rated | 27.9 | 1339 | — | 2 / 101 / 67 | 170 / 170 | 63 | 101 | 0 / 1 | Repaired · 2026-07-24 |
| E-888363fef76ee16a | Inkling Small | Max | Limited data | 34.7 | 1469 | — | 0 / 16 / 1 | 17 / 17 | 8 | 16 | 0 / 1 | Repaired · 2026-08-09 |
| E-99211d414b6fcc51 | Inkling Small | None | Limited data | 32.2 | 1453 | — | 0 / 10 / 4 | 14 / 14 | 6 | 10 | 0 / 1 | Repaired · 2026-08-09 |
| E-9cd2fd1302bb65bd | Inkling Small | Medium | Limited data | 33.3 | 1460 | — | 0 / 12 / 3 | 15 / 15 | 7 | 12 | 0 / 1 | First try · 2026-08-09 |
| E-707dd709e358a173 | Grok 4.5 | High | Rated | 91.3 | 1946 | — | 148 / 2 / 20 | 170 / 170 | 64 | 2 | 0 / 1 | First try · 2026-07-24 |
| E-73422318071a105c | Grok 4.5 | Medium | Rated | 87.2 | 1917 | — | 80 / 1 / 13 | 94 / 94 | 47 | 1 | 0 / 1 | First try · 2026-07-24 |
| E-b914d026c7631fcb | Grok 4.5 | Low | Rated | 85.5 | 1891 | — | 142 / 0 / 26 | 168 / 168 | 69 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-3e2fe948d2bcebb0 | Grok Build 0.1 | Reasoning enabled | Rated | 34.6 | 1413 | — | 6 / 81 / 13 | 100 / 100 | 50 | 81 | 0 / 1 | Repaired · 2026-07-02 |
| E-5f664f9580459829 | MiMo-V2.5 | High | Rated | 33.1 | 1406 | — | 2 / 65 / 3 | 70 / 70 | 35 | 65 | 0 / 1 | Repaired · 2026-07-02 |
| E-650d06103e7fa176 | MiMo-V2.5 | Reasoning enabled | Rated | 43.1 | 1496 | — | 20 / 44 / 26 | 90 / 90 | 43 | 44 | 0 / 1 | Repaired · 2026-07-03 |
| E-b5eb7da0f5021b69 | MiMo-V2.5 | Reasoning enabled | Rated | 20.1 | 1278 | — | 2 / 40 / 40 | 82 / 82 | 38 | 40 | 0 / 1 | Repaired · 2026-07-02 |
| E-cabbf604f15eb575 | MiMo-V2.5 | Reasoning disabled | Rated | 23.7 | 1312 | — | 2 / 54 / 30 | 86 / 86 | 43 | 54 | 0 / 1 | First try · 2026-07-02 |
| E-d51fce0298267f96 | MiMo-V2.5 | Reasoning disabled | Rated | 32.4 | 1396 | — | 0 / 66 / 14 | 80 / 80 | 40 | 66 | 0 / 1 | First try · 2026-07-01 |
| E-bd1bb7ac29877b8f | MiMo-V2.5-Pro | Reasoning enabled | Rated | 31.4 | 1385 | — | 2 / 66 / 20 | 88 / 88 | 41 | 66 | 0 / 1 | Repaired · 2026-07-02 |
| E-6a361d88d8c1fb48 | GLM-5.2 | Reasoning disabled | Rated | 34.3 | 1417 | — | 3 / 54 / 13 | 70 / 70 | 35 | 54 | 0 / 1 | First try · 2026-07-11 |
| E-97efd9455394f6d7 | GLM-5.2 | Reasoning disabled | Rated | 66.1 | 1726 | — | 42 / 0 / 16 | 58 / 58 | 29 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-da1e9a6be31e371f | GLM-5.2 | High | Rated | 34.6 | 1422 | — | 1 / 55 / 10 | 66 / 66 | 33 | 55 | 0 / 1 | Repaired · 2026-07-11 |