Game profile
Game of the Amazons
Game of the Amazons is a 10x10 mobility and territory game where each move relocates an amazon and then fires a permanent blocking arrow.
Scores here compare player programs using DuelLab's encoded rules for Game of the Amazons; they are not a broad measure of human play strength.
By model and setting
GB2-07: Game of the Amazons by model and setting
Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and uncertainty combine those contributing programs.
| Rank | Model | Reasoning | Score | Raw Elo | W / D / L | Uncertainty |
|---|---|---|---|---|---|---|
| 1 | XHigh | 100.0 | 2007.8 | 67 / 0 / 1 | 16.4 | |
| 2 | XHigh | 98.4 | 1985.9 | 89 / 0 / 1 | 8.7 | |
| 3 | XHigh | 93.8 | 1944.0 | 76 / 0 / 6 | 11.1 | |
| 4 | XHigh | 90.5 | 1908.6 | 89 / 0 / 7 | 7.0 | |
| 5 | Medium | 87.4 | 1883.5 | 131 / 0 / 27 | 12.4 | |
| 6 | Medium | 84.6 | 1852.4 | 81 / 0 / 11 | 8.1 | |
| 7 | None | 81.4 | 1824.0 | 63 / 0 / 19 | 11.1 | |
| 8 | Enabled | 79.1 | 1805.4 | 58 / 0 / 14 | 14.8 | |
| 9 | XHigh | 77.8 | 1790.5 | 61 / 0 / 17 | 12.5 | |
| 10 | XHigh | 76.4 | 1776.6 | 59 / 0 / 21 | 11.8 | |
| 11 | Low | 76.3 | 1764.6 | 110 / 0 / 32 | 0.0 | |
| 12 | XHigh | 74.9 | 1760.0 | 70 / 0 / 20 | 8.7 | |
| 13 | Medium | 73.9 | 1752.2 | 55 / 0 / 25 | 11.8 | |
| 14 | Minimal | 73.0 | 1732.8 | 196 / 0 / 94 | 0.0 | |
| 15 | XHigh | 72.8 | 1741.8 | 52 / 0 / 28 | 11.8 | |
| 16 | XHigh | 72.3 | 1737.3 | 55 / 0 / 25 | 11.8 | |
| 17 | XHigh | 72.3 | 1734.1 | 70 / 0 / 22 | 8.1 | |
| 18 | Medium | 72.2 | 1737.0 | 59 / 0 / 17 | 13.2 | |
| 19 | Medium | 70.5 | 1717.0 | 70 / 0 / 22 | 8.1 | |
| 20 | None | 68.9 | 1704.7 | 51 / 0 / 27 | 12.5 | |
| 21 | Medium | 68.8 | 1702.8 | 57 / 0 / 27 | 10.5 | |
| 22 | XHigh | 68.7 | 1745.0 | 20 / 0 / 0 | 65.4 | |
| 23 | High | 65.7 | 1660.7 | 101 / 0 / 57 | 0.0 | |
| 24 | Medium | 64.8 | 1660.3 | 60 / 0 / 40 | 6.0 | |
| 25 | High | 64.3 | 1660.9 | 43 / 0 / 35 | 12.5 | |
| 26 | None | 63.5 | 1652.7 | 56 / 0 / 24 | 11.8 | |
| 27 | Medium | 62.9 | 1644.7 | 52 / 0 / 34 | 9.9 | |
| 28 | Medium | 62.6 | 1641.4 | 56 / 0 / 32 | 9.2 | |
| 29 | XHigh | 61.3 | 1629.3 | 43 / 0 / 43 | 9.9 | |
| 30 | Max | 60.4 | 1608.1 | 108 / 0 / 64 | 0.0 | |
| 31 | Historical | 59.6 | 1620.1 | 74 / 0 / 56 | 17.9 | |
| 32 | High | 59.2 | 1609.3 | 48 / 0 / 38 | 9.9 | |
| 33 | Medium | 56.9 | 1584.8 | 53 / 0 / 45 | 6.5 | |
| 34 | Medium | 56.3 | 1567.6 | 90 / 0 / 96 | 0.0 | |
| 35 | Medium | 55.9 | 1578.7 | 47 / 0 / 35 | 11.1 | |
| 36 | Medium | 55.6 | 1567.0 | 155 / 0 / 111 | 1.0 | |
| 37 | None | 55.6 | 1575.9 | 52 / 0 / 30 | 11.1 | |
| 38 | Minimal | 55.0 | 1558.5 | 161 / 0 / 144 | 0.0 | |
| 39 | Low | 54.0 | 1547.9 | 82 / 0 / 78 | 0.0 | |
| 40 | None | 53.7 | 1559.9 | 37 / 0 / 35 | 14.8 | |
| 41 | None | 53.0 | 1548.4 | 56 / 0 / 37 | 7.8 | |
| 42 | None | 53.0 | 1549.5 | 51 / 0 / 35 | 9.9 | |
| 43 | Medium | 52.4 | 1549.6 | 41 / 0 / 27 | 16.4 | |
| 44 | None | 52.4 | 1543.1 | 79 / 0 / 99 | 9.0 | |
| 45 | Medium | 52.4 | 1542.7 | 51 / 0 / 39 | 8.7 | |
| 46 | None | 51.2 | 1539.9 | 59 / 0 / 65 | 19.3 | |
| 47 | Reasoning | 50.0 | 1523.2 | 44 / 0 / 34 | 12.5 | |
| 48 | High | 49.6 | 1505.6 | 90 / 0 / 72 | 0.0 | |
| 49 | Medium | 49.5 | 1513.5 | 55 / 0 / 43 | 6.5 | |
| 50 | Enabled | 49.3 | 1510.2 | 56 / 0 / 46 | 5.5 | |
| 51 | Minimal | 49.2 | 1559.3 | 12 / 0 / 7 | 68.1 | |
| 52 | High | 49.0 | 1500.2 | 87 / 0 / 67 | 0.0 | |
| 53 | Enabled | 48.6 | 1504.7 | 50 / 0 / 46 | 7.0 | |
| 54 | Max | 48.2 | 1557.9 | 31 / 0 / 17 | 77.5 | |
| 55 | Enabled | 47.8 | 1495.3 | 58 / 0 / 50 | 4.1 | |
| 56 | Medium | 47.5 | 1543.3 | 11 / 0 / 8 | 68.1 | |
| 57 | Enabled | 47.0 | 1488.0 | 55 / 0 / 51 | 4.6 | |
| 58 | High | 47.0 | 1481.6 | 282 / 0 / 326 | 0.0 | |
| 59 | None | 46.9 | 1488.6 | 52 / 0 / 44 | 7.0 | |
| 60 | High | 46.9 | 1480.1 | 149 / 0 / 154 | 0.0 | |
| 61 | High | 46.4 | 1483.7 | 34 / 0 / 62 | 7.0 | |
| 62 | None | 44.1 | 1461.7 | 51 / 0 / 47 | 6.5 | |
| 63 | Enabled | 43.1 | 1450.5 | 51 / 0 / 51 | 5.5 | |
| 64 | Enabled | 43.0 | 1457.3 | 160 / 0 / 206 | 15.0 | |
| 65 | None | 42.8 | 1450.1 | 51 / 0 / 41 | 8.1 | |
| 66 | High | 41.7 | 1441.4 | 30 / 0 / 54 | 10.5 | |
| 67 | None | 41.1 | 1432.7 | 97 / 0 / 93 | 7.3 | |
| 68 | Enabled | 40.9 | 1441.6 | 61 / 0 / 59 | 20.7 | |
| 69 | Enabled | 40.4 | 1426.9 | 48 / 0 / 46 | 7.5 | |
| 70 | None | 40.4 | 1426.4 | 43 / 0 / 51 | 7.5 | |
| 71 | Low | 39.6 | 1475.1 | 21 / 0 / 27 | 77.5 | |
| 72 | Medium | 38.9 | 1414.3 | 74 / 0 / 96 | 10.2 | |
| 73 | High | 38.8 | 1467.0 | 20 / 0 / 28 | 77.5 | |
| 74 | None | 38.4 | 1408.0 | 36 / 0 / 52 | 9.2 | |
| 75 | Low | 38.0 | 1393.0 | 67 / 0 / 105 | 0.0 | |
| 76 | Medium | 38.0 | 1454.1 | 8 / 0 / 10 | 71.0 | |
| 77 | Medium | 37.7 | 1407.3 | 56 / 0 / 80 | 16.4 | |
| 78 | Medium | 37.1 | 1393.5 | 38 / 0 / 60 | 6.5 | |
| 79 | Medium | 37.0 | 1392.5 | 52 / 0 / 50 | 5.5 | |
| 80 | Enabled | 36.2 | 1377.2 | 123 / 0 / 187 | 0.0 | |
| 81 | None | 35.3 | 1380.3 | 32 / 0 / 48 | 11.8 | |
| 82 | None | 35.2 | 1375.7 | 34 / 0 / 62 | 7.0 | |
| 83 | None | 33.5 | 1406.4 | 6 / 0 / 14 | 65.4 | |
| 84 | None | 32.8 | 1357.2 | 34 / 0 / 44 | 12.5 | |
| 85 | High | 32.6 | 1352.7 | 33 / 0 / 56 | 9.0 | |
| 86 | Minimal | 31.5 | 1342.4 | 30 / 0 / 58 | 9.2 | |
| 87 | Reasoning | 31.2 | 1337.9 | 40 / 0 / 52 | 8.1 | |
| 88 | Medium | 31.2 | 1338.2 | 29 / 0 / 61 | 8.7 | |
| 89 | None | 31.1 | 1335.9 | 46 / 0 / 52 | 6.5 | |
| 90 | None | 29.7 | 1323.5 | 37 / 0 / 57 | 7.5 | |
| 91 | High | 28.9 | 1306.5 | 47 / 0 / 107 | 0.0 | |
| 92 | Low | 27.9 | 1295.2 | 54 / 0 / 118 | 0.0 | |
| 93 | High | 27.3 | 1300.4 | 34 / 0 / 58 | 8.1 | |
| 94 | Max | 25.8 | 1275.5 | 45 / 0 / 121 | 0.0 | |
| 95 | None | 24.9 | 1278.3 | 53 / 0 / 123 | 9.3 | |
| 96 | Enabled | 23.6 | 1264.6 | 30 / 0 / 62 | 8.1 | |
| 97 | Max | 22.0 | 1305.1 | 1 / 0 / 15 | 77.5 | |
| 98 | High | 19.9 | 1231.2 | 20 / 0 / 64 | 10.5 | |
| 99 | None | 19.0 | 1224.1 | 24 / 0 / 56 | 11.8 | |
| 100 | Medium | 14.6 | 1169.2 | 39 / 0 / 113 | 0.0 | |
| 101 | Medium | 12.4 | 1160.3 | 19 / 0 / 61 | 11.8 | |
| 102 | None | 11.8 | 1151.8 | 13 / 0 / 79 | 8.1 | |
| 103 | Reasoning | 11.8 | 1154.5 | 24 / 0 / 56 | 11.8 | |
| 104 | None | 10.5 | 1144.7 | 9 / 0 / 61 | 15.6 | |
| 105 | Low | 9.1 | 1114.7 | 24 / 0 / 138 | 0.0 | |
| 106 | None | 7.1 | 1108.5 | 13 / 0 / 69 | 11.1 | |
| 107 | Medium | 6.6 | 1092.5 | 17 / 0 / 135 | 0.0 | |
| 108 | None | 3.6 | 1075.8 | 17 / 0 / 61 | 12.5 | |
| 109 | Medium | 0.5 | 1045.5 | 11 / 0 / 69 | 11.8 | |
| 110 | None | 0.0 | 1044.3 | 4 / 0 / 64 | 16.4 |
Underlying results
Individual player programs
Each row is one accepted player program for GB2-07: Game of the Amazons. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.
| Player ID | Model | Reasoning | Status | Score | Elo | Confidence | W / D / L | Rated / attempted | Opponents | Capped draws | Faults / players | Generation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| E-babd82321b910e7b | Claude Fable 5 | XHigh | Rated | 72.8 | 1742 | — | 52 / 0 / 28 | 80 / 80 | 38 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-bc12a8303ec2def7 | Claude Fable 5 | Medium | Rated | 72.2 | 1737 | — | 59 / 0 / 17 | 76 / 76 | 38 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ca22621c58b6f244 | Claude Opus 4.5 | Thinking field omitted | Rated | 46.9 | 1489 | — | 52 / 0 / 44 | 96 / 96 | 48 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-e7848fdc8b4ffd95 | Claude Opus 4.5 | Medium effort + 16,000 thinking tokens | Rated | 56.3 | 1568 | — | 90 / 0 / 96 | 186 / 186 | 70 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-e8719bed57f17312 | Claude Opus 4.5 | High effort + 32,000 thinking tokens | Rated | 49.6 | 1506 | — | 90 / 0 / 72 | 162 / 162 | 57 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ed9657bcd9dfeda4 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-f2d7a3f3bae22998 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-0bf7b9ed307db853 | Claude Opus 4.8 | Medium | Rated | 68.8 | 1703 | — | 57 / 0 / 27 | 84 / 84 | 42 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-5e09cecd1172d99b | Claude Opus 4.8 | XHigh | Rated | 77.8 | 1791 | — | 61 / 0 / 17 | 78 / 78 | 38 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-76804598cce96e62 | Claude Opus 4.8 | Thinking field omitted | Rated | 55.6 | 1576 | — | 52 / 0 / 30 | 82 / 82 | 41 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-1e882072d8d97548 | Claude Opus 5 | XHigh | Rated | 100.0 | 2008 | — | 67 / 0 / 1 | 68 / 68 | 32 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-54bca3ce32fa85ae | Claude Opus 5 | Medium | Rated | 96.6 | 1974 | — | 67 / 0 / 3 | 70 / 70 | 35 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-914b104a64ab3110 | Claude Opus 5 | Thinking disabled | Rated | 81.4 | 1824 | — | 63 / 0 / 19 | 82 / 82 | 41 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-de5e72176c4f0dc9 | Claude Opus 5 | Medium | Rated | 78.3 | 1793 | — | 64 / 0 / 24 | 88 / 88 | 44 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-754e53d1d8048114 | Claude Sonnet 5 | Thinking disabled | Rated | 38.4 | 1408 | — | 36 / 0 / 52 | 88 / 88 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-a0f9e38d7d75c542 | Claude Sonnet 5 | Medium | Rated | 52.4 | 1543 | — | 51 / 0 / 39 | 90 / 90 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-d751b3c423ad89f1 | Claude Sonnet 5 | XHigh | Rated | 72.3 | 1734 | — | 70 / 0 / 22 | 92 / 92 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-1c961fde1b53f0eb | North Mini Code | Enabled | Rated | 36.6 | 1397 | — | 27 / 0 / 41 | 68 / 68 | 34 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3b908f26a42804a4 | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 42.3 | 1446 | — | 45 / 0 / 47 | 92 / 92 | 42 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-c7f5dc6d5d3c2a8d | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 7.4 | 1111 | — | 8 / 0 / 76 | 84 / 88 | 40 | 0 | 4 / 1 | Repaired · 2026-07-11 |
| E-8f2f6c973751f183 | DeepSeek V4 Flash | High | Rated | 28.4 | 1318 | — | 23 / 0 / 45 | 68 / 68 | 34 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-c394c0713cfcfaa4 | DeepSeek V4 Flash | Reasoning disabled | Rated | 32.8 | 1357 | — | 34 / 0 / 44 | 78 / 78 | 39 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ecf2a6ea6f9fe06c | DeepSeek V4 Flash | XHigh | Rated | 72.3 | 1737 | — | 55 / 0 / 25 | 80 / 80 | 39 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-edc2d085c4253ed3 | DeepSeek V4 Flash | High | Rated | 46.9 | 1496 | — | 33 / 0 / 35 | 68 / 68 | 34 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-f398fd6ac8c8bada | DeepSeek V4 Pro | XHigh | Rated | 61.3 | 1629 | — | 43 / 0 / 43 | 86 / 86 | 42 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-f76d96b0f3163d4b | DeepSeek V4 Pro | Reasoning disabled | Rated | 42.8 | 1450 | — | 51 / 0 / 41 | 92 / 92 | 45 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0d43f308cfa4da52 | Gemini 3.1 Flash Lite | High | Rated | 46.4 | 1484 | — | 34 / 0 / 62 | 96 / 96 | 46 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1b3c52da51dfbdd4 | Gemini 3.1 Flash Lite | Medium | Rated | 0.5 | 1045 | — | 11 / 0 / 69 | 80 / 80 | 38 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3d6a15fe821fe6ad | Gemini 3.1 Flash Lite | Reasoning disabled | Rated | 0.0 | 1044 | — | 4 / 0 / 64 | 68 / 68 | 34 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-5447c508e2b0ab6c | Gemini 3.5 Flash | Medium | Rated | 56.9 | 1585 | — | 53 / 0 / 45 | 98 / 98 | 48 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-c9fe3c158f1169e0 | Gemini 3.5 Flash | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-f7f306cca2bb9532 | Gemini 3.5 Flash | High | Rated | 64.3 | 1661 | — | 43 / 0 / 35 | 78 / 78 | 37 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-455ee67905f5f955 | Gemini 3.5 Flash Lite | Minimal | Rated | 62.4 | 1631 | — | 77 / 0 / 65 | 142 / 142 | 55 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c4d27e5c752afb39 | Gemini 3.5 Flash Lite | High | Rated | 45.6 | 1468 | — | 70 / 0 / 82 | 152 / 152 | 53 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e2e240babaf0b862 | Gemini 3.5 Flash Lite | Minimal | Rated | 83.7 | 1835 | — | 119 / 0 / 29 | 148 / 148 | 58 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f74134262b66367b | Gemini 3.5 Flash Lite | Medium | Rated | 14.6 | 1169 | — | 39 / 0 / 113 | 152 / 152 | 60 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f746ec3aee7874b2 | Gemini 3.5 Flash Lite | High | Rated | 48.1 | 1492 | — | 79 / 0 / 72 | 151 / 151 | 57 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-1f7519ff2c4a840c | Gemini 3.6 Flash | Medium | Rated | 66.4 | 1669 | — | 87 / 0 / 61 | 148 / 148 | 60 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-65c6c8e09fe2c210 | Gemini 3.6 Flash | Medium | Rated | 44.9 | 1465 | — | 68 / 0 / 50 | 118 / 118 | 59 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8e9b51be911dad38 | Gemini 3.6 Flash | Minimal | Rated | 39.4 | 1408 | — | 66 / 0 / 91 | 157 / 161 | 55 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-a2d90fcdc2f4ef9d | Gemini 3.6 Flash | Minimal | Rated | 70.6 | 1709 | — | 95 / 0 / 53 | 148 / 148 | 58 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f6ecc1626f38fa34 | Gemini 3.6 Flash | High | Rated | 49.0 | 1500 | — | 87 / 0 / 67 | 154 / 154 | 55 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-3f820f7e8ff15839 | Gemma 4 31B | Reasoning disabled | Rated | 19.0 | 1224 | — | 24 / 0 / 56 | 80 / 82 | 40 | 0 | 2 / 1 | Repaired · 2026-07-02 |
| E-f417d302c870dfa6 | Gemma 4 31B | Reasoning enabled | Rated | 40.4 | 1427 | — | 48 / 0 / 46 | 94 / 94 | 45 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-fcfa606d3cbb0ba0 | GPT 4.1 | None | Rated | 53.7 | 1560 | — | 37 / 0 / 35 | 72 / 72 | 36 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-15dad0db253c0497 | GPT 5 | High | Rated | 59.2 | 1609 | — | 48 / 0 / 38 | 86 / 86 | 42 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-4d8b4cfcff519db6 | GPT 5 | Medium | Rated | 62.9 | 1645 | — | 52 / 0 / 34 | 86 / 86 | 43 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-a67f59519ca31035 | GPT 5 | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-1d11cba509a3ee65 | GPT-5.4 | Medium | Rated | 37.1 | 1393 | — | 38 / 0 / 60 | 98 / 98 | 43 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-323834608cbfa7f4 | GPT-5.4 | None | Rated | 35.2 | 1376 | — | 34 / 0 / 62 | 96 / 96 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-9bc57dfe55b73887 | GPT-5.4 | XHigh | Rated | 90.5 | 1909 | — | 89 / 0 / 7 | 96 / 96 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-c2ab31787514c10c | GPT-5.4 Mini | None | Rated | 7.1 | 1109 | — | 13 / 0 / 69 | 82 / 84 | 41 | 0 | 2 / 1 | First try · 2026-07-02 |
| E-f4d7ac8a0f5d2974 | GPT-5.4 Mini | Medium | Rated | 49.5 | 1513 | — | 55 / 0 / 43 | 98 / 98 | 48 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-4e14ae758717169e | GPT-5.4 Nano | None | Rated | 29.7 | 1323 | — | 37 / 0 / 57 | 94 / 94 | 47 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-bea6d7d9558897f9 | GPT-5.4 Nano | Medium | Rated | 12.9 | 1164 | — | 14 / 0 / 68 | 82 / 82 | 40 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ce04fd14b6f43868 | GPT-5.4 Nano | Medium | Rated | 65.0 | 1665 | — | 60 / 0 / 28 | 88 / 88 | 44 | 0 | 0 / 1 | Repaired · 2026-07-09 |
| E-4edfe4117ad3e936 | GPT-5.5 | None | Rated | 44.1 | 1462 | — | 51 / 0 / 47 | 98 / 98 | 49 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-6201278165db862a | GPT-5.5 | XHigh | Rated | 93.8 | 1944 | — | 76 / 0 / 6 | 82 / 82 | 40 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-640b3078b8bce40e | GPT-5.5 | Medium | Rated | 73.9 | 1752 | — | 55 / 0 / 25 | 80 / 80 | 39 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-8fd5624103eac132 | GPT-5.6 Luna | None | Rated | 11.8 | 1152 | — | 13 / 0 / 79 | 92 / 92 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-af6cc32d5ba04b84 | GPT-5.6 Luna | Medium | Rated | 31.2 | 1338 | — | 29 / 0 / 61 | 90 / 90 | 43 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-d86d2f05318f688d | GPT-5.6 Luna | XHigh | Rated | 74.9 | 1760 | — | 70 / 0 / 20 | 90 / 90 | 43 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-475950cead6d8909 | GPT-5.6 Sol | XHigh | Rated | 98.4 | 1986 | — | 89 / 0 / 1 | 90 / 90 | 42 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-6e22708296e06d4c | GPT-5.6 Sol | Medium | Rated | 84.6 | 1852 | — | 81 / 0 / 11 | 92 / 92 | 43 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-e65ec062f67d1b0b | GPT-5.6 Sol | None | Rated | 53.0 | 1548 | — | 56 / 0 / 37 | 93 / 93 | 43 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-65bf9818e3e1b632 | GPT-5.6 Terra | XHigh | Rated | 76.4 | 1777 | — | 59 / 0 / 21 | 80 / 80 | 40 | 0 | 0 / 1 | First try · 2026-07-10 |
| E-8ebe8776c7d44d46 | GPT-5.6 Terra | None | Rated | 40.4 | 1426 | — | 43 / 0 / 51 | 94 / 94 | 46 | 0 | 0 / 1 | First try · 2026-07-10 |
| E-aca193dd2a8774fb | GPT-5.6 Terra | Medium | Rated | 37.0 | 1392 | — | 52 / 0 / 50 | 102 / 102 | 50 | 0 | 0 / 1 | Repaired · 2026-07-10 |
| E-57b2b1d3b488c246 | Ling 3.0 Flash | Enabled | Rated | 44.4 | 1484 | — | 20 / 0 / 24 | 44 / 44 | 22 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-5e20a850f6c14680 | Ling 3.0 Flash | Enabled | Rated | 39.2 | 1432 | — | 18 / 0 / 28 | 46 / 46 | 23 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-28ec7bff448d69bb | LongCat 2.0 | Enabled | Rated | 63.8 | 1643 | — | 96 / 0 / 62 | 158 / 158 | 62 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c1f595f47c71e648 | LongCat 2.0 | None | Rated | 36.9 | 1393 | — | 51 / 0 / 43 | 94 / 94 | 46 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e2db910734ca5315 | LongCat 2.0 | None | Rated | 45.2 | 1473 | — | 46 / 0 / 50 | 96 / 96 | 47 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-fe21773d3155f05f | LongCat 2.0 | Enabled | Rated | 8.6 | 1112 | — | 27 / 0 / 125 | 152 / 152 | 58 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-5618329845b079c7 | Muse Spark 1.2 | Minimal | Rated | 31.5 | 1342 | — | 30 / 0 / 58 | 88 / 88 | 42 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-ab39e2e398a78370 | Muse Spark 1.2 | Medium | Rated | 70.5 | 1717 | — | 70 / 0 / 22 | 92 / 92 | 43 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-24e15c4d7490cdf3 | Minimax M3 | Reasoning disabled | Rated | 35.3 | 1380 | — | 32 / 0 / 48 | 80 / 80 | 40 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-4547f4cedca403f9 | Minimax M3 | Reasoning enabled | Rated | 47.8 | 1495 | — | 58 / 0 / 50 | 108 / 108 | 50 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-d0d0df9d83b6e37e | Mistral Medium 3.5 | High | Rated | 19.9 | 1231 | — | 20 / 0 / 64 | 84 / 84 | 41 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-d35e87ebfc251f60 | Kimi K2.7 Code | Reasoning enabled | Rated | 49.3 | 1510 | — | 56 / 0 / 46 | 102 / 102 | 49 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1d1372c78963efdf | Kimi K3 | Max | Rated | 60.4 | 1608 | — | 108 / 0 / 64 | 172 / 172 | 61 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-4d8815930b656774 | Kimi K3 | Low | Rated | 27.9 | 1295 | — | 54 / 0 / 118 | 172 / 172 | 67 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-55ef4536a723bcf7 | Kimi K3 | High | Rated | 28.9 | 1306 | — | 47 / 0 / 107 | 154 / 154 | 59 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-1006c453b0c3a745 | Nex N2 Pro | Reasoning disabled | Rated | 63.5 | 1653 | — | 56 / 0 / 24 | 80 / 80 | 40 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-d1f432cda667f27f | Nex N2 Pro | Reasoning enabled | Rated | 48.6 | 1505 | — | 50 / 0 / 46 | 96 / 96 | 48 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0e1c7f89e1c19b69 | Nemotron 3 Ultra 550B A55B | Reasoning disabled | Rated | 10.5 | 1145 | — | 9 / 0 / 61 | 70 / 70 | 35 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-459f395cc0af6d2e | Nemotron 3 Ultra 550B A55B | Medium | Rated | 12.4 | 1160 | — | 19 / 0 / 61 | 80 / 80 | 38 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-43c337fb7f5e535e | O3 | High | Rated | 43.3 | 1445 | — | 73 / 0 / 82 | 155 / 155 | 56 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-541cee4461c65fcb | O3 | High | Rated | 49.1 | 1503 | — | 69 / 0 / 78 | 147 / 147 | 55 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-585aa996c86c4b8a | O3 | Low | Rated | 54.0 | 1548 | — | 82 / 0 / 78 | 160 / 160 | 59 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-bc20ac8102f6a0ac | O3 | High | Rated | 64.8 | 1653 | — | 88 / 0 / 68 | 156 / 156 | 55 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ee95d01578313864 | O3 | High | Rated | 30.8 | 1326 | — | 52 / 0 / 98 | 150 / 150 | 55 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-f1e3e54a3d40556f | O3 | Medium | Rated | 62.6 | 1641 | — | 56 / 0 / 32 | 88 / 88 | 44 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-29bc7f4fdf0f7b14 | GPT-OSS 120B | High | Rated | 41.7 | 1441 | — | 30 / 0 / 54 | 84 / 84 | 41 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-759d747bb732d949 | GPT-OSS 120B | Low | Rated | 9.1 | 1115 | — | 24 / 0 / 138 | 162 / 162 | 61 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-069a963abdd14cdf | Laguna S 2.1 | None | Rated | 45.3 | 1474 | — | 35 / 0 / 55 | 90 / 98 | 44 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-d8e68d23876f6d21 | Laguna S 2.1 | None | Rated | 59.5 | 1612 | — | 44 / 0 / 44 | 88 / 88 | 44 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-3142a09c7f192060 | Qwen3.7 Max | Reasoning disabled | Rated | 68.9 | 1705 | — | 51 / 0 / 27 | 78 / 78 | 39 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-59c7745eb1e91d63 | Qwen3.7 Max | Reasoning enabled | Rated | 79.1 | 1805 | — | 58 / 0 / 14 | 72 / 72 | 36 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-737a66790985a5e6 | Qwen3.7 Plus | Reasoning disabled | Rated | 3.6 | 1076 | — | 17 / 0 / 61 | 78 / 80 | 39 | 0 | 2 / 1 | First try · 2026-07-02 |
| E-9d091700cb41ece2 | Qwen3.7 Plus | Reasoning enabled | Rated | 43.1 | 1451 | — | 51 / 0 / 51 | 102 / 102 | 49 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1c3cd7cd7b39b7ff | Qwen3.8 Max | XHigh | Limited data | 68.7 | 1745 | — | 20 / 0 / 0 | 20 / 20 | 8 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-1f83b2062e021657 | Qwen3.8 Max | Medium | Limited data | 38.0 | 1454 | — | 8 / 0 / 10 | 18 / 18 | 10 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-9060604c6d76c81b | Qwen3.8 Max | Minimal | Limited data | 49.2 | 1559 | — | 12 / 0 / 7 | 19 / 19 | 10 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-27243ca72bb71e47 | Ox Alpha | Max | Rated | 52.8 | 1602 | — | 12 / 0 / 4 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-6160aff1d9ab7bd7 | Ox Alpha | Max | Rated | 48.4 | 1560 | — | 11 / 0 / 5 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-90df0bc1145d0335 | Ox Alpha | High | Rated | 22.6 | 1311 | — | 0 / 0 / 16 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-9cc97e533afb41b3 | Ox Alpha | High | Rated | 33.0 | 1411 | — | 4 / 0 / 12 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-9f68949b5725fa77 | Ox Alpha | Max | Rated | 43.5 | 1512 | — | 8 / 0 / 8 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-ae808d1219edf709 | Ox Alpha | High | Rated | 60.8 | 1679 | — | 16 / 0 / 0 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-b7e03d205460428f | Ox Alpha | Low | Rated | 52.1 | 1595 | — | 12 / 0 / 4 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-c2beebe255c607a1 | Ox Alpha | Low | Rated | 36.6 | 1446 | — | 6 / 0 / 10 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-f9e2fbd96bb7a98d | Ox Alpha | Low | Rated | 30.2 | 1384 | — | 3 / 0 / 13 | 16 / 16 | 8 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-1140a7c92290e8f4 | Step 3.7 Flash | Low | Rated | 38.0 | 1393 | — | 67 / 0 / 105 | 172 / 172 | 65 | 0 | 0 / 1 | Repaired · 2026-07-21 |
| E-6a5e44fe2dde4257 | Step 3.7 Flash | High | Rated | 32.6 | 1353 | — | 33 / 0 / 56 | 89 / 89 | 44 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-dfed1e345a939bcd | Hy3 Preview | High | Rated | 27.3 | 1300 | — | 34 / 0 / 58 | 92 / 92 | 44 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-062d41f517db2ccb | Inkling | None | Rated | 31.1 | 1336 | — | 46 / 0 / 52 | 98 / 98 | 48 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-38e756fc6f3a2db6 | Inkling | Max | Rated | 25.8 | 1275 | — | 45 / 0 / 121 | 166 / 166 | 62 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-b9ceec0ad4a1b9a4 | Inkling | Medium | Rated | 6.6 | 1092 | — | 17 / 0 / 135 | 152 / 152 | 59 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-516d381904063142 | Inkling Small | Max | Limited data | 22.0 | 1305 | — | 1 / 0 / 15 | 16 / 16 | 9 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-b205e1d25c695262 | Inkling Small | Medium | Limited data | 47.5 | 1543 | — | 11 / 0 / 8 | 19 / 19 | 9 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-f330739aca81e515 | Inkling Small | None | Limited data | 33.5 | 1406 | — | 6 / 0 / 14 | 20 / 20 | 11 | 0 | 0 / 1 | Repaired · 2026-08-09 |
| E-1d206565b78f3121 | Grok 4.5 | Low | Rated | 76.3 | 1765 | — | 110 / 0 / 32 | 142 / 142 | 55 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-436a3933a93e10cd | Grok 4.5 | High | Rated | 65.7 | 1661 | — | 101 / 0 / 57 | 158 / 158 | 62 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e58f3df122cf1d29 | Grok 4.5 | Medium | Rated | 64.8 | 1660 | — | 60 / 0 / 40 | 100 / 100 | 50 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-37ae0129627ee16f | Grok Build 0.1 | Reasoning enabled | Rated | 23.6 | 1265 | — | 30 / 0 / 62 | 92 / 92 | 43 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0984b025e9005f5b | MiMo-V2.5 | Reasoning disabled | Rated | 11.8 | 1154 | — | 24 / 0 / 56 | 80 / 82 | 40 | 0 | 2 / 1 | Repaired · 2026-07-02 |
| E-345a5b25cbac7f3b | MiMo-V2.5 | Reasoning enabled | Rated | 55.9 | 1579 | — | 47 / 0 / 35 | 82 / 82 | 38 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-47d67dcf0077af42 | MiMo-V2.5 | Reasoning disabled | Rated | 50.0 | 1523 | — | 44 / 0 / 34 | 78 / 78 | 39 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-fa1a93f7e4d57000 | MiMo-V2.5 | Reasoning enabled | Rated | 31.2 | 1338 | — | 40 / 0 / 52 | 92 / 92 | 44 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3b160130ae038271 | MiMo-V2.5-Pro | Reasoning enabled | Rated | 47.0 | 1488 | — | 55 / 0 / 51 | 106 / 106 | 52 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-83580d03385c6759 | MiMo-V2.5-Pro | Reasoning disabled | Rated | 53.0 | 1549 | — | 51 / 0 / 35 | 86 / 86 | 43 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-62e8714f035ebc68 | GLM-5.2 | Reasoning disabled | Rated | 41.3 | 1445 | — | 27 / 0 / 33 | 60 / 60 | 30 | 0 | 0 / 1 | First try · 2026-07-11 |
| E-e31f275ab7ef3741 | GLM-5.2 | Reasoning disabled | Rated | 61.1 | 1635 | — | 32 / 0 / 32 | 64 / 64 | 32 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ecd98326faa92bf4 | GLM-5.2 | High | Rated | 52.4 | 1550 | — | 41 / 0 / 27 | 68 / 68 | 34 | 0 | 0 / 1 | Repaired · 2026-07-11 |