Score · relative 0–100
52.3
Rank
32
Status
Complete 3/3
Rank change
0
Players generated
2026-08-21 – 2026-08-22
Match evidence updated
2026-10-26
Results published

Scores by reasoning setting

  • Max (Intensive group, tested and included)68.3
  • High (Balanced group, tested and included)47.3
  • Low (Baseline group, tested and included)41.2

Every tested setting is included in the overall score.

Available settings and grouping

Available settings

LowHighMax

Checked on 2026-08-21 · Provider documentation

How settings are grouped

  • Baseline: Low — tested and included
  • Balanced: High — tested and included
  • Intensive: Max — tested and included

Scores by game

  • Go1 of 9 failed47.6
  • Chess55.8
  • Shogi3 of 23 failed52.1
  • Xiangqi59.5
  • Hex54.6
  • International Draughts46.5
  • Game of the Amazons50.7
  • Tumbleweed1 of 9 failed51.7

Each game counts every generation attempt, a failed one as 0 (“1 of 2 failed” marks games with failed attempts). Scores are relative within each game, across the included settings; they do not compare game difficulty.

What this result shows

Strongest included setting: Max (68.3).

Across included settings, the highest game score is Xiangqi (59.5); the lowest is International Draughts (46.5). Each game counts every generation attempt, a failed one as 0. These are relative scores within each game, not direct comparisons of difficulty.

Match evidence measures these retained programs. It does not establish how a fresh generation will perform. Independent-generation variation is not estimated in this release.

Test protocol and evidence limits
Model identifier
stealth/ox-alpha
Provider route (catalog)
openrouter
Prompt identity / profile
Not retained in this result set / Not retained in this result set
Prompt version
Not retained in this result set
Generation policy
Generation-quality admission policy (see methodology)
Requested output-token limits
131072 (102 of 114 indexed attempts)

Generation evidence

  • Low: 28 contributing player programs across 8 games
  • High: 26 contributing player programs across 8 games
  • Max: 25 contributing player programs across 8 games

Counts describe contributing programs, not independent replications: repairs and resends are not new independent samples. Independent-generation lineage is not retained.

GameReasoning groupProgramsWorking-program strengthRaw ratingCombined record (W / D / L)
GoIntensive3 working of 3 attempts58.6 program scores 66.3 · 66.0 · 43.51555.1 program range 1407–1631838 / 73 / 637
GoBalanced2 working of 3 attempts62.3 program scores 65.6 · 59.01589.9 program range 1556–1624512 / 218 / 302
GoBaseline3 working of 3 attempts42.5 program scores 50.6 · 46.2 · 30.71395.9 program range 1279–1475444 / 368 / 736
ChessIntensive2 working of 2 attempts74.1 program scores 81.4 · 66.71691.5 program range 1610–1773522 / 352 / 86
ChessBalanced3 working of 3 attempts50.2 program scores 54.5 · 48.3 · 47.81473.2 program range 1454–1507179 / 1037 / 224
ChessBaseline3 working of 3 attempts43.1 program scores 44.7 · 42.6 · 41.91418.0 program range 1409–143143 / 1106 / 291
ShogiIntensive5 working of 5 attempts71.2 program scores 87.3 · 82.0 · 74.8 · 56.3 · 55.71674.3 program range 1479–19191612 / 143 / 714
ShogiBalanced7 working of 9 attempts57.7 program scores 84.1 · 70.3 · 60.2 · 50.3 · 49.2 · 47.9 · 41.81515.9 program range 1356–18451678 / 385 / 1395
ShogiBaseline8 working of 9 attempts45.2 program scores 57.7 · 52.5 · 51.8 · 48.3 · 44.1 · 43.0 · 38.0 · 26.51385.7 program range 1216–1497967 / 1345 / 1640
XiangqiIntensive3 working of 3 attempts71.5 program scores 88.4 · 64.5 · 61.71682.7 program range 1569–1887765 / 565 / 164
XiangqiBalanced3 working of 3 attempts57.3 program scores 61.0 · 57.1 · 53.81532.7 program range 1504–1563393 / 873 / 228
XiangqiBaseline3 working of 3 attempts49.6 program scores 56.0 · 47.2 · 45.51471.8 program range 1440–1522247 / 935 / 312
HexIntensive3 working of 3 attempts62.6 program scores 71.3 · 60.0 · 56.61606.9 program range 1521–1735969 / 0 / 621
HexBalanced3 working of 3 attempts49.3 program scores 56.0 · 49.9 · 42.01429.1 program range 1338–1513759 / 0 / 831
HexBaseline3 working of 3 attempts51.7 program scores 57.0 · 53.0 · 45.11458.8 program range 1377–1525796 / 0 / 794
International DraughtsIntensive3 working of 3 attempts68.6 program scores 85.4 · 81.1 · 39.41761.1 program range 1259–2058953 / 80 / 473
International DraughtsBalanced2 working of 2 attempts28.1 program scores 49.8 · 6.41041.5 program range 667–1416243 / 21 / 738
International DraughtsBaseline3 working of 3 attempts42.8 program scores 55.2 · 50.7 · 22.51311.2 program range 1002–1501572 / 26 / 908
Game of the AmazonsIntensive3 working of 3 attempts66.7 program scores 75.1 · 64.8 · 60.21673.4 program range 1578–18011035 / 0 / 555
Game of the AmazonsBalanced3 working of 3 attempts45.6 program scores 74.3 · 48.5 · 14.01381.6 program range 930–1786697 / 0 / 893
Game of the AmazonsBaseline3 working of 3 attempts39.8 program scores 58.5 · 44.1 · 16.61304.4 program range 983–1557597 / 0 / 993
TumbleweedIntensive3 working of 3 attempts73.4 program scores 86.5 · 72.7 · 60.81775.8 program range 1534–20551101 / 79 / 434
TumbleweedBalanced3 working of 3 attempts61.6 program scores 73.4 · 58.0 · 53.31558.5 program range 1431–1752797 / 285 / 532
TumbleweedBaseline2 working of 3 attempts30.2 program scores 32.8 · 27.71172.9 program range 1145–1201120 / 360 / 596

Each row covers all the model's programs in one game and setting. Strength and raw rating are attempt-weighted means; under them, each program's score and the lowest and highest rating describe the programs (not a confidence interval). The combined record adds up their matches: evidence volume, not strength.

Failures and budgets

5 model-code generation failures; 5 provider/infrastructure failures excluded from the generation denominator. Runtime player faults are separate: 176 recorded one-sided faults across contributing program rows. A crash or illegal move pinned on one program also counts as that program's loss in its match record; other faults, such as timeouts, are left out of rating evidence.

Repair/resend outcomes and available costs are included. Exact retry ceilings and execution budgets are not retained in this result set; see the methodology for the public policy. Do not infer a measured setting from a current provider catalog.

Player program results

Max: 88% / 12% / 0% · n 25High: 73% / 17% / 10% · n 29Low: 63% / 30% / 7% · n 30 All three benchmark settings tested

Generation cost

$0.00average estimated cost per game and reasoning setting

Median
$0.00
Range
$0.00–$0.00
Known cost subtotal (incomplete or unverified charges)
$0.00
Cost data
24 combinations · 88 runs
Price source
Provider-reported
Price list
Not recorded for this older data
Average output
23k tokens
Output range
1.7k–85k tokens
Runs with output-token data
88
How cost is measured

Comparison cost gives equal weight to each model, game, and reasoning-setting combination. Recorded generation attempts include repairs and resends when cost evidence is available; runtime compute and service operation are excluded. Cost and output-token counts use separate telemetry denominators. A list-price estimate is not actual expenditure; mixed evidence is not a uniform standard-price comparison.

Test protocol

  • Combines this model's tested reasoning settings
  • Player-program generation; retained protocol details are under “Test protocol and evidence limits” above