Score · relative 0–100
38.1
Rank
50
Status
Partial 3/3
Players generated
2026-10-20
Match evidence updated
2026-10-24
Results published

Why this result is partial: the provider capability record is unavailable. The rank uses the available reasoning-setting results.

Scores by reasoning setting

  • XHighnot included (Intensive group, tested, not included)40.0
  • Mediumnot included (Balanced group, tested, not included)42.7
  • Lownot included (Baseline group, tested, not included)31.5

Settings marked “not included” were tested but are left out of the overall score.

Scores by game

  • Go38.0
  • Chess1 of 3 failed27.6
  • Shogi34.8
  • Xiangqi39.7
  • Hex48.9
  • International Draughts51.2
  • Game of the Amazons54.6
  • Tumbleweed2 of 3 failed9.7

Each game counts every generation attempt, a failed one as 0 (“1 of 2 failed” marks games with failed attempts). Scores are relative within each game, across the included settings; they do not compare game difficulty.

What this result shows

No qualified setting comparison is retained.

Across included settings, the highest game score is Game of the Amazons (54.6); the lowest is Tumbleweed (9.7). Each game counts every generation attempt, a failed one as 0. These are relative scores within each game, not direct comparisons of difficulty.

Match evidence measures these retained programs. It does not establish how a fresh generation will perform. Independent-generation variation is not estimated in this release.

Test protocol and evidence limits
Model identifier
minimax/minimax-m3.1-flash
Provider route (catalog)
Not retained in this result set
Prompt identity / profile
Not retained in this result set / Not retained in this result set
Prompt version
Not retained in this result set
Generation policy
Generation-quality admission policy (see methodology)
Requested output-token limits
524288 (35 of 35 indexed attempts)

Generation evidence

    Counts describe contributing programs, not independent replications: repairs and resends are not new independent samples. Independent-generation lineage is not retained.

    GameReasoning groupProgramsWorking-program strengthRaw ratingCombined record (W / D / L)
    GoIntensive1 working of 1 attempt14.91076.458 / 26 / 432
    GoBalanced1 working of 1 attempt68.11650.5300 / 81 / 135
    GoBaseline1 working of 1 attempt30.91281.4136 / 29 / 351
    ChessIntensive1 working of 1 attempt41.11403.015 / 349 / 116
    ChessBaseline1 working of 1 attempt41.71407.94 / 377 / 99
    ShogiIntensive1 working of 1 attempt49.11420.1176 / 94 / 223
    ShogiBalanced1 working of 1 attempt31.81267.485 / 112 / 297
    ShogiBaseline1 working of 1 attempt23.51183.912 / 181 / 301
    XiangqiIntensive1 working of 1 attempt39.71394.732 / 315 / 151
    XiangqiBalanced1 working of 1 attempt38.71387.437 / 296 / 165
    XiangqiBaseline1 working of 1 attempt40.71402.727 / 335 / 136
    HexIntensive1 working of 1 attempt72.81761.4377 / 0 / 153
    HexBalanced1 working of 1 attempt50.51443.5259 / 0 / 271
    HexBaseline1 working of 1 attempt23.51071.7119 / 0 / 411
    International DraughtsIntensive1 working of 1 attempt32.21149.7137 / 6 / 358
    International DraughtsBalanced1 working of 1 attempt51.71445.4232 / 11 / 259
    International DraughtsBaseline1 working of 1 attempt69.71748.3334 / 1 / 167
    Game of the AmazonsIntensive1 working of 1 attempt70.21721.4365 / 0 / 165
    Game of the AmazonsBalanced1 working of 1 attempt71.51740.4372 / 0 / 158
    Game of the AmazonsBaseline1 working of 1 attempt22.21079.0106 / 0 / 424
    TumbleweedBalanced1 working of 1 attempt29.11160.1144 / 0 / 394

    Each row covers all the model's programs in one game and setting. Strength and raw rating are attempt-weighted means; under them, each program's score and the lowest and highest rating describe the programs (not a confidence interval). The combined record adds up their matches: evidence volume, not strength.

    Failures and budgets

    3 model-code generation failures; 0 provider/infrastructure failures excluded from the generation denominator. Runtime player faults are separate: 36 recorded one-sided faults across contributing program rows. A crash or illegal move pinned on one program also counts as that program's loss in its match record; other faults, such as timeouts, are left out of rating evidence.

    Repair/resend outcomes and available costs are included. Exact retry ceilings and execution budgets are not retained in this result set; see the methodology for the public policy. Do not infer a measured setting from a current provider catalog.

    Player program results

    Xhigh: 50% / 38% / 12% · n 8Medium: 63% / 25% / 12% · n 8Low: 63% / 25% / 12% · n 8 All three benchmark settings tested

    Generation cost

    $0.00average estimated cost per game and reasoning setting

    Median
    $0.00
    Range
    $0.00–$0.00
    Provider-reported total
    $0.00
    Cost data
    24 combinations · 24 runs
    Price source
    Provider-reported
    Price list
    boardgame-list-prices-2026-10-09
    Average output
    17k tokens
    Output range
    1.4k–73k tokens
    Runs with output-token data
    24
    How cost is measured

    Comparison cost gives equal weight to each model, game, and reasoning-setting combination. Recorded generation attempts include repairs and resends when cost evidence is available; runtime compute and service operation are excluded. Cost and output-token counts use separate telemetry denominators. A list-price estimate is not actual expenditure; mixed evidence is not a uniform standard-price comparison.

    Test protocol

    • Combines this model's tested reasoning settings
    • Player-program generation; retained protocol details are under “Test protocol and evidence limits” above