Scores by reasoning setting

Enabled (Balanced group, tested and included)34.9

Every tested setting is included in the overall score.

Available settings and grouping

Available settings

Reasoning enabled

Checked on 2026-07-21 · Provider documentation

How settings are grouped

Baseline: Not available for this model
Balanced: Reasoning enabled — tested and included
Intensive: Not available for this model

Scores by game

Go37.4
Chess43.5
Shogi29.0
Xiangqi41.0
Hex50.3
International Draughts32.7
Game of the Amazons15.0
Tumbleweed30.3

Each game counts every generation attempt, a failed one as 0 (“1 of 2 failed” marks games with failed attempts). Scores are relative within each game, across the included settings; they do not compare game difficulty.

What this result shows

Strongest included setting: Reasoning enabled (34.9).

Across included settings, the highest game score is Hex (50.3); the lowest is Game of the Amazons (15.0). Each game counts every generation attempt, a failed one as 0. These are relative scores within each game, not direct comparisons of difficulty.

Match evidence measures these retained programs. It does not establish how a fresh generation will perform. Independent-generation variation is not estimated in this release.

Test protocol and evidence limits

Model identifier: x-ai/grok-build-0.1
Provider route (catalog): openrouter
Prompt identity / profile: Not retained in this result set / Not retained in this result set
Prompt version: Not retained in this result set
Generation policy: Generation-quality admission policy (see methodology)
Requested output-token limits: Not retained (0 of 17 indexed attempts)

Generation evidence

Reasoning enabled: 8 contributing player programs across 8 games

Counts describe contributing programs, not independent replications: repairs and resends are not new independent samples. Independent-generation lineage is not retained.

Game	Reasoning group	Programs	Working-program strength	Raw rating	Combined record (W / D / L)
Go	Balanced	1 working of 1 attempt	37.4	1347.5	133 / 100 / 283
Chess	Balanced	1 working of 1 attempt	43.5	1421.9	10 / 382 / 88
Shogi	Balanced	1 working of 1 attempt	29.0	1240.7	62 / 132 / 300
Xiangqi	Balanced	1 working of 1 attempt	41.0	1405.1	26 / 340 / 132
Hex	Balanced	1 working of 1 attempt	50.3	1441.1	258 / 0 / 272
International Draughts	Balanced	1 working of 1 attempt	32.7	1157.4	140 / 6 / 356
Game of the Amazons	Balanced	1 working of 1 attempt	15.0	950.9	70 / 0 / 460
Tumbleweed	Balanced	1 working of 1 attempt	30.3	1174.3	35 / 231 / 272

Each row covers all the model's programs in one game and setting. Strength and raw rating are attempt-weighted means; under them, each program's score and the lowest and highest rating describe the programs (not a confidence interval). The combined record adds up their matches: evidence volume, not strength.

Failures and budgets

0 model-code generation failures; 0 provider/infrastructure failures excluded from the generation denominator. Runtime player faults are separate: 0 recorded one-sided faults across contributing program rows. A crash or illegal move pinned on one program also counts as that program's loss in its match record; other faults, such as timeouts, are left out of rating evidence.

Repair/resend outcomes and available costs are included. Exact retry ceilings and execution budgets are not retained in this result set; see the methodology for the public policy. Do not infer a measured setting from a current provider catalog.

Player program results

Reasoning enabled: 0% / 100% / 0% · n 8 No Overall rankIntensive not supportedBaseline not supportedMany programs needed repair

Generation cost

$0.06average estimated cost per game and reasoning setting

Median: $0.06
Range: $0.05–$0.07
Known cost subtotal (incomplete or unverified charges): $0.49
Cost data: 8 combinations · 8 runs
Price source: Provider-reported
Price list: Not recorded for this older data
Average output: 22k tokens
Output range: 16k–30k tokens
Runs with output-token data: 8

How cost is measured

Comparison cost gives equal weight to each model, game, and reasoning-setting combination. Recorded generation attempts include repairs and resends when cost evidence is available; runtime compute and service operation are excluded. Cost and output-token counts use separate telemetry denominators. A list-price estimate is not actual expenditure; mixed evidence is not a uniform standard-price comparison.

Test protocol

Combines this model's tested reasoning settings
Player-program generation; retained protocol details are under “Test protocol and evidence limits” above

Grok Build 0.1