Benchmark menu

Model results

Inkling

See how Inkling performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

Inkling

Provider: Other

Rank
43
Status
Partial 3/3
Rank change
Baseline
Score
28.7
Last tested
2026-08-22
Settings tested
All settings tested

Why this result is partial: generation quality is below the publication threshold. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Available settings

NoneMinimalLowMediumHighMax

Checked on 2026-07-24 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
None34.0Tested and includedBaseline
Medium24.7Tested and includedBalanced
Max27.4Tested and includedIntensive

How settings are grouped

  • Baseline: None — tested and included
  • Balanced: Medium — tested and included
  • Intensive: Max — tested and included

Player program results

Max: 25% / 31% / 44% · n 16Medium: 31% / 6% / 63% · n 16None: 44% / 31% / 25% · n 16 All settings testedMany programs failed

Generation cost

Average estimated cost
$0.13
Median estimated cost
$0.08
Estimated range
$0.02–$0.30
Cost data
24 combinations / 48 recorded runs
Observed total
$6.00
Price source
Provider-reported
Price list
Not recorded for this older data
Average output
26k tokens
Output range
1.4k–80k tokens
Samples
48

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt