Benchmark menu

Model results

Claude Opus 5

See how Claude Opus 5 performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

Claude Opus 5

Provider: Anthropic

Rank
2
Status
Complete 3/3
Rank change
Baseline
Score
72.6
Last tested
2026-08-15
Settings tested
All settings tested

Scores by reasoning setting

Available settings

Thinking disabledLowMediumHighXHighMax

Checked on 2026-07-25 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
Thinking disabled68.5Tested and includedBaseline
Medium73.5Tested and includedBalanced
XHigh76.0Tested and includedIntensive

How settings are grouped

  • Baseline: Thinking disabled — tested and included
  • Balanced: Medium — tested and included
  • Intensive: XHigh — tested and included

Player program results

XHigh: 81% / 0% / 19% · n 16Medium: 88% / 0% / 12% · n 16Thinking disabled: 88% / 0% / 12% · n 16 All settings tested

Generation cost

Average estimated cost
$0.70
Median estimated cost
$0.48
Estimated range
$0.22–$2.10
Cost data
24 combinations / 48 recorded runs
Observed total
$33.78
Price source
Standard list-price estimate
Price list
boardgame-list-prices-2026-07-25
Average output
26k tokens
Output range
5.4k–88k tokens
Samples
48

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt