B.O.B. Leaderboard

OpenAIreleased 3 Sep 2026

GPT-6 Astra

#2 of 9534 of 46 benchmarksConsistent

94.2

B.O.B.

Category profile

  • Real use (hard to game)2×91
  • Reasoning & knowledge99
  • Math96
  • Coding94
  • Agents & real work93
  • Independent indexes96

Reality check

Lab tests

95

Real use (7 tests)

91

Lab tests and real-use tests agree. It does 4 points better on the usual lab tests than on tests that are hard to train for.

What counts as real use

Price per 1M tokens (OpenRouter)

$10.00 in · $50.00 out

Cost per task on the AA index

$3.26

Output speed (Artificial Analysis)

57 tok/s

§Receipts

Every benchmark result

“Beats” = the share of tracked models this one beat on that test. The raw score is its best reported setting.

BenchmarkRawBeatsSource
Real use (hard to game) · Real use 91
EQ-Bench Creative Writingas gpt-6-astra2173
100%of 46
Sam Paech (open source)
LMArena WebDevas gpt-6-astra-max1780
99%of 82
LMArena (blind human votes)
BridgeBench (overall)as GPT-6 Astra728
96%of 29
BridgeMind
LiveBench 2.0 (real-work suites)as gpt-6-astra85.5%
95%of 39
LiveBench / Abacus.AI
LMArena Agent Arenaas GPT 6 Astra (Max)0.137
94%of 50
LMArena (real agent sessions)
Vals Indexas openai/gpt-6-astra63.1%
85%of 42
Vals AI (private test sets)
LMArena Textas gpt-6-astra-max1477
68%of 80
LMArena (blind human votes)
Reasoning & knowledge · Reasoning 99
Humanity's Last Examas gpt-6-astra_unknown54.8%
100%of 13
Epoch AI Benchmarking Hub
ARC-AGI-2as gpt-6-astra_max95.0%
100%of 44
Epoch AI Benchmarking Hub
Chess Puzzlesas gpt-6-astra_max74.0%
100%of 73
Epoch AI Benchmarking Hub
Mystery Game Puzzlesas gpt-6-astra_max84.0%
100%of 57
Epoch AI Benchmarking Hub
GPQA Diamondas gpt-6-astra_max95.8%
99%of 70
Epoch AI Benchmarking Hub
SimpleQA Verifiedas gpt-6-astra_max75.6%
98%of 57
Epoch AI Benchmarking Hub
CritPt (physics research)as gpt-6-astra_max31.7%
98%of 89
Epoch AI Benchmarking Hub
Blueprint-Bench 2as gpt-6-astra_unknown49.7%
93%of 31
Epoch AI Benchmarking Hub
Math · Math 96
FrontierMath Tiers 1-3as gpt-6-astra_max93.7%
99%of 60
Epoch AI Benchmarking Hub
FrontierMath Tier 4as gpt-6-astra_high97.6%
98%of 52
Epoch AI Benchmarking Hub
OTIS Mock AIMEas gpt-6-astra_max100.0%
94%of 73
Epoch AI Benchmarking Hub
ProofBenchas gpt-6-astra_unknown99.0%
93%of 68
Epoch AI Benchmarking Hub
Coding · Coding 94
DeepSWEas gpt-6-astra_xhigh74.1%
100%of 26
Epoch AI Benchmarking Hub
FrontierSWEas gpt-6-astra_max65.5%
100%of 20
Epoch AI Benchmarking Hub
ALE-Benchas gpt-6-astra_max2951.3%
100%of 71
Epoch AI Benchmarking Hub
WeirdMLas gpt-6-astra_max93.3%
98%of 52
Epoch AI Benchmarking Hub
FrontierCodeas gpt-6-astra_max53.3%
93%of 45
Epoch AI Benchmarking Hub
GSO (code optimisation)as gpt-6-astra_unknown79.4%
90%of 11
Epoch AI Benchmarking Hub
SciCodeas gpt-6-astra_max56.5%
76%of 86
Epoch AI Benchmarking Hub
Agents & real work · Agents 93
Vending-Bench 2as gpt-6-astra_unknown15514.7%
100%of 47
Epoch AI Benchmarking Hub
GDP.pdfas gpt-6-astra_max34.2%
97%of 37
Epoch AI Benchmarking Hub
LMCAas gpt-6-astra_xhigh64.4%
96%of 67
Epoch AI Benchmarking Hub
DTBenchas gpt-6-astra_xhigh97.3%
92%of 67
Epoch AI Benchmarking Hub
Remote Labor Indexas gpt-6-astra_unknown20.8%
88%of 9
Epoch AI Benchmarking Hub
APEX-Agentsas gpt-6-astra_unknown64.7%
85%of 48
Epoch AI Benchmarking Hub
Independent indexes · Indexes 96
Epoch Capabilities Indexas GPT-6 Astra166.4
99%of 81
Epoch AI
Artificial Analysis Intelligence Indexas GPT-6 Astra (max)53
93%of 54
Artificial Analysis