Benchmarks
MMLU-Pro
71.6%
GPQA Diamond
51.6%
HLE
3.5%
LiveCodeBench
29.1%
SciCode
30.2%
TerminalBench HardNot evaluated
MATH-500
77.8%
AIME
13.3%
AIME 2025Not evaluated
IFBenchNot evaluated
Long Context RecallNot evaluated
Tau2Not evaluated
Market AverageTop Score