Benchmarks
MMLU-Pro
53.7%
GPQA Diamond
33.2%
HLE
4.1%
LiveCodeBench
14.8%
SciCode
18.8%
TerminalBench HardNot evaluated
MATH-500
54.5%
AIME
0.0%
AIME 2025Not evaluated
IFBenchNot evaluated
Long Context RecallNot evaluated
Tau2Not evaluated
Market AverageTop Score