Skip to main content
Back to Explore

Llama 3.1 Nemotron Instruct 70B

NVIDIA·Released 2024-10-15
Open Source

Pricing

Input

$1.20

per 1M tokens

Output

$1.20

per 1M tokens

Blended

$1.20

per 1M tokens

Cheaper than 33% of models. Median price is $0.54/1M tokens.

Cost Calculator

Tokens per day1M
100K100M

Daily

$1.20

Monthly

$36.00

vs. Similar Models

Cohere: Command AQ:+0.1
$4.38+265%
Nova ProQ:+0.1
$1.40+17%
Gemma 3 27B InstructQ:-0.2
$0.14-88%
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)Q:-0.2
$0.09-93%

Performance

301

tokens/sec

Faster than 96% of models

4.06

seconds

Faster than 18% of models

4.06

seconds

Faster than 48% of models

Market Median

94 tok/s

219% faster

Median TTFT

1.11s

265% slower

Throughput/Dollar

251

tok/s per $/1M

Speed Comparison

Nemotron 3 Nano Omni 30B A3B Reasoning
298 tok/s-1%
OpenAI: gpt-oss-120b
307 tok/s+2%
Nova Micro
289 tok/s-4%

Benchmarks

MMLU-Pro
69.0%
GPQA Diamond
46.5%
HLE
4.6%
LiveCodeBench
16.9%
SciCode
23.3%
TerminalBench Hard
4.5%
MATH-500
73.3%
AIME
24.7%
AIME 2025
11.0%
IFBench
30.7%
Long Context Recall
7.0%
Tau2
23.1%
Market AverageTop Score

Open Source

Quick Compare

Similar Models

Compare all 7 models