Llama 3.1 8B Instruct by NVIDIA demonstrates competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.
Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.
Coding Benchmarks
Artificial Analysis composite coding score
Artificial Analysis (via OpenRouter)Reasoning Benchmarks
Multi-turn service agent making tool calls under strict policy constraints
OpenRouter (measured)Cost Benchmarks
Cost per 1M cached input tokens — the price that actually applies to a long agent conversation
OpenRouter APIContext Benchmarks
Available from 13 providers
The same model costs different amounts depending on who serves it. You can bring your own key for 4 of these — connect it here.
| Provider | Input / 1M | Output / 1M | Cached in | Context | Your key |
|---|---|---|---|---|---|
| Nvidia | $0 | $0 | — | 16K | — |
| Abacus | $0.02 | $0.05 | — | 128K | — |
| Kilo Gateway | $0.02 | $0.04 | — | 131K | — |
| NovitaAI | $0.02 | $0.05 | — | 16K | — |
| Inference | $0.025 | $0.025 | — | 16K | — |
| OpenRouter | $0.05 | $0.08 | $0.025 | 131K | Supported |
| NanoGPT | $0.0544 | $0.085 | $0.0272 | 131K | — |
| Hugging Face | $0.06 | $0.06 | — | 131K | Supported |
| Neon | $0.15 | $0.45 | — | 131K | — |
| Cortecs | $0.167 | $0.167 | — | 128K | — |
| Pioneer | $0.2 | $0.2 | $0.2 | 128K | — |
| Amazon Bedrock | $0.22 | $0.22 | — | 128K | Supported |
| Vercel AI Gateway | $0.22 | $0.22 | — | 128K | Supported |
Llama 3.1 8B Instruct — Benchmark Scores Overview
Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).
Llama 3.1 8B Instruct — Frequently Asked Questions
How much does Llama 3.1 8B Instruct cost?
Llama 3.1 8B Instruct costs $0.05 per 1M input tokens and $0.08 per 1M output tokens. This makes it one of the more affordable models.
What is the context window of Llama 3.1 8B Instruct?
Llama 3.1 8B Instruct has a context window of 131K tokens. This determines how much text, conversation history, and code the model can process in a single request.
Who created Llama 3.1 8B Instruct?
Llama 3.1 8B Instruct was created by NVIDIA. It is classified as a open source model in our catalogue.
Is Llama 3.1 8B Instruct open source?
Yes, Llama 3.1 8B Instruct is an open-source model. The model weights are publicly available for download and self-hosting.