Llama 3.1 70b Instruct by NVIDIA demonstrates competitive pricing. View detailed benchmark data including scores across coding, math, reasoning, speed, and cost metrics.
Specifications last checked against the provider on . Benchmark scores carry their own source, linked beside each number.
Cost Benchmarks
Context Benchmarks
Available from 7 providers
The same model costs different amounts depending on who serves it. You can bring your own key for 3 of these — connect it here.
| Provider | Input / 1M | Output / 1M | Cached in | Context | Your key |
|---|---|---|---|---|---|
| Nvidia | $0 | $0 | — | 128K | — |
| Kilo Gateway | $0.4 | $0.4 | — | 131K | — |
| OpenRouter | $0.4 | $0.4 | — | 131K | Supported |
| Amazon Bedrock | $0.72 | $0.72 | — | 128K | Supported |
| DevPass (LLM Gateway) | $0.72 | $0.72 | — | 128K | — |
| LLM Gateway | $0.72 | $0.72 | — | 128K | — |
| Vercel AI Gateway | $0.72 | $0.72 | — | 128K | Supported |
Llama 3.1 70b Instruct — Frequently Asked Questions
How much does Llama 3.1 70b Instruct cost?
Llama 3.1 70b Instruct costs $0.40 per 1M input tokens and $0.40 per 1M output tokens. This makes it one of the more affordable models.
What is the context window of Llama 3.1 70b Instruct?
Llama 3.1 70b Instruct has a context window of 131K tokens. This determines how much text, conversation history, and code the model can process in a single request.
Who created Llama 3.1 70b Instruct?
Llama 3.1 70b Instruct was created by NVIDIA. It is classified as a open source model in our catalogue.
Is Llama 3.1 70b Instruct open source?
Yes, Llama 3.1 70b Instruct is an open-source model. The model weights are publicly available for download and self-hosting.