Claude 3.5 Sonnet is an AI model by Anthropic. View detailed benchmark scores, pricing data, and performance metrics on the AI Value Index.
General Benchmarks
Coding Benchmarks
Reasoning Benchmarks
Speed Benchmarks
Cost Benchmarks
Context Benchmarks
Claude 3.5 Sonnet — Benchmark Scores Overview
Scores normalized to percentage scale for visual comparison. ELO scores mapped to 0-100 range (1100-1500).
Compare Claude 3.5 Sonnet With
Claude 3.5 Sonnet — Frequently Asked Questions
How intelligent is Claude 3.5 Sonnet?
Claude 3.5 Sonnet scores 1268 on the Chatbot Arena ELO rating, making it a mid-tier AI model. This score is based on blind head-to-head human preference voting.
How much does Claude 3.5 Sonnet cost?
Claude 3.5 Sonnet costs $3.0 per 1M input tokens and $15.0 per 1M output tokens. This is mid-range pricing for its capability level.
How fast is Claude 3.5 Sonnet?
Claude 3.5 Sonnet generates output at 70 tokens per second, which is slower, prioritizing quality over speed compared to other models. The time to first token is 400 ms.
How good is Claude 3.5 Sonnet at coding?
Claude 3.5 Sonnet achieves 49.0% on SWE-bench Verified, demonstrating moderate real-world software engineering capability. This benchmark tests the model's ability to resolve actual GitHub issues.
How good is Claude 3.5 Sonnet at math and reasoning?
Claude 3.5 Sonnet scores 78.3% on the MATH benchmark (competition-level mathematics). It also achieves 59.4% on GPQA Diamond, a graduate-level science reasoning benchmark.
What is the context window of Claude 3.5 Sonnet?
Claude 3.5 Sonnet has a context window of 200K tokens. This determines how much text, conversation history, and code the model can process in a single request.
Who created Claude 3.5 Sonnet?
Claude 3.5 Sonnet was created by Anthropic. It is classified as a mid model in the AI Value Index.
Is Claude 3.5 Sonnet open source?
No, Claude 3.5 Sonnet is a proprietary model. It is available through Anthropic's API and compatible providers.