Claude Sonnet 4 vs Gemini 3.1 Pro

Side-by-side benchmark comparison across coding, math, reasoning, speed, and pricing.

Gemini 3.1 Pro by Google wins on 13 of 15 benchmarks against Claude Sonnet 4 by Anthropic, which leads on 2. This head-to-head comparison covers coding, math, reasoning, speed, and pricing metrics from the AI Value Index.

Category-by-Category Breakdown

General Intelligence: In general intelligence, Gemini 3.1 Pro scores 1501 on Chatbot Arena ELO compared to Claude Sonnet 4's 1365, while Gemini 3.1 Pro scores 92.6% on MMLU-Pro compared to Claude Sonnet 4's 81.0%, while Gemini 3.1 Pro scores 92.0% on IFEval compared to Claude Sonnet 4's 87.0%.

Coding: In coding, Gemini 3.1 Pro scores 93.0% on HumanEval+ compared to Claude Sonnet 4's 88.0%, while Gemini 3.1 Pro scores 80.6% on SWE-bench Verified compared to Claude Sonnet 4's 72.7%, while Gemini 3.1 Pro scores 75.0% on LiveCodeBench compared to Claude Sonnet 4's 58.0%.

Math: In math, Gemini 3.1 Pro scores 93.0% on MATH compared to Claude Sonnet 4's 85.0%, while Gemini 3.1 Pro scores 98.0% on GSM8K compared to Claude Sonnet 4's 94.5%.

Reasoning: In reasoning, Gemini 3.1 Pro scores 94.1% on GPQA Diamond compared to Claude Sonnet 4's 75.4%, while Gemini 3.1 Pro scores 77.1% on ARC-AGI compared to Claude Sonnet 4's 42.0%.

Context: In context, Gemini 3.1 Pro scores 1.0M on Context Length compared to Claude Sonnet 4's 200K.

Pricing Comparison

Claude Sonnet 4 costs $3.0/1M input tokens and $15.0/1M output tokens, while Gemini 3.1 Pro costs $2.0/1M input and $12.0/1M output. Gemini 3.1 Pro is the more affordable option for API usage.

Speed Comparison

Claude Sonnet 4 generates output at 75 tok/s compared to Gemini 3.1 Pro's 65 tok/s, and the time to first token is 400 ms for Claude Sonnet 4 versus 420 ms for Gemini 3.1 Pro. Claude Sonnet 4 delivers faster throughput.

Verdict

For developers prioritizing speed, Claude Sonnet 4 has the edge. For those who value coding and general intelligence and math and affordability, Gemini 3.1 Pro is the stronger choice.

Claude Sonnet 4 vs Gemini 3.1 Pro — FAQ

Which is better, Claude Sonnet 4 or Gemini 3.1 Pro?

Gemini 3.1 Pro wins on more benchmarks overall (13 vs 2). However, the best choice depends on your specific needs — each model excels in different areas.

How does Claude Sonnet 4 compare to Gemini 3.1 Pro for coding?

Gemini 3.1 Pro is better for coding, scoring 80.6% on SWE-bench Verified compared to 72.7%. SWE-bench tests real-world software engineering by resolving actual GitHub issues.

Is Claude Sonnet 4 cheaper than Gemini 3.1 Pro?

Yes, Gemini 3.1 Pro is cheaper. Claude Sonnet 4 costs $3.0/1M input and $15.0/1M output tokens. Gemini 3.1 Pro costs $2.0/1M input and $12.0/1M output tokens.

Which is faster, Claude Sonnet 4 or Gemini 3.1 Pro?

Claude Sonnet 4 is faster, generating output at 75 tok/s compared to 65 tok/s. Faster output speed means shorter wait times for API responses.

What benchmarks does the Claude Sonnet 4 vs Gemini 3.1 Pro comparison cover?

This comparison covers 15 benchmarks including Chatbot Arena ELO, MMLU-Pro, HumanEval+, IFEval, MATH, SWE-bench Verified, GPQA Diamond, Output Speed, and more. Metrics span general intelligence, coding, math, reasoning, speed, and cost categories.