AI models
Claude Sonnet 5.5 vs Gemini 3.8 Flash
Same criteria, side by side. Where the gap is small, it may be measurement noise.
Also searched as
Claude Sonnet vs Gemini Flash
Direct answer: GPQA Diamond: Claude Sonnet 5.5 95.6%, Gemini 3.8 Flash 95.4% (Epoch AI). OTIS Mock AIME: Claude Sonnet 5.5 100%, Gemini 3.8 Flash 98.9% (Epoch AI). FrontierMath (tiers 1 to 3): Claude Sonnet 5.5 88.8%, Gemini 3.8 Flash 68.4% (Epoch AI). SimpleQA Verified: Claude Sonnet 5.5 46.5%, Gemini 3.8 Flash 69.7% (Epoch AI). GPQA Diamond (OpenRouter): Claude Sonnet 5.5 93%, Gemini 3.8 Flash 95.6% (OpenRouter Benchmarks). τ-bench Verified (airline): Claude Sonnet 5.5 78.8%, Gemini 3.8 Flash 76.7% (OpenRouter Benchmarks).
| Metric | Claude Sonnet 5.5 | Gemini 3.8 Flash | Source |
|---|---|---|---|
| Weights ?what it is | closed | closed | no data |
| Input US$/1M ? | US$ 2.00 | US$ 0.82 | no data |
| Output US$/1M ? | US$ 10.00 | US$ 4.12 | no data |
| Context ? | 1,000,000 | 1,048,576 | no data |
| GPQA Diamond ? | 95.6% | 95.4% | Epoch AI |
| OTIS Mock AIME ? | 100% | 98.9% | Epoch AI |
| FrontierMath (tiers 1 to 3) ? | 88.8% | 68.4% | Epoch AI |
| SimpleQA Verified ? | 46.5% | 69.7% | Epoch AI |
| GPQA Diamond (OpenRouter) ? | 93% | 95.6% | OpenRouter Benchmarks |
| τ-bench Verified (airline) ? | 78.8% | 76.7% | OpenRouter Benchmarks |
Compare with
Sources
- Epoch AI, CC BY 4.0, latest version we checked.
- OpenRouter Benchmarks, CC BY 4.0, latest version we checked.
- OpenRouter, dados públicos da API; exports de benchmarks e rankings em CC BY 4.0, latest version we checked.
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.