GPQA Diamond
?what it ishighest score on this metric 96.4%
97º / 198 · Epoch AI, latest version we checked
o1
Benchmarks, price, context and versions
Direct answer: o1 is a model from OpenAI. 76.8% on GPQA Diamond, per Epoch AI.
✓ Good for
- Not enough data in the open sources this section uses to build this block.
✕ Not the best for
- calculation and problems with an exact answer (#97 of 186 on OTIS Mock AIME)
- the ceiling of reasoning on research-level math (#79 of 86 on FrontierMath (tiers 1 to 3))
- answering short facts with little invention (#48 of 87 on SimpleQA Verified)
This block follows a rule of this section, using source data: if the model is in the top 25% of the metric, the item goes under "Good for"; if it is in the bottom half, it goes under "Not the best for". The middle band appears in neither. Price and context use OpenRouter; scores use Epoch AI or OpenRouter Benchmarks, in the latest version we checked.
Benchmarks
Key specs
Version history
- no data
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch.
FAQ
What is o1?
o1 is a model from OpenAI, with closed weights, used for text.
How much does o1 cost?
No data in open sources.
What is the context window of o1?
No data in open sources.
Is o1 open source?
No. It is available through API only.
What is o1's GPQA Diamond score?
76.8% on GPQA Diamond, per Epoch AI.
Is o1 good for coding?
No data: there is no SWE-bench Verified measurement for it in open sources.
Who made o1?
It was made by OpenAI, a lab from the US.
provisional data Questions under review: Semrush had no API balance during collection. Answers use source data only.
Models from OpenAI
Sources
- Epoch AI, CC BY 4.0, latest version we checked.
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.