GPQA Diamond
?what it ishighest score on this metric 96.4%
140º / 198 · Epoch AI, latest version we checked
o1-preview
Benchmarks, price, context and versions
Direct answer: o1-preview is a model from OpenAI. 50.3% on GPQA Diamond, per Epoch AI.
✓ Good for
- Not enough data in the open sources this section uses to build this block.
✕ Not the best for
- technical reasoning on science topics (#140 of 198 on GPQA Diamond)
- calculation and problems with an exact answer (#130 of 186 on OTIS Mock AIME)
This block follows a rule of this section, using source data: if the model is in the top 25% of the metric, the item goes under "Good for"; if it is in the bottom half, it goes under "Not the best for". The middle band appears in neither. Price and context use OpenRouter; scores use Epoch AI or OpenRouter Benchmarks, in the latest version we checked.
Benchmarks
Key specs
Version history
- no data
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch.
FAQ
What is o1-preview?
o1-preview is a model from OpenAI, with closed weights, used for text.
How much does o1-preview cost?
No data in open sources.
What is the context window of o1-preview?
No data in open sources.
Is o1-preview open source?
No. It is available through API only.
What is o1-preview's GPQA Diamond score?
50.3% on GPQA Diamond, per Epoch AI.
Is o1-preview good for coding?
No data: there is no SWE-bench Verified measurement for it in open sources.
Who made o1-preview?
It was made by OpenAI, a lab from the US.
provisional data Questions under review: Semrush had no API balance during collection. Answers use source data only.
Models from OpenAI
Sources
- Epoch AI, CC BY 4.0, latest version we checked.
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.