RSS

OpenAI

GPT-4o

Benchmarks, price, context and versions

Also searched as

GPT 4o, gpt-4o-mini, gpt-4o-mini-tts, gpt-4o-mini pricing

Direct answer: GPT-4o is a model from OpenAI. 49.2% on GPQA Diamond, per Epoch AI. On OpenRouter, US$ 2.50 per 1 million input tokens and US$ 10.00 per 1 million output tokens.

✓ Good for

  • Not enough data in the open sources this section uses to build this block.

✕ Not the best for

  • technical reasoning on science topics (#141 of 198 on GPQA Diamond)
  • calculation and problems with an exact answer (#158 of 186 on OTIS Mock AIME)
  • the ceiling of reasoning on research-level math (#85 of 86 on FrontierMath (tiers 1 to 3))
  • answering short facts with little invention (#70 of 87 on SimpleQA Verified)
  • fixing bugs in real code (#32 of 32 on SWE-bench Verified)
  • technical reasoning as the model appears through the API (#124 of 135 on GPQA Diamond (OpenRouter))
  • agents that follow rules and use tools (#122 of 131 on τ-bench Verified (airline))
  • when the input budget sits at the top of the table (input price in the highest 25% on OpenRouter)

This block follows a rule of this section, using source data: if the model is in the top 25% of the metric, the item goes under "Good for"; if it is in the bottom half, it goes under "Not the best for". The middle band appears in neither. Price and context use OpenRouter; scores use Epoch AI or OpenRouter Benchmarks, in the latest version we checked.

Benchmarks

GPQA Diamond

?what it is
49.2%

highest score on this metric 96.4%

141º / 198 · Epoch AI, latest version we checked

OTIS Mock AIME

?
6.4%

highest score on this metric 100%

158º / 186 · Epoch AI, latest version we checked

FrontierMath (tiers 1 to 3)

?
0.4%

highest score on this metric 95.1%

85º / 86 · Epoch AI, latest version we checked

SimpleQA Verified

?
26%

highest score on this metric 94%

70º / 87 · Epoch AI, latest version we checked

SWE-bench Verified

?
31%

highest score on this metric 83.5%

32º / 32 · Epoch AI, latest version we checked

GPQA Diamond (OpenRouter)

?
52.7%

highest score on this metric 96.5%

124º / 135 · OpenRouter Benchmarks, latest version we checked

τ-bench Verified (airline)

?
43.2%

highest score on this metric 82%

122º / 131 · OpenRouter Benchmarks, latest version we checked

Key specs

Origin
the US
Family
GPT provisional data
Weights?
closed
License
no data
Input US$/1M?
US$ 2.50
Output US$/1M
US$ 10.00
Context?
128,000 tokens
Parameters
no data
Input
file, image, text
OpenRouter usage?
no data
Downloads (30 days)?
no data
Use cases provisional data
Text Agents Code
Dates in sources
  • 2024, published, per Epoch AI
  • 2024, listed on OpenRouter

Version history

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch.

FAQ

How much does GPT-4o cost?

On OpenRouter, US$ 2.50 per 1 million input tokens and US$ 10.00 per 1 million output tokens.

What is GPT-4o?

GPT-4o is a model from OpenAI, with closed weights, used for text, agents, code.

What is the context window of GPT-4o?

128,000 tokens, per OpenRouter.

Is GPT-4o open source?

No. It is available through API only.

What is GPT-4o's GPQA Diamond score?

49.2% on GPQA Diamond, per Epoch AI.

Is GPT-4o good for coding?

It scores 31% on SWE-bench Verified, per Epoch AI.

Who made GPT-4o?

It was made by OpenAI, a lab from the US.

provisional data Questions ordered by what shows up in public Google search suggestions (no volume). Answers use source data only.

Models from OpenAI

See lab

Sources

  • Epoch AI, CC BY 4.0, latest version we checked.
  • OpenRouter, dados públicos da API; exports de benchmarks e rankings em CC BY 4.0, latest version we checked.
  • OpenRouter Benchmarks, CC BY 4.0, latest version we checked.

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.