OpenAI

GPT-4o-mini

Benchmarks, price, context and versions

Also searched as

GPT 4o mini

Direct answer: GPT-4o-mini is a model from OpenAI. 37.7% on GPQA Diamond, per Epoch AI. On OpenRouter, US$ 0.15 per 1 million input tokens and US$ 0.60 per 1 million output tokens.

✓ Good for

  • high-volume use (input price in the cheapest 25% on OpenRouter)

✕ Not the best for

  • technical reasoning on science topics (#169 of 198 on GPQA Diamond)
  • calculation and problems with an exact answer (#154 of 186 on OTIS Mock AIME)
  • the ceiling of reasoning on research-level math (#83 of 86 on FrontierMath (tiers 1 to 3))
  • answering short facts with little invention (#86 of 87 on SimpleQA Verified)
  • technical reasoning as the model appears through the API (#129 of 135 on GPQA Diamond (OpenRouter))
  • agents that follow rules and use tools (#128 of 131 on τ-bench Verified (airline))

This block follows a rule of this section, using source data: if the model is in the top 25% of the metric, the item goes under "Good for"; if it is in the bottom half, it goes under "Not the best for". The middle band appears in neither. Price and context use OpenRouter; scores use Epoch AI or OpenRouter Benchmarks, in the latest version we checked.

Benchmarks

GPQA Diamond

?what it is
37.7%

highest score on this metric 96.4%

169º / 198 · Epoch AI, latest version we checked

OTIS Mock AIME

?
6.9%

highest score on this metric 100%

154º / 186 · Epoch AI, latest version we checked

FrontierMath (tiers 1 to 3)

?
0.7%

highest score on this metric 95.1%

83º / 86 · Epoch AI, latest version we checked

SimpleQA Verified

?
8.3%

highest score on this metric 94%

86º / 87 · Epoch AI, latest version we checked

GPQA Diamond (OpenRouter)

?
43.6%

highest score on this metric 96.5%

129º / 135 · OpenRouter Benchmarks, latest version we checked

τ-bench Verified (airline)

?
30.7%

highest score on this metric 82%

128º / 131 · OpenRouter Benchmarks, latest version we checked

Key specs

Origin
the US
Family
GPT mini provisional data
Weights?
closed
License
no data
Input US$/1M?
US$ 0.15
Output US$/1M
US$ 0.60
Context?
128,000 tokens
Parameters
no data
Input
file, image, text
OpenRouter usage?
no data
Downloads (30 days)?
no data
Use cases provisional data
Text Agents
Dates in sources
  • 2024, published, per Epoch AI
  • 2024, listed on OpenRouter

Version history

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch.

FAQ

What is GPT-4o-mini?

GPT-4o-mini is a model from OpenAI, with closed weights, used for text, agents.

How much does GPT-4o-mini cost?

On OpenRouter, US$ 0.15 per 1 million input tokens and US$ 0.60 per 1 million output tokens.

What is the context window of GPT-4o-mini?

128,000 tokens, per OpenRouter.

Is GPT-4o-mini open source?

No. It is available through API only.

What is GPT-4o-mini's GPQA Diamond score?

37.7% on GPQA Diamond, per Epoch AI.

Is GPT-4o-mini good for coding?

No data: there is no SWE-bench Verified measurement for it in open sources.

Who made GPT-4o-mini?

It was made by OpenAI, a lab from the US.

provisional data Questions under review: Semrush had no API balance during collection. Answers use source data only.

Models from OpenAI

See lab

Sources

  • Epoch AI, CC BY 4.0, latest version we checked.
  • OpenRouter, dados públicos da API; exports de benchmarks e rankings em CC BY 4.0, latest version we checked.
  • OpenRouter Benchmarks, CC BY 4.0, latest version we checked.

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.