RSS

Anthropic

Claude 3.5 Haiku

Benchmarks, price, context and versions

Direct answer: Claude 3.5 Haiku is a model from Anthropic. 38.1% on GPQA Diamond, per Epoch AI.

✓ Good for

  • Not enough data in the open sources this section uses to build this block.

✕ Not the best for

  • technical reasoning on science topics (#167 of 198 on GPQA Diamond)
  • calculation and problems with an exact answer (#165 of 186 on OTIS Mock AIME)

This block follows a rule of this section, using source data: if the model is in the top 25% of the metric, the item goes under "Good for"; if it is in the bottom half, it goes under "Not the best for". The middle band appears in neither. Price and context use OpenRouter; scores use Epoch AI or OpenRouter Benchmarks, in the latest version we checked.

Benchmarks

GPQA Diamond

?what it is
38.1%

highest score on this metric 96.4%

167º / 198 · Epoch AI, latest version we checked

OTIS Mock AIME

?
4.3%

highest score on this metric 100%

165º / 186 · Epoch AI, latest version we checked

Key specs

Origin
the US
Family
Claude Haiku provisional data
Weights?
closed
License
no data
Input US$/1M?
no data
Output US$/1M
no data
Context?
no data
Parameters
no data
Input
no data
OpenRouter usage?
no data
Downloads (30 days)?
no data
Use cases provisional data
Text
Dates in sources
  • 2024, published, per Epoch AI

Version history

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch.

FAQ

What is Claude 3.5 Haiku?

Claude 3.5 Haiku is a model from Anthropic, with closed weights, used for text.

How much does Claude 3.5 Haiku cost?

No data in open sources.

What is the context window of Claude 3.5 Haiku?

No data in open sources.

Is Claude 3.5 Haiku open source?

No. It is available through API only.

What is Claude 3.5 Haiku's GPQA Diamond score?

38.1% on GPQA Diamond, per Epoch AI.

Is Claude 3.5 Haiku good for coding?

No data: there is no SWE-bench Verified measurement for it in open sources.

Who made Claude 3.5 Haiku?

It was made by Anthropic, a lab from the US.

provisional data Questions under review: Semrush had no API balance during collection. Answers use source data only.

Models from Anthropic

See lab

Anthropic does not publish weights on Hugging Face: data only via OpenRouter and Epoch AI.

Sources

  • Epoch AI, CC BY 4.0, latest version we checked.

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.