Use case provisional data
Best AI models for agents: benchmark comparison
Using tools, following policies and finishing multi-step tasks. τ-bench simulates an airline support desk with rules and systems.
Direct answer: On τ-bench Verified (airline), the top score among the models on this page is Claude Fable 5, with 82%, per OpenRouter Benchmarks.
How to read this table
- Each row is a model. ClickTap the name to open the full page, with sources and version history. ClickTap a header to sort.
- Benchmark scores are percentages, and higher is better. I always compare the same metric, from the same source, in the latest version we checked. In this section, in the 90% to 100% range, I treat a gap of 1 or 2 points as possible measurement noise.
- The "?" next to each column explains what it measures and when it matters. "No data" means there is no measurement in the open sources this section uses. "Provisional data" marks a field derived by a rule, such as use case.
- Input and output prices are the OpenRouter list price, in US dollars per 1 million tokens, and the two can differ a lot. The "to check" badge marks an odd value in the source, which is left out of recommendations. Usage is the token share in OpenRouter's public ranking, for the latest day published by that source. Downloads are the official Hugging Face repository's 30-day window. Epoch's GPQA Diamond and OpenRouter's GPQA Diamond measure the same test, but they can differ.
| ?what it is | ? | ? | ? | ? | ? | ? | ? | ? | ? | |
|---|---|---|---|---|---|---|---|---|---|---|
| Claude Fable 5Anthropic | closed | US$ 10.00 | US$ 50.00 | 1,000,000 | 85.9% | no data | 82% | 70.7% | no data | no data |
| DeepSeek V4 Flash 0423DeepSeek | open | US$ 0.09 | US$ 0.18 | 1,048,576 | no data | no data | 81.7% | no data | 2.85% | 1,168,829 |
| Gemini 3.7 FlashGoogle | closed | US$ 0.75 | US$ 3.75 | 1,048,576 | 94.8% | no data | 80.7% | 69.2% | no data | no data |
| Qwen3.5 397B A17BAlibaba | open | US$ 0.60 | US$ 3.60 | 262,144 | 86.4% | no data | 80.2% | no data | no data | 826,220 |
| GPT-5.1OpenAI | closed | US$ 1.25 | US$ 10.00 | 400,000 | 87.6% | 68% | 80% | 48% | no data | no data |
| Ling 3.1 FlashAnt Group | undisclosed | US$ 0.045 | US$ 0.14 | 1,000,000 | no data | no data | 79.3% | no data | no data | no data |
| Claude Fable 5.1Anthropic | closed | US$ 10.00 | US$ 50.00 | 1,000,000 | no data | no data | 79.2% | 70.8% | no data | no data |
| Qwen3.6 27BAlibaba | open | US$ 0.32 | US$ 3.20 | 262,144 | 85.9% | no data | 79% | no data | no data | 2,365,084 |
| MiMo V2.6 ProXiaomi | open | US$ 0.43 | US$ 0.87 | 1,050,000 | no data | no data | 78.9% | no data | 0.54% | no data |
| GLM-5.3Zhipu AI (Z.ai) | open | US$ 0.07 | US$ 1.40 | 1,048,576 | 90.9% | no data | 78.8% | 41% | 1.55% | no data |
| Claude Sonnet 5.5Anthropic | closed | US$ 2.00 | US$ 10.00 | 1,000,000 | 95.6% | no data | 78.8% | 46.5% | 1.18% | no data |
| Kimi K3.1 ProMoonshot AI | open | US$ 2.00 | US$ 10.00 | 1,048,576 | 94.2% | no data | 78.7% | 62.2% | 2.51% | no data |
| Gemini 4 ArgonGoogle | closed | US$ 2.00 | US$ 10.00 | 1,048,576 | 96.4% | no data | 78.7% | 76% | 0.54% | no data |
| Claude Opus 5Anthropic | closed | US$ 5.00 | US$ 25.00 | 1,000,000 | 93.9% | no data | 78.7% | 59.9% | no data | no data |
| Qwen3.5-35B-A3BAlibaba | open | US$ 0.14 | US$ 1.00 | 262,144 | 83.5% | no data | 78.7% | no data | no data | 1,582,689 |
| DeepSeek V4 ProDeepSeek | open | US$ 0.96 | US$ 1.91 | 1,048,576 | 91.7% | 77.6% | 78.6% | 52.9% | 0.66% | no data |
| Gemini 3.5 Flash LiteGoogle | closed | US$ 0.30 | US$ 2.50 | 1,048,576 | 83.3% | no data | 78.3% | no data | no data | no data |
| MiMo-V2.6-FlashXiaomi | open | US$ 0.14 | US$ 0.28 | 1,050,000 | no data | no data | 78.2% | no data | 2.22% | 76,859 |
| Qwen3.8 27BAlibaba | open | US$ 0.15 | US$ 1.88 | 1,048,575 | no data | no data | 78% | no data | 0.34% | 7,443,748 |
| DeepSeek V4.1 FlashDeepSeek | open | US$ 0.022 | US$ 0.40 | 1,048,576 | 93.2% | no data | 77.8% | 42.9% | 32.17% | no data |
| Claude Opus 4.7Anthropic | closed | US$ 5.00 | US$ 25.00 | 1,000,000 | 90.2% | 83.5% | 77.8% | 51.7% | no data | no data |
| Qwen3.5-122B-A10BAlibaba | open | US$ 0.26 | US$ 2.08 | 262,144 | no data | no data | 77.7% | no data | no data | 880,973 |
| Hy4Tencent | open | US$ 0.42 | US$ 1.25 | 1,048,576 | no data | no data | 77.6% | no data | 10.74% | no data |
| Claude Opus 4.8Anthropic | closed | US$ 5.00 | US$ 25.00 | 1,000,000 | 91% | no data | 77.5% | 53% | no data | no data |
| Qwen3.8 2.4T A95BAlibaba | open | US$ 2.00 | US$ 6.00 | 1,048,576 | no data | no data | 77.4% | no data | no data | 26,226 |
| Kimi K2.7 CodeMoonshot AI | open | US$ 0.60 | US$ 3.50 | 262,144 | 87.9% | no data | 77.3% | 36.5% | no data | 91,687 |
| Muse Glimmer 30BMeta | open | US$ 0.30 | US$ 1.20 | 131,072 | no data | no data | 77.2% | no data | no data | no data |
| Gemma 4 31BGoogle | open | US$ 0.20 | US$ 0.40 | 262,144 | 75.8% | no data | 77% | 10.4% | 0.22% | no data |
| Gemini 3.1 ProGoogle | closed | US$ 2.00 | US$ 12.00 | 1,048,576 | 94.4% | 75.6% | 77% | 73.5% | no data | no data |
| GLM 5Zhipu AI (Z.ai) | open | US$ 1.00 | US$ 3.20 | 204,800 | 87.8% | 72.1% | 76.9% | no data | no data | 1,370,207 |
| Gemini 3.8 FlashGoogle | closed | US$ 0.82 | US$ 4.12 | 1,048,576 | 95.4% | no data | 76.7% | 69.7% | 0.82% | no data |
| GLM-5.2Zhipu AI (Z.ai) | open | US$ 0.007 to check | US$ 6.80 | 1,048,576 | 91.9% | 78.7% | 76.7% | 34.2% | 0.43% | no data |
| Nova Micro 1.0Amazon | undisclosed | US$ 0.035 | US$ 0.14 | 128,000 | no data | no data | 76.7% | no data | no data | no data |
| DeepSeek V4 Flash Vision ExpDeepSeek | open | US$ 0.44 | US$ 1.32 | 1,048,576 | no data | no data | 76.7% | no data | no data | 148,215 |
| Claude Opus 4.5Anthropic | closed | US$ 5.00 | US$ 25.00 | 200,000 | 86% | 76.7% | 76.6% | 45.7% | no data | no data |
| Qwen3.8 FlashAlibaba | open | US$ 0.15 | US$ 0.47 | 1,000,000 | no data | no data | 76.4% | no data | 0.7% | no data |
| GLM-5.3-FlashZhipu AI (Z.ai) | open | US$ 0.04 | US$ 0.078 | 1,048,576 | 90.2% | no data | 76.3% | no data | 5.09% | no data |
| MiniMax M3MiniMax | open | US$ 0.30 | US$ 1.20 | 1,048,576 | 90.9% | no data | 76.3% | no data | 0.3% | no data |
| Gemini 3.6 FlashGoogle | closed | US$ 0.75 | US$ 3.75 | 1,048,576 | 94.1% | no data | 76.3% | 66.2% | no data | no data |
| Kimi K3Moonshot AI | open | US$ 0.19 to check | US$ 16.00 | 1,048,576 | 93.1% | no data | 76.2% | 50.6% | 0.5% | no data |
| Qwen3.6 35B A3BAlibaba | open | US$ 0.10 | US$ 0.90 | 262,144 | 84.8% | no data | 76.2% | no data | no data | 4,177,044 |
| GLM 4.7Zhipu AI (Z.ai) | open | US$ 0.60 | US$ 2.20 | 204,800 | 83.3% | no data | 76% | 32.2% | no data | 47,416 |
| Claude Opus 4.6Anthropic | closed | US$ 5.00 | US$ 25.00 | 1,000,000 | 90.5% | 78.7% | 75.8% | 47% | no data | no data |
| GLM 5.1Zhipu AI (Z.ai) | open | US$ 1.40 | US$ 4.40 | 204,800 | 89.9% | 74.2% | 75.8% | 34% | no data | 867,145 |
| Muse Spark OpenMeta | open | US$ 1.25 | US$ 4.25 | 1,048,576 | 88.6% | no data | 75.7% | 56.6% | no data | no data |
| Qwen3.5-9BAlibaba | open | US$ 0.052 | US$ 0.077 | 262,144 | 79% | no data | 75.7% | no data | no data | 6,370,574 |
| Claude Sonnet 5Anthropic | closed | US$ 2.00 | US$ 10.00 | 1,000,000 | 90.5% | no data | 75.4% | 33.7% | 0.25% | no data |
| Claude Opus 5.5Anthropic | closed | US$ 4.00 | US$ 20.00 | 1,000,000 | 90.6% | no data | 75.3% | 72.2% | 3.21% | no data |
| Grok 4.7xAI | closed | US$ 2.00 | US$ 6.00 | 500,000 | 92.7% | no data | 75.3% | 56% | 0.22% | no data |
| Grok 4.6xAI | closed | US$ 2.00 | US$ 6.00 | 500,000 | 94% | no data | 75.3% | 49.3% | no data | no data |
| GPT-5.3-CodexOpenAI | closed | US$ 1.75 | US$ 14.00 | 400,000 | no data | 74.8% | 75.3% | no data | no data | no data |
| GPT-5.4OpenAI | closed | US$ 2.50 | US$ 15.00 | 1,050,000 | 93.3% | 76.9% | 75% | 45.1% | no data | no data |
| Nemotron 3.5 Super VLNVIDIA | open | US$ 0.15 | US$ 0.47 | 1,048,576 | no data | no data | 74.9% | no data | 1.49% | no data |
| Claude Sonnet 4.5Anthropic | closed | US$ 3.00 | US$ 15.00 | 1,000,000 | 82.3% | 71.3% | 74.9% | 30.7% | no data | no data |
| Kimi K2.6Moonshot AI | open | US$ 0.65 | US$ 3.41 | 262,144 | 90.8% | 76.7% | 74.9% | 34.9% | no data | no data |
| Claude Sonnet 4.6Anthropic | closed | US$ 3.00 | US$ 15.00 | 1,000,000 | 87.4% | 75.2% | 74.8% | 35.5% | no data | no data |
| MiniMax M3.1 FlashMiniMax | open | US$ 0.15 | US$ 0.60 | 1,048,576 | no data | no data | 74.7% | no data | 1.89% | 55,087 |
| GPT-5.5OpenAI | closed | US$ 5.00 | US$ 30.00 | 1,050,000 | 94% | 80.6% | 74.7% | 63% | no data | no data |
| DeepSeek V3.2DeepSeek | open | US$ 0.26 | US$ 0.38 | 163,840 | 83.4% | no data | 74.7% | no data | no data | no data |
| MiMo-V2.5Xiaomi | open | US$ 0.40 | US$ 2.00 | 1,000,000 | no data | no data | 74.7% | no data | no data | 100,669 |
| GPT-5.6 SolOpenAI | closed | US$ 4.40 | US$ 22.00 | 1,050,000 | 93.5% | no data | 74.2% | 69.7% | no data | no data |
| MiMo-V2.5-ProXiaomi | open | US$ 0.48 | US$ 1.80 | 1,024,000 | no data | no data | 74.1% | no data | no data | 9,642 |
| Claude Haiku 5.5Anthropic | closed | US$ 0.10 to check | US$ 0.50 | 1,000,000 | 89.6% | no data | 74% | 23.8% | 1.27% | no data |
| Ling 3.0 FlashAnt Group | open | US$ 0.021 | US$ 0.063 | 262,144 | no data | no data | 74% | no data | no data | 9,515 |
| Kimi K2.5Moonshot AI | open | US$ 0.53 | US$ 3.33 | 262,144 | 87.6% | 73.8% | 73.8% | 34.3% | no data | 393,277 |
| MiniMax M2.7MiniMax | open | US$ 0.21 | US$ 0.84 | 196,608 | no data | no data | 73.4% | no data | no data | 303,481 |
| Gemini 3 Flash PreviewGoogle | undisclosed | US$ 0.50 | US$ 3.00 | 1,048,576 | no data | no data | 73.3% | no data | 0.32% | no data |
| GLM 4.6Zhipu AI (Z.ai) | open | US$ 0.50 | US$ 2.00 | 204,800 | no data | no data | 73.3% | no data | no data | 27,796 |
| DeepSeek V3.1DeepSeek | open | US$ 0.25 | US$ 0.95 | 163,840 | no data | no data | 73.1% | no data | no data | 266,086 |
| DeepSeek V3.1 TerminusDeepSeek | open | US$ 0.27 | US$ 1.00 | 163,840 | no data | no data | 73% | no data | no data | 9,250 |
| Gemini 3.5 FlashGoogle | closed | US$ 1.50 | US$ 9.00 | 1,048,576 | 92.8% | 79.3% | 73% | 66.2% | no data | no data |
| GPT-5.6 LunaOpenAI | closed | US$ 0.20 | US$ 1.20 | 1,050,000 | 91.6% | no data | 72.7% | 41% | 0.68% | no data |
| Gemini 3.1 Flash LiteGoogle | closed | US$ 0.25 | US$ 1.50 | 1,048,576 | 81.8% | no data | 72.7% | no data | 0.26% | no data |
| GPT-6 Astra ProOpenAI | undisclosed | US$ 10.00 | US$ 50.00 | 1,050,000 | no data | no data | 72.7% | no data | no data | no data |
| Qwen3.7 PlusAlibaba | closed | US$ 0.32 | US$ 1.28 | 1,000,000 | 87.9% | no data | 72.7% | no data | no data | no data |
| GPT-5 MiniOpenAI | closed | US$ 0.25 | US$ 2.00 | 400,000 | 75% | 64.7% | 72.4% | 21.6% | no data | no data |
| GPT-5.6 TerraOpenAI | closed | US$ 2.00 | US$ 12.00 | 1,050,000 | 93.3% | no data | 72.3% | 43.2% | no data | no data |
| Ling 3.0 Flash VLAnt Group | open | US$ 0.06 | US$ 0.18 | 131,072 | no data | no data | 72% | no data | no data | 9,945 |
| Qwen3.7 MaxAlibaba | closed | US$ 1.48 | US$ 4.42 | 1,000,000 | 90.9% | 77.3% | 72% | 55.8% | no data | no data |
| GPT-5.6 Sol ProOpenAI | undisclosed | US$ 4.00 | US$ 20.00 | 1,050,000 | no data | no data | 71.7% | no data | no data | no data |
| Nemotron 3.5 LightningNVIDIA | open | US$ 0.07 | US$ 0.20 | 262,144 | no data | no data | 71.5% | no data | 0.52% | 1,070,415 |
| GPT-6.1 SolOpenAI | closed | US$ 2.00 | US$ 10.00 | 1,050,000 | 95.4% | no data | 70.7% | 73.9% | 1.62% | no data |
| GPT-5OpenAI | closed | US$ 1.25 | US$ 10.00 | 400,000 | 86.2% | 73.6% | 70.7% | 50.1% | no data | no data |
| GPT-5.6 Luna ProOpenAI | undisclosed | US$ 0.20 | US$ 1.20 | 1,050,000 | no data | no data | 70.7% | no data | no data | no data |
| Gemma 4 26B A4BGoogle | open | US$ 0.08 | US$ 0.10 | 262,144 | 73.2% | no data | 70.6% | no data | 0.21% | 5,439,703 |
| GPT-6 SolOpenAI | closed | US$ 2.00 | US$ 10.00 | 1,050,000 | 94.3% | no data | 70.2% | 60.7% | no data | no data |
| GPT-6.1 TerraOpenAI | closed | US$ 1.00 | US$ 5.00 | 1,050,000 | 94.3% | no data | 70% | 57.3% | 0.58% | no data |
| GPT-6 AstraOpenAI | closed | US$ 10.00 | US$ 50.00 | 1,050,000 | 95.8% | no data | 69.7% | 75.6% | no data | no data |
| GLM 4.7 FlashZhipu AI (Z.ai) | open | US$ 0.06 | US$ 0.40 | 200,000 | no data | no data | 69.7% | no data | no data | 1,071,754 |
| GPT-6 Luna ProOpenAI | undisclosed | US$ 0.10 | US$ 0.50 | 1,050,000 | no data | no data | 69.3% | no data | 0.31% | no data |
| MiniMax M2.5MiniMax | open | US$ 0.27 | US$ 1.08 | 200,000 | no data | no data | 69.2% | no data | no data | 1,184,681 |
| GPT-6 LunaOpenAI | closed | US$ 0.10 | US$ 0.50 | 1,050,000 | 90.5% | no data | 68.4% | 41.4% | 3.42% | no data |
| gpt-oss-120bOpenAI | open | US$ 0.15 | US$ 0.60 | 131,072 | 75.8% | no data | 67.3% | no data | 0.24% | no data |
| GPT-5.4 MiniOpenAI | closed | US$ 0.75 | US$ 4.50 | 400,000 | 86.9% | no data | 66.7% | 29.4% | no data | no data |
| Claude Haiku 4.5Anthropic | closed | US$ 1.00 | US$ 5.00 | 200,000 | 71.2% | no data | 66.4% | 13.2% | no data | no data |
| GPT-5.4 NanoOpenAI | closed | US$ 0.20 | US$ 1.25 | 400,000 | 78.5% | no data | 65.6% | 11.7% | no data | no data |
| Granite 4.2 8BIBM | open | US$ 0.06 | US$ 0.15 | 131,072 | no data | no data | 64% | no data | no data | no data |
| Qwen3 235B A22B Thinking 2507Alibaba | open | US$ 0.45 | US$ 3.50 | 128,000 | no data | no data | 61.7% | no data | no data | 8,177 |
| Qwen3 Coder NextAlibaba | open | US$ 0.12 | US$ 0.80 | 262,144 | no data | no data | 60.7% | no data | no data | 425,899 |
| GLM 4.6VZhipu AI (Z.ai) | open | US$ 0.30 | US$ 0.90 | 131,072 | no data | no data | 60.7% | no data | no data | 5,245 |
| Gemini 2.5 ProGoogle | closed | US$ 1.25 | US$ 10.00 | 1,048,576 | 85.3% | 57.6% | 60% | no data | no data | no data |
| Gemini 2.5 FlashGoogle | closed | US$ 0.30 | US$ 2.50 | 1,048,576 | no data | no data | 59.1% | no data | no data | no data |
| DeepSeek R1DeepSeek | open | US$ 0.50 | US$ 2.15 | 163,840 | 76.3% | no data | 58% | no data | no data | no data |
| Qwen3 32BAlibaba | open | US$ 0.08 | US$ 0.28 | 131,072 | 65.7% | no data | 54.3% | no data | no data | 3,001,273 |
| Gemini 2.5 Flash LiteGoogle | undisclosed | US$ 0.10 | US$ 0.40 | 1,048,576 | no data | no data | 53.7% | no data | 0.17% | no data |
| gpt-oss-20bOpenAI | open | US$ 0.03 | US$ 0.13 | 131,072 | 60.8% | no data | 53.5% | no data | no data | no data |
| GPT-4.1OpenAI | closed | US$ 2.00 | US$ 8.00 | 1,047,576 | 66.9% | 48.5% | 52.3% | 31.1% | no data | no data |
| Nemotron 3 Nano 30B A3BNVIDIA | open | US$ 0.06 | US$ 0.24 | 262,144 | no data | no data | 52% | no data | no data | 1,556,699 |
| GPT-5 NanoOpenAI | closed | US$ 0.05 | US$ 0.40 | 400,000 | 69.4% | no data | 48.3% | 11.7% | no data | no data |
| Qwen3-CoderAlibaba | open | US$ 0.30 | US$ 1.00 | 262,144 | no data | no data | 48% | no data | no data | 58,791 |
| Gemma 3 12BGoogle | open | US$ 0.05 | US$ 0.15 | 131,072 | 39.5% | no data | 48% | no data | no data | no data |
| Qwen3 VL 235B A22B InstructAlibaba | open | US$ 0.21 | US$ 1.90 | 262,144 | no data | no data | 48% | no data | no data | 325,913 |
| Qwen3-235B-A22BAlibaba | open | US$ 0.14 | US$ 0.80 | 262,144 | 80.1% | no data | 47.9% | 40.4% | no data | no data |
| Qwen3 Next 80B A3B InstructAlibaba | open | US$ 0.09 | US$ 1.10 | 262,144 | no data | no data | 47.5% | no data | no data | 129,851 |
| Qwen3 30B A3BAlibaba | open | US$ 0.12 | US$ 0.50 | 40,960 | 70.1% | no data | 47% | no data | no data | 1,135,784 |
| Mistral Small 4Mistral AI | open | US$ 0.15 | US$ 0.60 | 262,144 | no data | no data | 46% | no data | no data | 28,703 |
| Qwen3 Coder 30B A3B InstructAlibaba | open | US$ 0.15 | US$ 0.60 | 262,144 | no data | no data | 46% | no data | no data | 1,679,625 |
| GPT-4.1 MiniOpenAI | closed | US$ 0.40 | US$ 1.60 | 1,047,576 | 65.8% | no data | 45.1% | 12.7% | no data | no data |
| Qwen3 14BAlibaba | open | US$ 0.10 | US$ 0.22 | 40,960 | 63.8% | no data | 44% | no data | no data | 12,907,991 |
| DeepSeek V3DeepSeek | open | US$ 0.29 | US$ 1.14 | 163,840 | 67.6% | no data | 43.8% | no data | no data | no data |
| Llama 4 MaverickMeta | open | US$ 0.35 | US$ 1.00 | 524,288 | 67% | no data | 43.4% | no data | no data | 11,953 |
| GPT-4oOpenAI | closed | US$ 2.50 | US$ 10.00 | 128,000 | 49.2% | 31% | 43.2% | 26% | no data | no data |
| DeepSeek V3DeepSeek | open | US$ 0.32 | US$ 0.89 | 163,840 | 56.5% | no data | 43% | no data | no data | 1,486,147 |
| Qwen3 30B A3B Instruct 2507Alibaba | open | US$ 0.10 | US$ 0.30 | 262,144 | no data | no data | 41.5% | no data | no data | 880,864 |
| Qwen3 VL 30B A3B InstructAlibaba | open | US$ 0.15 | US$ 0.60 | 262,144 | no data | no data | 41.3% | no data | no data | 446,889 |
| Llama 3.3 70B InstructMeta | open | US$ 0.71 | US$ 0.71 | 131,072 | no data | no data | 39.9% | no data | no data | 349,408 |
| Qwen3 VL 8B InstructAlibaba | open | US$ 0.25 | US$ 0.75 | 262,144 | no data | no data | 32.7% | no data | no data | 7,052,170 |
| GPT-4o-miniOpenAI | closed | US$ 0.15 | US$ 0.60 | 128,000 | 37.7% | no data | 30.7% | 8.3% | no data | no data |
| Qwen2.5 72B InstructAlibaba | open | US$ 0.36 | US$ 0.40 | 32,768 | no data | no data | 27.3% | no data | no data | 151,833 |
| Llama 3.1 8B InstructMeta | open | US$ 0.02 | US$ 0.04 | 131,072 | no data | no data | 23.5% | no data | no data | no data |
| GPT-4.1 NanoOpenAI | closed | US$ 0.10 | US$ 0.40 | 1,047,576 | 48.9% | no data | 14% | 6% | no data | no data |
| Step 5 PreviewStepFun | open | US$ 1.00 | US$ 2.70 | 1,000,000 | no data | no data | no data | no data | 3.25% | no data |
| Nemotron 3 UltraNVIDIA | open | US$ 0.60 | US$ 2.40 | 262,144 | 85.4% | no data | no data | no data | 1.77% | 1,080,025 |
| Muse Spark 1.3 ContributorMeta | undisclosed | US$ 0.10 | US$ 0.20 | 1,048,576 | no data | no data | no data | no data | 1.6% | no data |
| Hy3Tencent | open | US$ 0.13 | US$ 0.53 | 262,144 | no data | no data | no data | no data | 1.09% | 1,141,189 |
| Solar Mini 4Upstage | undisclosed | US$ 0.05 | US$ 0.20 | 524,288 | no data | no data | no data | no data | 0.59% | no data |
| Qwen3.7 FlashAlibaba | closed | US$ 0.03 | US$ 0.13 | 1,000,000 | 82.3% | no data | no data | no data | 0.2% | no data |
| Solar Pro 4Upstage | undisclosed | US$ 0.15 | US$ 0.60 | 524,288 | no data | no data | no data | no data | 0.2% | no data |
| Claude Fable 5.2Anthropic | closed | US$ 8.00 | US$ 40.00 | 1,000,000 | 93.9% | no data | no data | 94% | no data | no data |
| GPT-5.2OpenAI | closed | US$ 1.75 | US$ 14.00 | 400,000 | 91.4% | 73.8% | no data | 37.1% | no data | no data |
| Qwen3.8 MaxAlibaba | closed | US$ 2.00 | US$ 6.00 | 1,000,000 | 92.7% | no data | no data | 47.3% | no data | no data |
| Mistral Large 4Mistral AI | open | US$ 0.70 | US$ 2.10 | 1,048,576 | 90.2% | no data | no data | 22.4% | no data | no data |
| Nova 2 LiteAmazon | undisclosed | US$ 0.30 | US$ 2.50 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Nova Lite 1.0Amazon | undisclosed | US$ 0.06 | US$ 0.24 | 300,000 | no data | no data | no data | no data | no data | no data |
| Nova Premier 1.0Amazon | undisclosed | US$ 2.50 | US$ 12.50 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Nova Pro 1.0Amazon | undisclosed | US$ 0.80 | US$ 3.20 | 300,000 | no data | no data | no data | no data | no data | no data |
| Claude Opus 4.1Anthropic | closed | US$ 15.00 | US$ 75.00 | 200,000 | 77.3% | 73.3% | no data | no data | no data | no data |
| Seed 1.6ByteDance | undisclosed | no data | no data | no data | no data | no data | no data | no data | no data | no data |
| Seed 1.6 FlashByteDance | undisclosed | no data | no data | no data | no data | no data | no data | no data | no data | no data |
| Seed 2.1 TurboByteDance | undisclosed | US$ 0.50 | US$ 2.50 | 262,144 | no data | no data | no data | no data | no data | no data |
| Seed-2.0-CodeByteDance | undisclosed | no data | no data | no data | no data | no data | no data | no data | no data | no data |
| Seed-2.0-LiteByteDance | undisclosed | US$ 0.25 | US$ 2.00 | 262,144 | no data | no data | no data | no data | no data | no data |
| Seed-2.0-MiniByteDance | undisclosed | US$ 0.10 | US$ 0.40 | 262,144 | no data | no data | no data | no data | no data | no data |
| Command ACohere | open | US$ 2.50 | US$ 10.00 | 256,000 | no data | no data | no data | no data | no data | no data |
| Command A+Cohere | undisclosed | US$ 0.30 | US$ 1.50 | 192,000 | no data | no data | no data | no data | no data | no data |
| Command R (08-2024)Cohere | undisclosed | US$ 0.15 | US$ 0.60 | 128,000 | no data | no data | no data | no data | no data | no data |
| Command R+ (08-2024)Cohere | undisclosed | US$ 2.50 | US$ 10.00 | 128,000 | no data | no data | no data | no data | no data | no data |
| Command R7B (12-2024)Cohere | undisclosed | US$ 0.037 | US$ 0.15 | 128,000 | no data | no data | no data | no data | no data | no data |
| DeepSeek V3.2 ExpDeepSeek | open | US$ 0.27 | US$ 0.41 | 163,840 | no data | no data | no data | no data | no data | 45,262 |
| Gemini 2.5 Pro Preview 06-05Google | undisclosed | US$ 1.25 | US$ 10.00 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Nano Banana Pro (Gemini 3 Pro Image)Google | undisclosed | US$ 2.00 | US$ 12.00 | 131,072 | no data | no data | no data | no data | no data | no data |
| Gemini 3.1 Flash Lite PreviewGoogle | undisclosed | US$ 0.25 | US$ 1.50 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Gemini 3.1 Pro Preview Custom ToolsGoogle | undisclosed | US$ 2.00 | US$ 12.00 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Nano Banana 2.1Google | undisclosed | US$ 1.50 | US$ 7.50 | 65,536 | no data | no data | no data | no data | no data | no data |
| Gemma 3 27BGoogle | open | US$ 0.08 | US$ 0.35 | 131,072 | 47.7% | no data | no data | no data | no data | no data |
| Ling 3.0 TinyAnt Group | open | US$ 0.015 | US$ 0.045 | 262,144 | no data | no data | no data | no data | no data | 13,841 |
| LFM2.5-2.6BLiquid AI | open | US$ 0.35 | US$ 0.50 | 128,000 | no data | no data | no data | no data | no data | 47,737 |
| LFM2.5-24B-A2BLiquid AI | open | US$ 0.05 | US$ 0.70 | 128,000 | no data | no data | no data | no data | no data | 39,597 |
| LFM3-1.7BLiquid AI | open | US$ 0.08 | US$ 0.20 | 262,144 | no data | no data | no data | no data | no data | 82,718 |
| LongCat 2.0Meituan | open | US$ 0.30 | US$ 1.20 | 1,048,756 | no data | no data | no data | no data | no data | 3,024 |
| Llama 4 ScoutMeta | open | US$ 0.10 | US$ 0.30 | 1,310,720 | 51.8% | no data | no data | no data | no data | 111,251 |
| Muse EmberMeta | undisclosed | US$ 0.10 | US$ 0.50 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Muse Spark 1.1Meta | closed | US$ 1.25 | US$ 4.25 | 1,048,576 | no data | no data | no data | 57.8% | no data | no data |
| Muse Spark 1.2Meta | closed | US$ 1.25 | US$ 4.25 | 1,048,576 | no data | no data | no data | 60.3% | no data | no data |
| Muse Spark 1.2 ContributorMeta | undisclosed | US$ 0.10 | US$ 0.20 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Muse Spark 1.3Meta | closed | US$ 1.25 | US$ 4.25 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Muse WonderMeta | closed | US$ 4.00 | US$ 20.00 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| Codestral 2508Mistral AI | undisclosed | US$ 0.30 | US$ 0.90 | 256,000 | no data | no data | no data | no data | no data | no data |
| Devstral 2 2512Mistral AI | open | US$ 0.40 | US$ 2.00 | 262,144 | no data | no data | no data | no data | no data | 6,656 |
| Ministral 3 14B 2512Mistral AI | open | US$ 0.20 | US$ 0.20 | 262,144 | no data | no data | no data | no data | no data | 180,348 |
| Ministral 3 3B 2512Mistral AI | open | US$ 0.10 | US$ 0.10 | 131,072 | no data | no data | no data | no data | no data | 66,175 |
| Ministral 3 8B 2512Mistral AI | open | US$ 0.15 | US$ 0.15 | 262,144 | no data | no data | no data | no data | no data | 93,502 |
| Mistral LargeMistral AI | closed | US$ 2.00 | US$ 6.00 | 128,000 | 38.8% | no data | no data | no data | no data | no data |
| Mistral Medium 3Mistral AI | closed | US$ 0.40 | US$ 2.00 | 131,072 | 59.5% | no data | no data | no data | no data | no data |
| Mistral Medium 3.5Mistral AI | undisclosed | US$ 1.50 | US$ 7.50 | 262,144 | no data | no data | no data | no data | no data | no data |
| Mistral Medium 3.1Mistral AI | undisclosed | US$ 0.40 | US$ 2.00 | 131,072 | no data | no data | no data | no data | no data | no data |
| Mistral NemoMistral AI | open | US$ 0.029 | US$ 0.03 | 131,072 | 29.9% | no data | no data | no data | no data | 96,932 |
| SabaMistral AI | undisclosed | US$ 0.20 | US$ 0.60 | 32,768 | no data | no data | no data | no data | no data | no data |
| Mistral Small 3.1 24BMistral AI | open | US$ 0.35 | US$ 0.56 | 128,000 | no data | no data | no data | no data | no data | 161,294 |
| Mistral Small 3.2 24BMistral AI | open | US$ 0.10 | US$ 0.30 | 256,000 | no data | no data | no data | no data | no data | 104,505 |
| Mixtral 8x22B InstructMistral AI | open | US$ 2.00 | US$ 6.00 | 65,536 | no data | no data | no data | no data | no data | 39,252 |
| Voxtral Small 24B 2507Mistral AI | open | US$ 0.10 | US$ 0.30 | 32,768 | no data | no data | no data | no data | no data | 6,535 |
| Kimi K2 0711Moonshot AI | open | US$ 0.57 | US$ 2.30 | 131,072 | no data | no data | no data | no data | no data | 277,844 |
| Kimi K2 ThinkingMoonshot AI | open | US$ 0.60 | US$ 2.50 | 262,144 | 84.2% | no data | no data | no data | no data | 53,302 |
| Nemotron 3 SuperNVIDIA | open | US$ 0.075 | US$ 0.40 | 262,144 | no data | no data | no data | no data | no data | 35,797 |
| GPT-3.5 Turbo (older v0613)OpenAI | undisclosed | US$ 1.00 | US$ 2.00 | 4,095 | no data | no data | no data | no data | no data | no data |
| GPT-3.5 Turbo 16kOpenAI | undisclosed | US$ 3.00 | US$ 4.00 | 16,385 | no data | no data | no data | no data | no data | no data |
| GPT-4OpenAI | closed | US$ 30.00 | US$ 60.00 | 8,191 | 35.7% | no data | no data | no data | no data | no data |
| GPT-5 ProOpenAI | closed | US$ 15.00 | US$ 120.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.1-CodexOpenAI | undisclosed | US$ 1.25 | US$ 10.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.1-Codex-MaxOpenAI | undisclosed | US$ 1.25 | US$ 10.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.1-Codex-MiniOpenAI | undisclosed | US$ 0.25 | US$ 2.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.2 ChatOpenAI | undisclosed | US$ 1.75 | US$ 14.00 | 128,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.2-CodexOpenAI | undisclosed | US$ 1.75 | US$ 14.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.2 ProOpenAI | closed | US$ 21.00 | US$ 168.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| GPT-5.4 ProOpenAI | closed | US$ 30.00 | US$ 180.00 | 1,050,000 | 94.6% | no data | no data | 46.3% | no data | no data |
| GPT-5.5 ProOpenAI | closed | US$ 30.00 | US$ 180.00 | 1,050,000 | 93.9% | no data | no data | no data | no data | no data |
| GPT-5.6 Terra ProOpenAI | undisclosed | US$ 2.00 | US$ 12.00 | 1,050,000 | no data | no data | no data | no data | no data | no data |
| GPT-6 Sol ProOpenAI | undisclosed | US$ 2.00 | US$ 10.00 | 1,050,000 | no data | no data | no data | no data | no data | no data |
| GPT-6.1 Sol ProOpenAI | undisclosed | US$ 2.00 | US$ 10.00 | 1,050,000 | no data | no data | no data | no data | no data | no data |
| GPT-6.1 Terra ProOpenAI | undisclosed | US$ 1.00 | US$ 5.00 | 1,050,000 | no data | no data | no data | no data | no data | no data |
| GPT AudioOpenAI | undisclosed | US$ 2.50 | US$ 10.00 | 128,000 | no data | no data | no data | no data | no data | no data |
| GPT Audio MiniOpenAI | undisclosed | US$ 0.60 | US$ 2.40 | 128,000 | no data | no data | no data | no data | no data | no data |
| GPT Chat LatestOpenAI | undisclosed | US$ 5.00 | US$ 30.00 | 400,000 | no data | no data | no data | no data | no data | no data |
| gpt-oss-safeguard-20bOpenAI | open | US$ 0.075 | US$ 0.30 | 131,072 | no data | no data | no data | no data | no data | no data |
| o3OpenAI | closed | US$ 2.00 | US$ 8.00 | 200,000 | 81.8% | 62.3% | no data | 49.4% | no data | no data |
| o3 ProOpenAI | undisclosed | US$ 20.00 | US$ 80.00 | 200,000 | no data | no data | no data | no data | no data | no data |
| Qwen2.5 7B InstructAlibaba | open | no data | no data | no data | no data | no data | no data | no data | no data | 6,075,622 |
| Qwen-PlusAlibaba | closed | US$ 0.26 | US$ 0.78 | 1,000,000 | 48.1% | no data | no data | no data | no data | no data |
| Qwen3 Coder FlashAlibaba | undisclosed | US$ 0.20 | US$ 0.97 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Qwen3 VL 30B A3B ThinkingAlibaba | open | US$ 0.29 | US$ 1.00 | 262,144 | no data | no data | no data | no data | no data | 9,400 |
| Qwen3.5-27BAlibaba | open | US$ 0.26 | US$ 2.60 | 262,144 | no data | no data | no data | no data | no data | 1,661,103 |
| Qwen3.5-FlashAlibaba | undisclosed | US$ 0.065 | US$ 0.26 | 1,000,000 | 82.3% | no data | no data | 20.3% | no data | no data |
| Qwen3.5 Plus 2026-02-15Alibaba | undisclosed | US$ 0.26 | US$ 1.56 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Qwen3.5 Plus 2026-04-20Alibaba | undisclosed | US$ 0.30 | US$ 1.80 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Qwen3.6 FlashAlibaba | undisclosed | US$ 0.19 | US$ 1.12 | 1,000,000 | 83.3% | no data | no data | 15.9% | no data | no data |
| Qwen3.6 PlusAlibaba | closed | US$ 0.33 | US$ 1.95 | 1,000,000 | 88.4% | 57.9% | no data | 44.1% | no data | no data |
| Qwen3.8 Max PrimeAlibaba | undisclosed | US$ 4.00 | US$ 12.00 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Qwen3.8 Omni FlashAlibaba | undisclosed | US$ 0.15 | US$ 0.47 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Step 3.5 FlashStepFun | open | US$ 0.10 | US$ 0.30 | 262,144 | no data | no data | no data | no data | no data | 188,228 |
| Step 3.7 FlashStepFun | open | US$ 0.20 | US$ 1.15 | 262,144 | no data | no data | no data | no data | no data | 10,411 |
| Hy3 previewTencent | open | US$ 0.18 | US$ 0.60 | 262,144 | no data | no data | no data | no data | no data | 69,777 |
| Grok 4.20xAI | closed | US$ 1.25 | US$ 2.50 | 2,000,000 | 89.3% | no data | no data | 30.2% | no data | no data |
| Grok 4.3xAI | undisclosed | US$ 1.25 | US$ 2.50 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| Grok 4.5xAI | closed | US$ 2.00 | US$ 6.00 | 500,000 | 93.4% | no data | no data | 48.3% | no data | no data |
| Grok Build 0.1xAI | undisclosed | US$ 1.00 | US$ 2.00 | 256,000 | no data | no data | no data | no data | no data | no data |
| MiMo-V2.6-Pro-UltraSpeedXiaomi | undisclosed | US$ 4.35 | US$ 8.70 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| GLM 4.5Zhipu AI (Z.ai) | open | US$ 0.60 | US$ 2.20 | 131,072 | no data | no data | no data | no data | no data | 113,522 |
| GLM 4.5 AirZhipu AI (Z.ai) | open | US$ 0.20 | US$ 1.10 | 131,072 | no data | no data | no data | no data | no data | 1,258,503 |
| GLM 4.5VZhipu AI (Z.ai) | open | US$ 0.60 | US$ 1.80 | 65,536 | no data | no data | no data | no data | no data | 15,564 |
| GLM 5 TurboZhipu AI (Z.ai) | undisclosed | US$ 1.20 | US$ 4.00 | 202,752 | no data | no data | no data | no data | no data | no data |
| GLM 5.3 FlashXZhipu AI (Z.ai) | undisclosed | US$ 0.37 | US$ 1.25 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| GLM 5.3 FlashX LegalZhipu AI (Z.ai) | undisclosed | US$ 0.37 | US$ 1.25 | 1,048,576 | no data | no data | no data | no data | no data | no data |
| GLM 5.3 PrimeZhipu AI (Z.ai) | undisclosed | US$ 2.80 | US$ 8.80 | 1,000,000 | no data | no data | no data | no data | no data | no data |
| GLM 5V TurboZhipu AI (Z.ai) | undisclosed | US$ 1.20 | US$ 4.00 | 202,752 | no data | no data | no data | no data | no data | no data |
Which model to use for what
This pick follows the data and changes when the data does.
Agents
- Rule: Highest score on τ-bench Verified (airline)Claude Fable 5 82%
- Rule: Highest open weights score on τ-bench Verified (airline)DeepSeek V4 Flash 0423 81.7%
- Rule: Cheapest per 1M input tokens among the top 5 on τ-bench Verified (airline)DeepSeek V4 Flash 0423 US$ 0.09
τ-bench Verified (airline) ?
What does this mean?
What it measures: τ-bench Verified (airline), on the OpenRouter Benchmarks leaderboard (CC BY 4.0, latest version we checked), simulates an airline support agent that uses systems and must follow company policy until the end of the conversation. The score is the share of tasks completed within the rules.
When it matters: It matters for agents that run tasks with tools. It shows whether the model follows policy across several steps, like an assistant that looks up an internal rule and finishes the request without inventing an exception.
Compare with
Sources
- Epoch AI, CC BY 4.0, latest version we checked.
- OpenRouter Benchmarks, CC BY 4.0, latest version we checked.
- OpenRouter, dados públicos da API; exports de benchmarks e rankings em CC BY 4.0, latest version we checked.
- Hugging Face Hub, metadados públicos do Hub; licença de cada modelo no repositório, latest version we checked.
Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.