# Code: AI models

- **URL canônica:** https://meirinho.com.br/en/ia/modelos/uso/codigo/
- **Idioma:** en
- **Atualizado:** 2026-11-17

---
Use case provisional data

# Best AI models for code: benchmark comparison

Fixing real bugs and writing code that passes tests. SWE-bench Verified is the most used yardstick, but the agent setup changes results a lot.

**Direct answer:** The top score on SWE-bench Verified belongs to Claude Opus 4.7, at 83.5% per Epoch AI, and 4 models are in a statistical tie with it.

## How to read this table

1. Each row is a model. Click the name to open the full page, with sources and version history. Click a header to sort.
2. Benchmark scores are percentages, and higher is better. I always compare the same metric. When there is more than one source, each cell says where the number comes from. The score is the one from the latest version we checked. In this section, in the 90% to 100% range, I treat a gap of 1 or 2 points as possible measurement noise.
3. The "?" next to each column explains what it measures and when it matters. "No data" means there is no measurement in the open sources this section uses. "Provisional data" marks a field derived by a rule, such as use case.
4. Input and output prices use the lab's official price when its page publishes one; when the figure comes from a third-party provider, the cell carries a label. Prices are in US dollars per 1 million tokens, and the two sides can differ a lot. The "to check" badge marks an odd value in the source, which is left out of recommendations. Usage is the token share in OpenRouter's public ranking, for the latest day published by that source. Downloads are the official Hugging Face repository's 30-day window. Epoch's GPQA Diamond and OpenRouter's GPQA Diamond measure the same test, but they can differ.

| Model | Weights[? what it is](https://meirinho.com.br/en/ia/modelos/glossario/pesos-abertos/) | Input US$/1M[?](https://meirinho.com.br/en/ia/modelos/glossario/preco-por-token/) | Output US$/1M[?](https://meirinho.com.br/en/ia/modelos/glossario/preco-por-token/) | Context[?](https://meirinho.com.br/en/ia/modelos/glossario/janela-de-contexto/) | GPQA Diamond[?](https://meirinho.com.br/en/ia/modelos/glossario/gpqa-diamond/) | SWE-bench Verified[?](https://meirinho.com.br/en/ia/modelos/glossario/swe-bench-verified/) | τ-bench Verified (airline)[?](https://meirinho.com.br/en/ia/modelos/glossario/tau-bench/) | SimpleQA Verified[?](https://meirinho.com.br/en/ia/modelos/glossario/simpleqa-verified/) | OpenRouter usage[?](https://meirinho.com.br/en/ia/modelos/glossario/uso-no-openrouter/) | Downloads (30 days)[?](https://meirinho.com.br/en/ia/modelos/glossario/downloads-hugging-face/) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| [Claude Opus 4.7](https://meirinho.com.br/en/ia/modelos/claude-opus-4-7/)Anthropic | closed | US$ 5.00 · Official pricing | US$ 25.00 · Official pricing | 1,000,000 | [90.2%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [83.5%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [77.8%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [51.7%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [GPT-5.5](https://meirinho.com.br/en/ia/modelos/gpt-5-5/)OpenAI | closed | US$ 5.00 · Official pricing | US$ 30.00 · Official pricing | 1,050,000 | [94%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [80.6%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [74.7%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [63%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.02% OpenRouter | no data |
| [Gemini 3.5 Flash](https://meirinho.com.br/en/ia/modelos/gemini-3-5-flash/)Google | closed | US$ 1.50 · OpenRouter | US$ 9.00 · OpenRouter | 1,048,576 | [92.8%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [79.3%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [73%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [66.2%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.03% OpenRouter | no data |
| [GLM-5.2](https://meirinho.com.br/en/ia/modelos/glm-5-2/)Zhipu AI (Z.ai) | open | US$ 1.40 · Official pricing | US$ 4.40 · Official pricing | 1,048,576 | [91.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [78.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [76.7%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [34.2%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.4% OpenRouter | no data |
| [Claude Opus 4.6](https://meirinho.com.br/en/ia/modelos/claude-opus-4-6/)Anthropic | closed | US$ 5.00 · Official pricing | US$ 25.00 · Official pricing | 1,000,000 | [90.5%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [78.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [75.8%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [47%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [DeepSeek V4 Pro](https://meirinho.com.br/en/ia/modelos/deepseek-v4-pro/)DeepSeek | open | US$ 1.32 · Official pricing | US$ 3.96 · Official pricing | 1,048,576 | [90.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [77.6%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [78.6%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [47%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.61% OpenRouter | no data |
| [Qwen3.7 Max](https://meirinho.com.br/en/ia/modelos/qwen3-7-max/)Alibaba | closed | US$ 2.50 · Official pricing | US$ 7.50 · Official pricing | 1,000,000 | [90.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [77.3%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [72%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [55.8%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.01% OpenRouter | no data |
| [GPT-5.4](https://meirinho.com.br/en/ia/modelos/gpt-5-4/)OpenAI | closed | US$ 2.50 · Official pricing | US$ 15.00 · Official pricing | 1,050,000 | [93.3%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [76.9%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [75%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [45.1%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.02% OpenRouter | no data |
| [Kimi K2.6](https://meirinho.com.br/en/ia/modelos/kimi-k2-6/)Moonshot AI | open | US$ 0.95 · Official pricing · The K2 series will be retired by the end of December 2026 | US$ 4.00 · Official pricing | 262,144 | [90.8%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [76.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [74.9%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [34.9%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.04% OpenRouter | no data |
| [Claude Opus 4.5](https://meirinho.com.br/en/ia/modelos/claude-opus-4-5/)Anthropic | closed | US$ 5.00 · Official pricing | US$ 25.00 · Official pricing | 200,000 | [86%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [76.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [76.6%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [45.7%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [Qwen 3.6 Max (Preview)](https://meirinho.com.br/en/ia/modelos/qwen-3-6-max-preview/)Alibaba | undisclosed | official price to be confirmed | no data | no data | [87.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [76.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | [52%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [Gemini 3.1 Pro](https://meirinho.com.br/en/ia/modelos/gemini-3-1-pro/)Google | closed | US$ 2.00 · OpenRouter | US$ 12.00 · OpenRouter | 1,048,576 | [94.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [75.6%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [77%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [73.5%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.05% OpenRouter | no data |
| [Gemini 3 Flash](https://meirinho.com.br/en/ia/modelos/gemini-3-flash/)Google | closed | official price to be confirmed | no data | no data | [89.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [75.4%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | [66.8%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [Claude Sonnet 4.6](https://meirinho.com.br/en/ia/modelos/claude-sonnet-4-6/)Anthropic | closed | US$ 3.00 · Official pricing | US$ 15.00 · Official pricing | 1,000,000 | [87.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [75.2%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [74.8%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [35.5%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [GPT-5.3-Codex](https://meirinho.com.br/en/ia/modelos/gpt-5-3-codex/)OpenAI | closed | US$ 1.75 · Official pricing | US$ 14.00 · Official pricing | 400,000 | no data | [74.8%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [75.3%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | <0.01% OpenRouter | no data |
| [GLM 5.1](https://meirinho.com.br/en/ia/modelos/glm-5-1/)Zhipu AI (Z.ai) | open | US$ 1.40 · Official pricing | US$ 4.40 · Official pricing | 204,800 | [89.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [74.2%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [75.8%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [34%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.01% OpenRouter | 867,145 |
| [Kimi K2.5](https://meirinho.com.br/en/ia/modelos/kimi-k2-5/)Moonshot AI | open | US$ 0.50 (Third-party provider pricing, OpenRouter) · OpenRouter · The K2 series will be retired by the end of December 2026 | US$ 2.50 · OpenRouter | 262,144 | [87.6%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [73.8%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [73.8%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [34.3%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.01% OpenRouter | 393,277 |
| [GPT-5.2](https://meirinho.com.br/en/ia/modelos/gpt-5-2/)OpenAI | closed | US$ 1.75 · Official pricing | US$ 14.00 · Official pricing | 400,000 | [91.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [73.8%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | [37.1%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.01% OpenRouter | no data |
| [GPT-5](https://meirinho.com.br/en/ia/modelos/gpt-5/)OpenAI | closed | US$ 1.25 · Official pricing | US$ 10.00 · Official pricing | 400,000 | [86.2%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [73.6%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [70.7%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [50.1%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | <0.01% OpenRouter | no data |
| [Claude Opus 4.1](https://meirinho.com.br/en/ia/modelos/claude-opus-4-1/)Anthropic | closed | US$ 15.00 Third-party price (OpenRouter) Model retired by the lab · OpenRouter | US$ 75.00 · OpenRouter | 200,000 | [77.3%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [73.3%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | no data | no data | no data |
| [Gemini 3 Pro](https://meirinho.com.br/en/ia/modelos/gemini-3-pro/)Google | closed | official price to be confirmed | no data | no data | [92.6%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [72.9%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | no data | no data | no data |
| [GLM 5](https://meirinho.com.br/en/ia/modelos/glm-5/)Zhipu AI (Z.ai) | open | US$ 1.00 · Official pricing | US$ 3.20 · Official pricing | 204,800 | [87.8%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [72.1%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [76.9%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | 0.02% OpenRouter | 1,370,207 |
| [Claude Sonnet 4.5](https://meirinho.com.br/en/ia/modelos/claude-sonnet-4-5/)Anthropic | closed | US$ 3.00 · Official pricing | US$ 15.00 · Official pricing | 1,000,000 | [82.3%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [71.3%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [74.9%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [30.7%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [Claude Opus 4](https://meirinho.com.br/en/ia/modelos/claude-opus-4/)Anthropic | closed | official price to be confirmed | no data | no data | [76.3%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [70.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | no data | no data | no data |
| [GPT-5.1](https://meirinho.com.br/en/ia/modelos/gpt-5-1/)OpenAI | closed | US$ 1.25 · Official pricing | US$ 10.00 · Official pricing | 400,000 | [87.6%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [68%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [80%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [48%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.02% OpenRouter | no data |
| [GPT-5 Mini](https://meirinho.com.br/en/ia/modelos/gpt-5-mini/)OpenAI | closed | US$ 0.25 · Official pricing | US$ 2.00 · Official pricing | 400,000 | [75%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [64.7%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [72.4%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [21.6%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.04% OpenRouter | no data |
| [o3](https://meirinho.com.br/en/ia/modelos/o3/)OpenAI | closed | US$ 2.00 · Official pricing | US$ 8.00 · Official pricing | 200,000 | [81.8%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [62.3%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | [49.4%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | <0.01% OpenRouter | no data |
| [Claude 3.7 Sonnet](https://meirinho.com.br/en/ia/modelos/claude-3-7-sonnet/)Anthropic | closed | official price to be confirmed | no data | no data | [79.7%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [61%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | no data | no data | no data |
| [Qwen3.6 Plus](https://meirinho.com.br/en/ia/modelos/qwen3-6-plus/)Alibaba | closed | US$ 0.50 · Official pricing | US$ 3.00 · Official pricing | 1,000,000 | [88.4%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [57.9%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | no data | [44.1%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | no data | no data |
| [Gemini 2.5 Pro](https://meirinho.com.br/en/ia/modelos/gemini-2-5-pro/)Google | closed | US$ 1.25 · OpenRouter | US$ 10.00 · OpenRouter | 1,048,576 | [85.3%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [57.6%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [60%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | 0.01% OpenRouter | no data |
| [GPT-4.1](https://meirinho.com.br/en/ia/modelos/gpt-4-1/)OpenAI | closed | US$ 2.00 · Official pricing | US$ 8.00 · Official pricing | 1,047,576 | [66.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | [48.5%](https://epoch.ai/benchmarks/swe-bench-verified) Epoch AI | [52.3%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [31.1%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.02% OpenRouter | no data |
| [Kimi K2.7 Code](https://meirinho.com.br/en/ia/modelos/kimi-k2-7-code/)Moonshot AI | open | US$ 0.95 · Official pricing · The K2 series will be retired by the end of December 2026 | US$ 4.00 · Official pricing | 262,144 | [87.9%](https://epoch.ai/benchmarks/gpqa-diamond) Epoch AI | no data | [77.3%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | [36.5%](https://epoch.ai/benchmarks/simpleqa-verified) Epoch AI | 0.03% OpenRouter | 91,687 |
| [Qwen3 Coder Next](https://meirinho.com.br/en/ia/modelos/qwen3-coder-next/)Alibaba | open | US$ 0.12 · OpenRouter | US$ 0.80 · OpenRouter | 262,144 | no data | no data | [60.7%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | 0.01% OpenRouter | 425,899 |
| [GPT-4o](https://meirinho.com.br/en/ia/modelos/gpt-4o/)OpenAI | closed | US$ 2.50 · Official pricing | US$ 10.00 · Official pricing | 128,000 | no data | no data | [43.2%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | 0.01% OpenRouter | no data |
| [Qwen3 Coder 30B A3B Instruct](https://meirinho.com.br/en/ia/modelos/qwen3-coder-30b-a3b-instruct/)Alibaba | open | US$ 0.15 · OpenRouter | US$ 0.60 · OpenRouter | 262,144 | no data | no data | [46%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | <0.01% OpenRouter | 1,679,625 |
| [Qwen3 Coder Flash](https://meirinho.com.br/en/ia/modelos/qwen3-coder-flash/)Alibaba | undisclosed | US$ 0.30 · Official pricing | US$ 1.50 · Official pricing | 1,000,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [Devstral 2 2512](https://meirinho.com.br/en/ia/modelos/devstral-2512/)Mistral AI | open | US$ 0.40 Third-party price (OpenRouter) Model retired by the lab · OpenRouter | US$ 2.00 · OpenRouter | 262,144 | no data | no data | no data | no data | <0.01% OpenRouter | 6,656 |
| [GPT-5.1-Codex](https://meirinho.com.br/en/ia/modelos/gpt-5-1-codex/)OpenAI | undisclosed | US$ 1.25 · OpenRouter | US$ 10.00 · OpenRouter | 400,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [GPT-5.1-Codex-Mini](https://meirinho.com.br/en/ia/modelos/gpt-5-1-codex-mini/)OpenAI | undisclosed | US$ 0.25 · OpenRouter | US$ 2.00 · OpenRouter | 400,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [GPT-5.2-Codex](https://meirinho.com.br/en/ia/modelos/gpt-5-2-codex/)OpenAI | undisclosed | US$ 1.75 · OpenRouter | US$ 14.00 · OpenRouter | 400,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [Seed-2.0-Code](https://meirinho.com.br/en/ia/modelos/seed-2-0-code/)ByteDance | undisclosed | official price to be confirmed | no data | no data | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [Codestral 2508](https://meirinho.com.br/en/ia/modelos/codestral-2508/)Mistral AI | undisclosed | US$ 0.30 · Official pricing | US$ 0.90 · Official pricing | 256,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [GPT-5.1-Codex-Max](https://meirinho.com.br/en/ia/modelos/gpt-5-1-codex-max/)OpenAI | undisclosed | US$ 1.25 · OpenRouter | US$ 10.00 · OpenRouter | 400,000 | no data | no data | no data | no data | <0.01% OpenRouter | no data |
| [Qwen3-Coder](https://meirinho.com.br/en/ia/modelos/qwen3-coder/)Alibaba | open | US$ 0.30 · OpenRouter | US$ 1.00 · OpenRouter | 262,144 | no data | no data | [48%](https://openrouter.ai/benchmarks/tau2-bench-airline) OpenRouter Benchmarks | no data | no data | 58,791 |
| [Qwen2.5 Coder 32B Instruct](https://meirinho.com.br/en/ia/modelos/qwen-2-5-coder-32b-instruct/)Alibaba | open | US$ 0.66 · OpenRouter | US$ 1.00 · OpenRouter | 32,768 | no data | no data | no data | no data | <0.01% OpenRouter | 547,627 |

## Which model to use for what

This pick follows the data and changes when the data does.

### [Code](https://meirinho.com.br/en/ia/modelos/uso/codigo/)

- Rule: Highest score on SWE-bench Verified[Claude Opus 4.7](https://meirinho.com.br/en/ia/modelos/claude-opus-4-7/) 83.5% Epoch AI
- Rule: Highest open weights score on SWE-bench Verified[GLM-5.2](https://meirinho.com.br/en/ia/modelos/glm-5-2/) 78.7% Epoch AI
- Rule: Cheapest per 1M input tokens among the top 5 on SWE-bench Verified[GLM-5.2](https://meirinho.com.br/en/ia/modelos/glm-5-2/) US$ 1.40 Official pricing

## SWE-bench Verified [?](https://meirinho.com.br/en/ia/modelos/glossario/swe-bench-verified/)

**What it measures:** SWE-bench Verified, on the Epoch AI leaderboard (CC BY 4.0, latest version we checked), is 500 real issues from Python repositories on GitHub. The model has to produce the fix and pass the automated tests. The score is the share of tasks solved.

**When it matters:** This is the coding yardstick this table uses. I think of it as fixing a real bug in the company repo, not writing a function in isolation. Always compare under the same agent setup, because that setup changes the score.

## Compare with

- [DeepSeek V4 Pro vs GPT-6.1 Sol](https://meirinho.com.br/en/ia/modelos/comparar/deepseek-v4-pro-vs-gpt-6-1-sol/)
- [DeepSeek V3 vs GPT-5](https://meirinho.com.br/en/ia/modelos/comparar/deepseek-v3-vs-gpt-5/)
- [DeepSeek V4 Pro vs Qwen3.8 Max](https://meirinho.com.br/en/ia/modelos/comparar/deepseek-v4-pro-vs-qwen3-8-max/)
- [DeepSeek V4 Pro vs Kimi K3.1 Pro](https://meirinho.com.br/en/ia/modelos/comparar/deepseek-v4-pro-vs-kimi-k3-1-pro/)
- [DeepSeek V4 Pro vs GLM-5.3](https://meirinho.com.br/en/ia/modelos/comparar/deepseek-v4-pro-vs-glm-5-3/)

[Text](https://meirinho.com.br/en/ia/modelos/uso/texto/) · [Agents](https://meirinho.com.br/en/ia/modelos/uso/agentes/) · [Image](https://meirinho.com.br/en/ia/modelos/uso/imagem/) · [Video](https://meirinho.com.br/en/ia/modelos/uso/video/) · [Voice](https://meirinho.com.br/en/ia/modelos/uso/voz/) · [Transcription](https://meirinho.com.br/en/ia/modelos/uso/transcricao/)

## Sources

- [Epoch AI](https://epoch.ai/benchmarks), CC BY 4.0, latest version we checked.
- [OpenRouter Benchmarks](https://openrouter.ai/benchmarks), CC BY 4.0, latest version we checked.
- [OpenRouter](https://openrouter.ai/api/v1/models), dados públicos da API; exports de benchmarks e rankings em CC BY 4.0, latest version we checked.
- [Hugging Face Hub](https://huggingface.co/api/models), metadados públicos do Hub; licença de cada modelo no repositório, latest version we checked.

Dates come from the sources: OpenRouter listing or Hugging Face repo creation, which may differ from the official launch. Family and version were grouped by rule from the name.

[#](#)
