# SWE-bench Verified: what it is

- **URL canônica:** https://meirinho.com.br/en/ia/modelos/glossario/swe-bench-verified/
- **Idioma:** en
- **Atualizado:** 2026-11-17

---
Glossary

# SWE-bench Verified

SWE-bench Verified, on the Epoch AI leaderboard (CC BY 4.0, latest version we checked), is 500 real issues from Python repositories on GitHub. The model has to produce the fix and pass the automated tests. The score is the share of tasks solved.

## What it measures

SWE-bench Verified, on the Epoch AI leaderboard (CC BY 4.0, latest version we checked), is 500 real issues from Python repositories on GitHub. The model has to produce the fix and pass the automated tests. The score is the share of tasks solved.

## When it matters

This is the coding yardstick this table uses. I think of it as fixing a real bug in the company repo, not writing a function in isolation. Always compare under the same agent setup, because that setup changes the score.

## How to read it

The score is the share of issues solved, with tests passing, on the Epoch AI leaderboard, in the latest version we checked. This test has 500 issues, so 1 percentage point is 5 issues. Always compare under the same agent setup.

## Who leads

1. [Claude Opus 4.7](https://meirinho.com.br/en/ia/modelos/claude-opus-4-7/) Anthropic****83.5%** Epoch AI
2. [GPT-5.5](https://meirinho.com.br/en/ia/modelos/gpt-5-5/) OpenAI****80.6%** Epoch AI
3. [Gemini 3.5 Flash](https://meirinho.com.br/en/ia/modelos/gemini-3-5-flash/) Google****79.3%** Epoch AI
4. [GLM-5.2](https://meirinho.com.br/en/ia/modelos/glm-5-2/) Zhipu AI (Z.ai)****78.7%** Epoch AI
5. [Claude Opus 4.6](https://meirinho.com.br/en/ia/modelos/claude-opus-4-6/) Anthropic****78.7%** Epoch AI
6. [DeepSeek V4 Pro](https://meirinho.com.br/en/ia/modelos/deepseek-v4-pro/) DeepSeek****77.6%** Epoch AI
7. [Qwen3.7 Max](https://meirinho.com.br/en/ia/modelos/qwen3-7-max/) Alibaba****77.3%** Epoch AI
8. [GPT-5.4](https://meirinho.com.br/en/ia/modelos/gpt-5-4/) OpenAI****76.9%** Epoch AI
9. [Kimi K2.6](https://meirinho.com.br/en/ia/modelos/kimi-k2-6/) Moonshot AI****76.7%** Epoch AI
10. [Claude Opus 4.5](https://meirinho.com.br/en/ia/modelos/claude-opus-4-5/) Anthropic****76.7%** Epoch AI

Source: [Epoch AI](https://epoch.ai/benchmarks/swe-bench-verified), latest version we checked.

## Where it appears

[Code](https://meirinho.com.br/en/ia/modelos/uso/codigo/)

## Glossary

- [GPQA Diamond](https://meirinho.com.br/en/ia/modelos/glossario/gpqa-diamond/)
- [GPQA Diamond (OpenRouter)](https://meirinho.com.br/en/ia/modelos/glossario/gpqa-diamond-openrouter/)
- [OTIS Mock AIME](https://meirinho.com.br/en/ia/modelos/glossario/otis-mock-aime/)
- [FrontierMath (tiers 1 to 3)](https://meirinho.com.br/en/ia/modelos/glossario/frontiermath/)
- [SimpleQA Verified](https://meirinho.com.br/en/ia/modelos/glossario/simpleqa-verified/)
- [τ-bench Verified (airline)](https://meirinho.com.br/en/ia/modelos/glossario/tau-bench/)
- [Price per token](https://meirinho.com.br/en/ia/modelos/glossario/preco-por-token/)
- [Context window](https://meirinho.com.br/en/ia/modelos/glossario/janela-de-contexto/)
- [Open weights](https://meirinho.com.br/en/ia/modelos/glossario/pesos-abertos/)
- [OpenRouter usage](https://meirinho.com.br/en/ia/modelos/glossario/uso-no-openrouter/)
- [Hugging Face downloads](https://meirinho.com.br/en/ia/modelos/glossario/downloads-hugging-face/)

[#](#)
