τ-bench Verified (airline)

What it measures

τ-bench Verified (airline), on the OpenRouter Benchmarks leaderboard (CC BY 4.0, latest version we checked), simulates an airline support agent that uses systems and must follow company policy until the end of the conversation. The score is the share of tasks completed within the rules.

When it matters

It matters for agents that run tasks with tools. It shows whether the model follows policy across several steps, like an assistant that looks up an internal rule and finishes the request without inventing an exception.

How to read it

The score is the share of conversations in which the agent finished the task within the rules, on the OpenRouter Benchmarks leaderboard, in the latest version we checked. In real support, breaking a policy halfway through is costly.