How to read benchmarks · Guide

Transcription

For transcription, what decides in my use is the word error on audio in Brazilian Portuguese, together with speed, price per thousand minutes and diarization. LibriSpeech WER, already saturated and in read English, does not serve that choice.

The Hugging Face Open ASR Leaderboard exists, but the figures from that board were not collected in this pass.

In a one-off citation from Artificial Analysis, in the latest version we checked, Alibaba's Fun-Realtime-ASR-preview shows an AA-WER of 1.7%, at US$2.82 per thousand minutes. Source: Artificial Analysis (artificialanalysis.ai). The metric weights AgentTalk at 50%, VoxPopuli at 25% and Earnings22 at 25%, a mostly English mix, and the "preview" label itself can change. For a meeting, an interview or support in pt-BR, a test on your own audio still comes ahead of that cut.

Open source board

Transcription has no number board. Anything from Artificial Analysis stays as a citation in the text.