AI article
Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM
Community description: Audit of the 65-row Open ASR board on Hugging Face: 8 rows average 7 datasets, not 8. Ranks 1 and 2 swap on a common mean. 45 rows are open PRs.
Dev.to | Nov 7, 2026 | Ward Ed
Automated excerpt
The board's mean_wer is not the same average for every row. 54 rows average 8 datasets. 8 rows, including ranks 2, 3 and 4, have no TED-LIUM score and average 7. Not on November 7, 2026. 54 rows average eight datasets, and eight rows average seven because they have no TED-LIUM score. For all 54 rows that report it, its WER is lower than the row's own mean over the other seven sets.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.