Hugging Face Open ASR Leaderboard

Headlines · 1

1. 3d
   Baseten Reports 7x Throughput Boost for Qwen3-ASR Batch Transcription

   Baseten reports that it optimized a Qwen3-ASR 1.7B deployment on a single NVIDIA RTX PRO 6000 using native audio decoding, FP8 KV-cache quantization, and fewer host-to-device synchronizations. At high concurrency, the optimized stack processed up to 7 times more audio per second than out-of-the-box vLLM. Baseten also reports sustaining more than 3,000 times real time on hour-long files, at an estimated cost of about $0.0013 per audio hour, with no meaningful change in word error rate. It describes Qwen3-ASR 1.7B as the top-ranking open-source model on Hugging Face's Open ASR Leaderboard, with a 5.4% average word error rate. These deployment performance and cost figures are vendor-reported.

   Baseten Blog · 🔥 0

Experience and discussion from the community

Share my Hugging Face Open ASR Leaderboard experienceAsk about Hugging Face Open ASR Leaderboard