埃及和尼日利亚英语加入Open ASR Leaderboard
Hugging Face宣布与Liva AI合作,将埃及和尼日利亚英语口音的私有会话语音数据集加入Open ASR Leaderboard。两个数据集分别包含1.34小时和1.55小时的自然会话语音,转写文本带标点和大小写,并保留不流畅表达。榜单将按美国与非美国,以及Kachru内圈与外圈和扩展圈分类报告口音情况。
Hugging Face表示,新增私有数据旨在扩大ASR评测中的口音代表性,并通过减少基准作弊来提升评测可信度。新的口音分类也将更细致地呈现榜单的覆盖范围。
A few months ago, we added private data to the Open ASR Leaderboard: 11 splits from Appen and DataOceanAI covering scripted and conversational speech from five accents (blog). The community response was great, with many highlighting the importance of held-out sets for trustworthy evaluations. Since then, we added one more private split for Indian-accented English with Voice Arena (blog).
We’re excited to announce a new collaboration with Liva AI to add even more private data with two new accents: Egyptian 🇪🇬 and Nigerian 🇳🇬.
| Dataset | Accent | Duration [h] | Style | Transcription |
|---|---|---|---|---|
| Liva AI Conversational EG | Egyptian | 1.34 | Conversational, spontaneous | Punctuated, cased, with disfluencies. |
| Liva AI Conversational NG | Nigerian | 1.55 | Conversational, spontaneous | Punctuated, cased, with disfluencies. |
This is part of our continued effort to improve representation in ASR evals (more accents and more languages) and to improve trust (new private data to minimize benchmaxxing, and new data providers). We’re excited to see the community continuing to push ASR performance for the world 🤗