创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

苹果提出轻量语码转换检测方法

AI 总结

苹果机器学习研究团队发表论文,提出一种直接从语音中检测语码转换(同一句话内交替使用多种语言)的轻量方法,无需先做多语言转写。该方法利用预训练语音编码器中逐帧的语言信息,先用单语录音找出对语言敏感的表征维度,再聚合这些维度的帧级激活形成判断。作者称,在 CS-FLEURS 的 14 个语言对上调校决策规则后,Whisper-small 编码器平均 F1 达 0.798,高于 CNN 的 0.776 和用于单语语种识别的 HuBERT 线性基线的 0.751。

深度见解

作者认为,预训练语音编码器已蕴含识别语码转换语句所需的信息,这一方法可作为轻量工具,帮助构建更具代表性的多语种语料。

research area Methods and Algorithms, research area Speech and Natural Language Processing

content type paperpublished October 2026

Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models

AuthorsJie Chi, Zakaria Aldeneh, Masha Fedzechkina, Maureen de Seyssel, Natalie Schluter

View publication

Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding relevant utterances in large speech collections so that they can be included in training data. One way to find such utterances is to transcribe the speech and detect language alternation in the text, but this depends on obtaining accurate multilingual transcriptions. We propose a lightweight method that detects CS directly from speech. It uses frame-level language information in pretrained speech encoders to determine whether both languages are present within an utterance. Specifically, we identify language-selective hidden-state dimensions using monolingual recordings and aggregate their frame-level activations into a CS prediction. With a small CS set used to tune a decision rule, we show that the Whisper-small encoder achieves a mean F1 of 0.798 across 14 language pairs in CS-FLEURS, compared with 0.776 for a CNN and 0.751 for a HuBERT linear baseline trained for monolingual language identification. Our findings suggest that pretrained speech encoders already encode the information needed to identify CS utterances, and they provide a lightweight tool for building more representative multilingual corpora.

#Apple#Apple Machine Learning Research#Whisper-small#HuBERT#CS-FLEURS

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。