中文
相关论文

相关论文: Mind the Shift: Using Delta SSL Embeddings to Enha…

200 篇论文

Self-supervised learning (SSL) models offer powerful representations for sound event detection (SED), yet their synergistic potential remains underexplored. This study systematically evaluates state-of-the-art SSL models to guide optimal…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Hanfang Cui , Longfei Song , Li Li , Dongxing Xu , Yanhua Long

Recent years have witnessed great strides in self-supervised learning (SSL) on the speech processing. The SSL model is normally pre-trained on a great variety of unlabelled data and a large model size is preferred to increase the modeling…

音频与语音处理 · 电气工程与系统科学 2025-05-08 Yujin Wang , Changli Tang , Ziyang Ma , Zhisheng Zheng , Xie Chen , Wei-Qiang Zhang

While Speech Foundation Models (SFMs) excel in various speech tasks, their performance for low-resource tasks such as child Automatic Speech Recognition (ASR) is hampered by limited pretraining data. To address this, we explore different…

计算与语言 · 计算机科学 2025-01-16 Natarajan Balaji Shankar , Zilai Wang , Eray Eren , Abeer Alwan

Self-supervised learning (SSL) is a powerful tool that allows learning of underlying representations from unlabeled data. Transformer based models such as wav2vec 2.0 and HuBERT are leading the field in the speech domain. Generally these…

计算与语言 · 计算机科学 2022-02-08 Bethan Thomas , Samuel Kessler , Salah Karout

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

音频与语音处理 · 电气工程与系统科学 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Automatic Speech Recognition (ASR) systems have progressed significantly in their performance on adult speech data; however, transcribing child speech remains challenging due to the acoustic differences in the characteristics of child and…

计算与语言 · 计算机科学 2023-11-10 Andrei Barcovschi , Rishabh Jain , Peter Corcoran

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain…

音频与语音处理 · 电气工程与系统科学 2024-07-22 Shujie Hu , Xurong Xie , Mengzhe Geng , Zengrui Jin , Jiajun Deng , Guinan Li , Yi Wang , Mingyu Cui , Tianzi Wang , Helen Meng , Xunying Liu

Self-supervised learning (SSL) has transformed speech processing, yet its reliance on massive pre-training datasets remains a bottleneck. While robustness is often attributed to scale and diversity, the role of the data distribution is less…

声音 · 计算机科学 2026-04-24 Ryan Whetten , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Speech foundation models (SFMs) have achieved state-of-the-art results for various speech tasks in supervised (e.g. Whisper) or self-supervised systems (e.g. WavLM). However, the performance of SFMs for child ASR has not been systematically…

音频与语音处理 · 电气工程与系统科学 2024-06-18 Ruchao Fan , Natarajan Balaji Shankar , Abeer Alwan

In recent years, self-supervised learning (SSL) models have made significant progress in audio deepfake detection (ADD) tasks. However, existing SSL models mainly rely on large-scale real speech for pre-training and lack the learning of…

声音 · 计算机科学 2025-09-05 Yunqi Hao , Yihao Chen , Minqiang Xu , Jianbo Zhan , Liang He , Lei Fang , Sian Fang , Lin Liu

Self-supervised learned models have been found to be very effective for certain speech tasks such as automatic speech recognition, speaker identification, keyword spotting and others. While the features are undeniably useful in speech…

音频与语音处理 · 电气工程与系统科学 2024-03-05 Ravi Shankar , Ke Tan , Buye Xu , Anurag Kumar

Automatic speech recognition (ASR) has progressed significantly in recent years due to the emergence of large-scale datasets and the self-supervised learning (SSL) paradigm. However, as its counterpart problem in the singing domain, the…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Longshen Ou , Xiangming Gu , Ye Wang

Self-supervised learning (SSL) speech models such as wav2vec and HuBERT have demonstrated state-of-the-art performance on automatic speech recognition (ASR) and proved to be extremely useful in low label-resource settings. However, the…

声音 · 计算机科学 2023-10-05 Weiwei Lin , Chenhang He , Man-Wai Mak , Youzhi Tu

Self-supervised learning (SSL) methods such as WavLM have shown promising speech separation (SS) results in small-scale simulation-based experiments. In this work, we extend the exploration of the SSL-based SS by massively scaling up both…

音频与语音处理 · 电气工程与系统科学 2022-11-29 Zhuo Chen , Naoyuki Kanda , Jian Wu , Yu Wu , Xiaofei Wang , Takuya Yoshioka , Jinyu Li , Sunit Sivasankaran , Sefik Emre Eskimez

Speech recognition models often obtain degraded performance when tested on speech with unseen accents. Domain-adversarial training (DAT) and multi-task learning (MTL) are two common approaches for building accent-robust ASR models. ASR…

音频与语音处理 · 电气工程与系统科学 2021-10-11 Jialu Li , Vimal Manohar , Pooja Chitkara , Andros Tjandra , Michael Picheny , Frank Zhang , Xiaohui Zhang , Yatharth Saraf

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Integrating front-end speech enhancement (SE) models with self-supervised learning (SSL)-based speech models is effective for downstream tasks in noisy conditions. SE models are commonly fine-tuned using SSL representations with mean…

计算与语言 · 计算机科学 2026-01-30 Amit Meghanani , Thomas Hain

Self-supervised learning representations (SSLR) have resulted in robust features for downstream tasks in many fields. Recently, several SSLRs have shown promising results on automatic speech recognition (ASR) benchmark corpora. However,…

声音 · 计算机科学 2022-07-01 Szu-Jui Chen , Jiamin Xie , John H. L. Hansen

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Alexandre Ducorroy , Rachid Riad

Automatic speech recognition (ASR) has shown rapid advances in recent years but still degrades significantly in far-field and noisy environments. The recent development of self-supervised learning (SSL) technology can improve the ASR…

声音 · 计算机科学 2022-05-05 Changfeng Gao , Gaofeng Cheng , Pengyuan Zhang