中文
相关论文

相关论文: Mispronunciation detection using self-supervised s…

200 篇论文

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained…

音频与语音处理 · 电气工程与系统科学 2026-04-10 Hashim Ali , Nithin Sai Adupa , Surya Subramani , Hafiz Malik

Self-supervised learning (SSL) has emerged as a promising paradigm for learning flexible speech representations from unlabeled data. By designing pretext tasks that exploit statistical regularities, SSL models can capture useful…

声音 · 计算机科学 2024-01-25 Yusuf Brima , Ulf Krumnack , Simone Pika , Gunther Heidemann

When beginners learn to speak a non-native language, it is difficult for them to judge for themselves whether they are speaking well. Therefore, computer-assisted pronunciation training systems are used to detect learner mispronunciations.…

音频与语音处理 · 电气工程与系统科学 2022-12-12 Kazuki Kawamura , Jun Rekimoto

Self-supervised learning (SSL) models have significantly advanced speech processing tasks, and several benchmarks have been proposed to validate their effectiveness. However, previous benchmarks have primarily focused on single-speaker…

计算与语言 · 计算机科学 2025-05-13 Junyi Peng , Takanori Ashihara , Marc Delcroix , Tsubasa Ochiai , Oldrich Plchot , Shoko Araki , Jan Černocký

In this study, we aim to explore efficient tuning methods for speech self-supervised learning. Recent studies show that self-supervised learning (SSL) can learn powerful representations for different speech tasks. However, fine-tuning…

音频与语音处理 · 电气工程与系统科学 2023-01-31 Zih-Ching Chen , Chin-Lun Fu , Chih-Ying Liu , Shang-Wen Li , Hung-yi Lee

Self-supervised learning (SSL) has recently allowed leveraging large datasets of unlabeled speech signals to reach impressive performance on speech tasks using only small amounts of annotated data. The high number of proposed approaches…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

Self-supervised learning (SSL) has transformed speech processing, yet its reliance on massive pre-training datasets remains a bottleneck. While robustness is often attributed to scale and diversity, the role of the data distribution is less…

声音 · 计算机科学 2026-04-24 Ryan Whetten , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Large-scale pre-trained self-supervised learning (SSL) models have shown remarkable advancements in speech-related tasks. However, the utilization of these models in complex multi-talker scenarios, such as extracting a target speaker in a…

音频与语音处理 · 电气工程与系统科学 2024-02-21 Junyi Peng , Marc Delcroix , Tsubasa Ochiai , Oldrich Plchot , Takanori Ashihara , Shoko Araki , Jan Cernocky

Self-supervised learned (SSL) speech pre-trained models perform well across various speech processing tasks. Distilled versions of SSL models have been developed to match the needs of on-device speech applications. Though having similar…

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

音频与语音处理 · 电气工程与系统科学 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Self-supervised learning (SSL) is a long-standing goal for speech processing, since it utilizes large-scale unlabeled data and avoids extensive human labeling. Recent years witness great successes in applying self-supervised learning in…

计算与语言 · 计算机科学 2021-10-13 Sanyuan Chen , Yu Wu , Chengyi Wang , Zhengyang Chen , Zhuo Chen , Shujie Liu , Jian Wu , Yao Qian , Furu Wei , Jinyu Li , Xiangzhan Yu

Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, and each of these…

计算与语言 · 计算机科学 2023-02-21 A Arunkumar , Vrunda N Sukhadia , S. Umesh

Enhancing explainability in speech self-supervised learning (SSL) is important for developing reliable SSL-based speech processing systems. This study probes how speech SSL models encode speaker-specific information via a large-scale…

音频与语音处理 · 电气工程与系统科学 2026-03-06 Aemon Yat Fei Chiu , Kei Ching Fung , Roger Tsz Yeung Li , Jingyu Li , Tan Lee

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

音频与语音处理 · 电气工程与系统科学 2024-11-08 Subrina Sultana , Donald S. Williamson

Audio and speech self-supervised encoder models are now widely used for a lot of different tasks. Many of these models are often trained on clean segmented speech content such as LibriSpeech. In this paper, we look into how the pretraining…

音频与语音处理 · 电气工程与系统科学 2026-04-13 Valentin Pelloin , Lina Bekkali , Reda Dehak , David Doukhan

Self-Supervised Learning (SSL) has gained traction for its ability to learn rich representations with low labeling costs, applicable across diverse downstream tasks. However, assessing the downstream-task performance remains challenging due…

声音 · 计算机科学 2025-10-07 Takashi Maekaku , Keita Goto , Jinchuan Tian , Yusuke Shinohara , Shinji Watanabe

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

机器学习 · 计算机科学 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

A common approach to the automatic detection of mispronunciation in language learning is to recognize the phonemes produced by a student and compare it to the expected pronunciation of a native speaker. This approach makes two simplifying…

音频与语音处理 · 电气工程与系统科学 2021-02-10 Daniel Korzekwa , Jaime Lorenzo-Trueba , Szymon Zaporowski , Shira Calamaro , Thomas Drugman , Bozena Kostek

In this work, we study the features extracted by English self-supervised learning (SSL) models in cross-lingual contexts and propose a new metric to predict the quality of feature representations. Using automatic speech recognition (ASR) as…

计算与语言 · 计算机科学 2023-11-28 Shuyue Stella Li , Beining Xu , Xiangyu Zhang , Hexin Liu , Wenhan Chao , Leibny Paola Garcia

Self-Supervised Learning (SSL) models have been successfully applied in various deep learning-based speech tasks, particularly those with a limited amount of data. However, the quality of SSL representations depends highly on the…

计算与语言 · 计算机科学 2022-04-20 Dan Berrebbi , Jiatong Shi , Brian Yan , Osbel Lopez-Francisco , Jonathan D. Amith , Shinji Watanabe