English
Related papers

Related papers: A Comparative Study of Self-Supervised Speech Repr…

200 papers

Recently proposed two-pass direct speech-to-speech translation (S2ST) models decompose the task into speech-to-text translation (S2TT) and text-to-speech (TTS) within an end-to-end model, yielding promising results. However, the training of…

Computation and Language · Computer Science 2024-06-12 Qingkai Fang , Shaolei Zhang , Zhengrui Ma , Min Zhang , Yang Feng

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Multilingual automatic speech recognition (ASR) systems have garnered attention for their potential to extend language coverage globally. While self-supervised learning (SSL) models, like MMS, have demonstrated their effectiveness in…

Computation and Language · Computer Science 2024-04-30 Hongfei Xue , Qijie Shao , Kaixun Huang , Peikun Chen , Jie Liu , Lei Xie

Self-supervised learning (SSL) has helped extend speech technologies to more languages by reducing the need for labeled data. However, models are still far from supporting the world's 7000+ languages. We propose XEUS, a Cross-lingual…

Computation and Language · Computer Science 2024-07-03 William Chen , Wangyou Zhang , Yifan Peng , Xinjian Li , Jinchuan Tian , Jiatong Shi , Xuankai Chang , Soumi Maiti , Karen Livescu , Shinji Watanabe

Depression, a prevalent mental health disorder impacting millions globally, demands reliable assessment systems. Unlike previous studies that focus solely on either detecting depression or predicting its severity, our work identifies…

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Muhammad Ali , Sayed Hashim

Self-supervised learning in speech involves training a speech representation network on a large-scale unannotated speech corpus, and then applying the learned representations to downstream tasks. Since the majority of the downstream tasks…

Self-supervised learning (SSL) has been dramatically successful not only in monolingual but also in cross-lingual settings. However, since the two settings have been studied individually in general, there has been little research focusing…

Computation and Language · Computer Science 2023-05-10 Takanori Ashihara , Takafumi Moriya , Kohei Matsuura , Tomohiro Tanaka

Modern speech enhancement (SE) networks typically implement noise suppression through time-frequency masking, latent representation masking, or discriminative signal prediction. In contrast, some recent works explore SE via generative…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Bryce Irvin , Marko Stamenovic , Mikolaj Kegler , Li-Chia Yang

Although high-fidelity speech can be obtained for intralingual speech synthesis, cross-lingual text-to-speech (CTTS) is still far from satisfactory as it is difficult to accurately retain the speaker timbres(i.e. speaker similarity) and…

Sound · Computer Science 2023-06-27 Sen Liu , Yiwei Guo , Chenpeng Du , Xie Chen , Kai Yu

Despite advances in deep learning, current state-of-the-art speech emotion recognition (SER) systems still have poor performance due to a lack of speech emotion datasets. This paper proposes augmenting SER systems with synthetic emotional…

Sound · Computer Science 2023-01-11 Abdullah Shahid , Siddique Latif , Junaid Qadir

Self-supervised learning (SSL) models have achieved impressive results across many speech tasks, yet child automatic speech recognition (ASR) remains challenging due to limited data and pretraining domain mismatch. Fine-tuning SSL models on…

Computation and Language · Computer Science 2026-01-29 Zilai Wang , Natarajan Balaji Shankar , Kaiyuan Zhang , Zihan Wang , Abeer Alwan

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Self-Supervised Learning (SSL) from speech data has produced models that have achieved remarkable performance in many tasks, and that are known to implicitly represent many aspects of information latently present in speech signals. However,…

Computation and Language · Computer Science 2022-10-27 Guan-Ting Lin , Chi-Luen Feng , Wei-Ping Huang , Yuan Tseng , Tzu-Han Lin , Chen-An Li , Hung-yi Lee , Nigel G. Ward

Self-supervised speech models have grown fast during the past few years and have proven feasible for use in various downstream tasks. Some recent work has started to look at the characteristics of these models, yet many concerns have not…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-13 Yuanchao Li , Yumnah Mohamied , Peter Bell , Catherine Lai

Self-Supervised Learning (SSL) has demonstrated strong performance in speech processing, particularly in automatic speech recognition. In this paper, we explore an SSL pretraining framework that leverages masked language modeling with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Aleksandr Kutsakov , Alexandr Maximenko , Georgii Gospodinov , Pavel Bogomolov , Fyodor Minkin

Self-supervised learning (SSL) has driven impressive advances in speech processing by adopting time-domain prediction objectives, while audio representation learning frameworks operate on time-frequency spectrograms. Models optimized for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-09 Ameenudeen P E , Charumathi Narayanan , Sriram Ganapathy

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Recent advances in Text-To-Speech (TTS) technology have enabled synthetic speech to mimic human voices with remarkable realism, raising significant security concerns. This underscores the need for traceable TTS models-systems capable of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Yuxiang Zhao , Yunchong Xiao , Yushen Chen , Zhikang Niu , Shuai Wang , Kai Yu , Xie Chen

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli