English
Related papers

Related papers: Uncertainty as a Predictor: Leveraging Self-Superv…

200 papers

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Audio-visual speech recognition (AVSR) incorporates auditory and visual modalities to improve recognition accuracy, particularly in noisy environments where audio-only speech systems are insufficient. While previous research has largely…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Sungnyun Kim , Sungwoo Cho , Sangmin Bae , Kangwook Jang , Se-Young Yun

In speech generation tasks, human subjective ratings, usually referred to as the opinion score, are considered the "gold standard" for speech quality evaluation, with the mean opinion score (MOS) serving as the primary evaluation metric.…

Sound · Computer Science 2024-06-21 Yuxun Tang , Jiatong Shi , Yuning Wu , Qin Jin

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-10 Hashim Ali , Nithin Sai Adupa , Surya Subramani , Hafiz Malik

Human judgments obtained through Mean Opinion Scores (MOS) are the most reliable way to assess the quality of speech signals. However, several recent attempts to automatically estimate MOS using deep learning approaches lack robustness and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Pranay Manocha , Anurag Kumar

Contrastive self-supervised learning (CSL) for speaker verification (SV) has drawn increasing interest recently due to its ability to exploit unlabeled data. Performing data augmentation on raw waveforms, such as adding noise or…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-12 Chong-Xin Gan , Man-Wai Mak , Weiwei Lin , Jen-Tzung Chien

Speech quality assessment typically requires evaluating audio from multiple aspects, such as mean opinion score (MOS) and speaker similarity (SIM) \etc., which can be challenging to cover using one small model designed for a single task. In…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-02 Siyin Wang , Wenyi Yu , Yudong Yang , Changli Tang , Yixuan Li , Jimin Zhuang , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Guangzhi Sun , Lu Lu , Yuxuan Wang , Chao Zhang

Several studies have proposed deep-learning-based models to predict the mean opinion score (MOS) of synthesized speech, showing the possibility of replacing human raters. However, inter- and intra-rater variability in MOSs makes it hard to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-03 Yeunju Choi , Youngmoon Jung , Hoirin Kim

Mean opinion score (MOS) is a typical subjective evaluation metric for speech synthesis systems. Since collecting MOS is time-consuming, it would be desirable if there are accurate MOS prediction models for automatic evaluation. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee

The deep learning community has witnessed an exponentially growing interest in self-supervised learning (SSL). However, it still remains unexplored how to build a framework for learning useful representations of raw music waveforms in a…

The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary evaluation of the challenge submissions was done through…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Rohan Kumar Das , Tomi Kinnunen , Wen-Chin Huang , Zhenhua Ling , Junichi Yamagishi , Yi Zhao , Xiaohai Tian , Tomoki Toda

Keyword Spotting (KWS) models are becoming increasingly integrated into various systems, e.g. voice assistants. To achieve satisfactory performance, these models typically rely on a large amount of labelled data, limiting their applications…

Sound · Computer Science 2023-05-25 Holger Severin Bovbjerg , Zheng-Hua Tan

Voice conversion (VC) systems are widely used for several applications, from speaker anonymisation to personalised speech synthesis. Supervised approaches learn a mapping between different speakers using parallel data, which is expensive to…

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

This paper introduces the ZevoMOS entry to the main track of the VoiceMOS Challenge 2022. The ZevoMOS submission is based on a two-step finetuning of pretrained self-supervised learning (SSL) speech models. The first step uses a task of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Adriana Stan

Recently proposed self-supervised learning approaches have been successful for pre-training speech representation models. The utility of these learned representations has been observed empirically, but not much has been studied about the…

Computation and Language · Computer Science 2022-12-06 Ankita Pasad , Ju-Chieh Chou , Karen Livescu

Training of multi-speaker text-to-speech (TTS) systems relies on curated datasets based on high-quality recordings or audiobooks. Such datasets often lack speaker diversity and are expensive to collect. As an alternative, recent studies…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-13 Sewade Ogun , Vincent Colotte , Emmanuel Vincent

Self-supervised learning (SSL) approaches such as wav2vec 2.0 and HuBERT models have shown promising results in various downstream tasks in the speech community. In particular, speech representations learned by SSL models have been shown to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Eesung Kim , Jae-Jin Jeon , Hyeji Seo , Hoon Kim

In this report, we describe our submitted system for track 2 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). We fuse a variety of good-performing models ranging from supervised models to self-supervised learning(SSL)…

Sound · Computer Science 2022-09-26 Gang Liu , Tianyan Zhou , Yong Zhao , Yu Wu , Zhuo Chen , Yao Qian , Jian Wu

Representation learning from unlabeled data has been of major interest in artificial intelligence research. While self-supervised speech representation learning has been popular in the speech research community, very few works have…