English
Related papers

Related papers: Self-Supervised Speech Quality Assessment (S3QA): …

200 papers

Objective speech quality models aim to predict human-perceived speech quality using automated methods. However, cross-lingual generalization remains a major challenge, as Mean Opinion Scores (MOS) vary across languages due to linguistic,…

Computation and Language · Computer Science 2025-02-19 Wafaa Wardah , Tuğçe Melike Koçak Büyüktaş , Kirill Shchegelskiy , Sebastian Möller , Robert P. Spang

Developers of text-to-speech synthesizers (TTS) often make use of human raters to assess the quality of synthesized speech. We demonstrate that we can model human raters' mean opinion scores (MOS) of synthesized speech using a deep…

Computation and Language · Computer Science 2016-11-29 Brian Patton , Yannis Agiomyrgiannakis , Michael Terry , Kevin Wilson , Rif A. Saurous , D. Sculley

Spoken Question-Answering (SQA) is a core capability for useful and interactive artificial intelligence systems. Recently, several speech-language models (SpeechLMs) have been released with a specific focus on improving their SQA…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-27 Vishaal Udandarao , Zhiyun Lu , Xuankai Chang , Yongqiang Wang , Violet Z. Yao , Albin Madapally Jose , Fartash Faghri , Josh Gardner , Chung-Cheng Chiu

Noise robustness remains a critical challenge for deploying neural speech codecs in real-world acoustic scenarios where background noise is often inevitable. A key observation we make is that even slight input noise perturbations can cause…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-14 Rui-Chen Zheng , Yang Ai , Hui-Peng Du , Li-Rong Dai

With the advances in speech communication systems such as online conferencing applications, we can seamlessly work with people regardless of where they are. However, during online meetings, speech quality can be significantly affected by…

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-08 Subrina Sultana , Donald S. Williamson

Predicting audio quality in voice synthesis and conversion systems is a critical yet challenging task, especially when traditional methods like Mean Opinion Scores (MOS) are cumbersome to collect at scale. This paper addresses the gap in…

Sound · Computer Science 2023-12-27 Aditya Ravuri , Erica Cooper , Junichi Yamagishi

In online conferencing applications, estimating the perceived quality of an audio signal is crucial to ensure high quality of experience for the end user. The most reliable way to assess the quality of a speech signal is through human…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-24 Bastiaan Tamm , Rik Vandenberghe , Hugo Van hamme

This paper proposes an approach to improve Non-Intrusive speech quality assessment(NI-SQA) based on the residuals between impaired speech and enhanced speech. The difficulty in our task is particularly lack of information, for which the…

Sound · Computer Science 2022-03-23 Zhe Ye , Jiahao Chen , Diqun Yan

The objective speech quality assessment is usually conducted by comparing received speech signal with its clean reference, while human beings are capable of evaluating the speech quality without any reference, such as in the mean opinion…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Meng Yu , Chunlei Zhang , Yong Xu , Shixiong Zhang , Dong Yu

While supervised quality predictors for synthesized speech have demonstrated strong correlations with human ratings, their requirement for in-domain labeled training data hinders their generalization ability to new domains. Unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Erica Cooper , Takuma Okamoto , Yamato Ohtani , Tomoki Toda , Hisashi Kawai

Automatic speech quality assessment aims to quantify subjective human perception of speech through computational models to reduce the need for labor-consuming manual evaluations. While models based on deep learning have achieved progress in…

Sound · Computer Science 2025-04-30 Zhicheng Lian , Lizhi Wang , Hua Huang

Discrete audio tokenizers are fundamental to empowering large language models with native audio processing and generation capabilities. Despite recent progress, existing approaches often rely on pretrained encoders, semantic distillation,…

The common standard for quality evaluation of automatic speech recognition (ASR) systems is reference-based metrics such as the Word Error Rate (WER), computed using manual ground-truth transcriptions that are time-consuming and expensive…

Computation and Language · Computer Science 2023-06-26 Kamer Ali Yuksel , Thiago Ferreira , Ahmet Gunduz , Mohamed Al-Badrashiny , Golara Javadi

Improving subjective sound quality of enhanced signals is one of the most important missions in speech enhancement. For evaluating the subjective quality, several methods related to perceptually-motivated objective sound quality assessment…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Masaki Kawanaka , Yuma Koizumi , Ryoichi Miyazaki , Kohei Yatabe

Suicide remains a public health challenge, necessitating improved detection methods to facilitate timely intervention and treatment. This systematic review evaluates the role of Artificial Intelligence (AI) and Machine Learning (ML) in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Ambre Marie , Marine Garnier , Thomas Bertin , Laura Machart , Guillaume Dardenne , Gwenolé Quellec , Sofian Berrouiguet

We present the third edition of the VoiceMOS Challenge, a scientific initiative designed to advance research into automatic prediction of human speech ratings. There were three tracks. The first track was on predicting the quality of…

The performances of the automatic speaker verification (ASV) systems degrade due to the reduction in the amount of speech used for enrollment and verification. Combining multiple systems based on different features and classifiers…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Arnab Poddar , Md Sahidullah , Goutam Saha

Research in modeling subjective metrics for quality assessment has led to the development of no-reference speech models that directly operate on utterance waveforms to predict the Mean Opinion Score (MOS). These models often rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-29 Imran E Kibria , Donald S. Williamson

In this paper, we propose StableQuant, a novel adaptive post-training quantization (PTQ) algorithm for widely used speech foundation models (SFMs). While PTQ has been successfully employed for compressing large language models (LLMs) due to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-22 Yeona Hong , Hyewon Han , Woo-jin Chung , Hong-Goo Kang