English
Related papers

Related papers: Rethinking Mean Opinion Scores in Speech Quality A…

200 papers

Research in modeling subjective metrics for quality assessment has led to the development of no-reference speech models that directly operate on utterance waveforms to predict the Mean Opinion Score (MOS). These models often rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-29 Imran E Kibria , Donald S. Williamson

Developers of text-to-speech synthesizers (TTS) often make use of human raters to assess the quality of synthesized speech. We demonstrate that we can model human raters' mean opinion scores (MOS) of synthesized speech using a deep…

Computation and Language · Computer Science 2016-11-29 Brian Patton , Yannis Agiomyrgiannakis , Michael Terry , Kevin Wilson , Rif A. Saurous , D. Sculley

Speech quality assessment (SQA) is often used to learn a mapping from a high-dimensional input space to a scalar that represents the mean opinion score (MOS) of the perceptual speech quality. Learning such a mapping is challenging for many…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-17 Junyi Fan , Donald Williamson

Mean Opinion Score (MOS) is a popular measure for evaluating synthesized speech. However, the scores obtained in MOS tests are heavily dependent upon many contextual factors. One such factor is the overall range of quality of the samples…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Erica Cooper , Junichi Yamagishi

The acoustic environment can degrade speech quality during communication (e.g., video call, remote presentation, outside voice recording), and its impact is often unknown. Objective metrics for speech quality have proven challenging to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-30 Karl El Hajal , Milos Cernak , Pablo Mainar

Speech quality assessment has been a critical component in many voice communication related applications such as telephony and online conferencing. Traditional intrusive speech quality assessment requires the clean reference of the degraded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Yuchen Liu , Li-Chia Yang , Alex Pawlicki , Marko Stamenovic

There has been significant research effort developing neural-network-based predictors of SQ in recent years. While a primary objective has been to develop non-intrusive, i.e.~reference-free, metrics to assess the performance of SE systems,…

Sound · Computer Science 2025-08-05 George Close , Kris Hong , Thomas Hain , Stefan Goetze

Automatic subjective speech quality assessment (SSQA) traditionally estimates speech quality on an utterance or system level. While this resolution was adequate for older transmission or synthesis systems that produced speech signals of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Michael Kuhlmann , Tobias Cord-Landwehr , Reinhold Haeb-Umbach

Deep noise suppressors (DNS) have become an attractive solution to remove background noise, reverberation, and distortions from speech and are widely used in telephony/voice applications. They are also occasionally prone to introducing…

Sound · Computer Science 2022-04-15 Abu Zaher Md Faridee , Hannes Gamper

Automatic speech quality assessment plays a crucial role in the development of speech synthesis systems, but existing models exhibit significant performance variations across different granularity levels of prediction tasks. This paper…

Sound · Computer Science 2025-07-09 Xintong Hu , Yixuan Chen , Rui Yang , Wenxiang Guo , Changhao Pan

Automatic Mean Opinion Score (MOS) prediction is employed to evaluate the quality of synthetic speech. This study extends the application of predicted MOS to the task of Fake Audio Detection (FAD), as we expect that MOS can be used to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Wangjin Zhou , Zhengdong Yang , Chenhui Chu , Sheng Li , Raj Dabre , Yi Zhao , Tatsuya Kawahara

Traditional image quality assessment (IQA) methods rely on mean opinion scores (MOS), which are resource-intensive to collect and fail to provide interpretable, localized feedback on specific image distortions. We overcome these limitations…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Fadeel Sher Khan , Long N. Le , Abhinau K. Venkataramanan , Seok-Jun Lee , Hamid R. Sheikh

While deep learning has made impressive progress in speech synthesis and voice conversion, the assessment of the synthesized speech is still carried out by human participants. Several recent papers have proposed deep-learning-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-10 Yeunju Choi , Youngmoon Jung , Hoirin Kim

Objective speech quality assessment is central to telephony, VoIP, and streaming systems, where large volumes of degraded audio must be monitored and optimized at scale. Classical metrics such as PESQ and POLQA approximate human mean…

Sound · Computer Science 2025-12-10 Mahathir Monjur , Shahriar Nirjon

In this study, we propose a cross-domain multi-objective speech assessment model called MOSA-Net, which can estimate multiple speech assessment metrics simultaneously. Experimental results show that MOSA-Net can improve the linear…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-20 Ryandhimas E. Zezario , Szu-Wei Fu , Fei Chen , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

Speech quality assessment (SQA) aims to predict the perceived quality of speech signals under a wide range of distortions. It is inherently connected to speech enhancement (SE), which seeks to improve speech quality by removing unwanted…

Sound · Computer Science 2025-08-25 Wei Wang , Wangyou Zhang , Chenda Li , Jiatong Shi , Shinji Watanabe , Yanmin Qian

In this paper, we propose a highly efficient method to estimate an image's mean opinion score (MOS) from a single opinion score (SOS). Assuming that each SOS is the observed sample of a normal distribution and the MOS is its unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Lei Wang , Desen Yuan

Although recent neural text-to-speech (TTS) systems have achieved high-quality speech synthesis, there are cases where a TTS system generates low-quality speech, mainly caused by limited training data or information loss during knowledge…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Yeunju Choi , Youngmoon Jung , Youngjoo Suh , Hoirin Kim

Automatic speech quality assessment has become increasingly important as modern speech generation systems continue to advance, while human listening tests remain costly, time-consuming, and difficult to scale. Most existing learning-based…

Automatic methods to predict listener opinions of synthesized speech remain elusive since listeners, systems being evaluated, characteristics of the speech, and even the instructions given and the rating scale all vary from test to test.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Erica Cooper , Wen-Chin Huang , Tomoki Toda , Junichi Yamagishi