English
Related papers

Related papers: MetricNet: Towards Improved Modeling For Non-Intru…

200 papers

Existing objective evaluation metrics for voice conversion (VC) are not always correlated with human perception. Therefore, training VC models with such criteria may not effectively improve naturalness and similarity of converted speech. In…

Sound · Computer Science 2022-03-01 Chen-Chou Lo , Szu-Wei Fu , Wen-Chin Huang , Xin Wang , Junichi Yamagishi , Yu Tsao , Hsin-Min Wang

There has been significant research effort developing neural-network-based predictors of SQ in recent years. While a primary objective has been to develop non-intrusive, i.e.~reference-free, metrics to assess the performance of SE systems,…

Sound · Computer Science 2025-08-05 George Close , Kris Hong , Thomas Hain , Stefan Goetze

Modern speech quality prediction models are trained on audio data resampled to a specific sampling rate. When faced with higher-rate audio at test time, these models can produce biased scores. We introduce HighRateMOS, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Wenze Ren , Yi-Cheng Lin , Wen-Chin Huang , Ryandhimas E. Zezario , Szu-Wei Fu , Sung-Feng Huang , Erica Cooper , Haibin Wu , Hung-Yu Wei , Hsin-Min Wang , Hung-yi Lee , Yu Tsao

In this study, we propose a cross-domain multi-objective speech assessment model called MOSA-Net, which can estimate multiple speech assessment metrics simultaneously. Experimental results show that MOSA-Net can improve the linear…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-20 Ryandhimas E. Zezario , Szu-Wei Fu , Fei Chen , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

Subjective tests are the gold standard for evaluating speech quality and intelligibility; however, they are time-consuming and expensive. Thus, objective measures that align with human perceptions are crucial. This study evaluates the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Hsin-Tien Chiang , Kuo-Hsuan Hung , Szu-Wei Fu , Heng-Cheng Kuo , Ming-Hsueh Tsai , Yu Tsao

The automatic speech quality assessment (SQA) has been extensively studied to predict the speech quality without time-consuming questionnaires. Recently, neural-based SQA models have been actively developed for speech samples produced by…

Sound · Computer Science 2025-06-24 Yuto Kondo , Hirokazu Kameoka , Kou Tanaka , Takuhiro Kaneko

MOS (Mean Opinion Score) is a subjective method used for the evaluation of a system's quality. Telecommunications (for voice and video), and speech synthesis systems (for generated speech) are a few of the many applications of the method.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Bálint Gyires-Tóth , Csaba Zainkó

Objective speech-quality metrics are widely used to assess codec performance. However, for neural codecs, it is often unclear which metrics provide reliable quality estimates. To address this, we evaluated 45 objective metrics by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Wolfgang Mack , Nezih Topaloglu , Laura Lechler , Ivana Balić , Alexandra Craciun , Mansur Yesilbursa , Kamil Wojcicki

The quality of the speech communication systems, which include noise suppression algorithms, are typically evaluated in laboratory experiments according to the ITU-T Rec. P.835, in which participants rate background noise, speech signal,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-19 Babak Naderi , Ross Cutler

In this paper, we study the task of subjective speech quality assessment (SSQA), which refers to predicting the perceptual quality of speech. Owing to the development of deep neural network models, SSQA has greatly advanced and has been…

Sound · Computer Science 2026-04-27 Wen-Chin Huang , Erica Cooper , Tomoki Toda

The quantification of audio aesthetics remains a complex challenge in audio processing, primarily due to its subjective nature, which is influenced by human perception and cultural context. Traditional methods often depend on human…

Most of the deep learning-based speech enhancement models are learned in a supervised manner, which implies that pairs of noisy and clean speech are required during training. Consequently, several noisy speeches recorded in daily life…

Sound · Computer Science 2021-10-13 Szu-Wei Fu , Cheng Yu , Kuo-Hsuan Hung , Mirco Ravanelli , Yu Tsao

Neural audio codecs have gained recent popularity for their use in generative modeling as they offer high-fidelity audio reconstruction at low bitrates. While human listening studies remain the gold standard for assessing perceptual…

Sound · Computer Science 2025-11-26 Luca A. Lanzendörfer , Florian Grötschla

Source separation is a crucial pre-processing step for various speech processing tasks, such as automatic speech recognition (ASR). Traditionally, the evaluation metrics for speech separation rely on the matched reference audios and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-28 Ari Frummer , Helin Wang , Tianyu Cao , Adi Arbel , Yuval Sieradzki , Oren Gal , Jesús Villalba , Thomas Thebaud , Najim Dehak

Mean opinion score (MOS) is a popular subjective metric to assess the quality of synthesized speech, and usually involves multiple human judges to evaluate each speech utterance. To reduce the labor cost in MOS test, multiple methods have…

Sound · Computer Science 2021-03-02 Yichong Leng , Xu Tan , Sheng Zhao , Frank Soong , Xiang-Yang Li , Tao Qin

Since its inception, the field of deep speech enhancement has been dominated by predictive (discriminative) approaches, such as spectral mapping or masking. Recently, however, novel generative approaches have been applied to speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Danilo de Oliveira , Julius Richter , Jean-Marie Lemercier , Tal Peer , Timo Gerkmann

Objective audio quality measurement systems often use perceptual models to predict the subjective quality scores of processed signals, as reported in listening tests. Most systems map different metrics of perceived degradation into a single…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Pablo M. Delgado , Jürgen Herre

Speech quality assessment (SQA) aims to evaluate the quality of speech samples without relying on time-consuming listener questionnaires. Recent efforts have focused on training neural-based SQA models to predict the mean opinion score…

Sound · Computer Science 2025-06-24 Yuto Kondo , Hirokazu Kameoka , Kou Tanaka , Takuhiro Kaneko

The discrepancy between the cost function used for training a speech enhancement model and human auditory perception usually makes the quality of enhanced speech unsatisfactory. Objective evaluation metrics which consider human perception…

Sound · Computer Science 2021-06-07 Szu-Wei Fu , Cheng Yu , Tsun-An Hsieh , Peter Plantinga , Mirco Ravanelli , Xugang Lu , Yu Tsao

The evaluation of synthetic and processed speech has long been a cornerstone of audio engineering and speech science. Although subjective listening tests remain the gold standard for assessing perceptual quality and intelligibility, their…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-05 Yu Tsao