English
Related papers

Related papers: Comparison of Speech Representations for the MOS P…

200 papers

Predicting audio quality in voice synthesis and conversion systems is a critical yet challenging task, especially when traditional methods like Mean Opinion Scores (MOS) are cumbersome to collect at scale. This paper addresses the gap in…

Sound · Computer Science 2023-12-27 Aditya Ravuri , Erica Cooper , Junichi Yamagishi

Self-supervised learning (SSL) models like Wav2Vec2, HuBERT, and WavLM have been widely used in speech processing. These transformer-based models consist of multiple layers, each capturing different levels of representation. While prior…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Xinyu Liang , Fredrik Cumlin , Victor Ungureanu , Chandan K. A. Reddy , Christian Schuldt , Saikat Chatterjee

Speech synthesis quality prediction has made remarkable progress with the development of supervised and self-supervised learning (SSL) MOS predictors but some aspects related to the data are still unclear and require further study. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-27 Alessandro Ragano , Emmanouil Benetos , Michael Chinen , Helard B. Martinez , Chandan K. A. Reddy , Jan Skoglund , Andrew Hines

MOS (Mean Opinion Score) is a subjective method used for the evaluation of a system's quality. Telecommunications (for voice and video), and speech synthesis systems (for generated speech) are a few of the many applications of the method.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Bálint Gyires-Tóth , Csaba Zainkó

Automatic methods to predict listener opinions of synthesized speech remain elusive since listeners, systems being evaluated, characteristics of the speech, and even the instructions given and the rating scale all vary from test to test.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Erica Cooper , Wen-Chin Huang , Tomoki Toda , Junichi Yamagishi

Designing a speech quality assessment (SQA) system for estimating mean-opinion-score (MOS) of multi-rate speech with varying sampling frequency (16-48 kHz) is a challenging task. The challenge arises due to the limited availability of a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-17 Fengyuan Cao , Xinyu Liang , Fredrik Cumlin , Victor Ungureanu , Chandan K. A. Reddy , Christian Schuldt , Saikat Chatterjee

An effective approach to automatically predict the subjective rating for synthetic speech is to train on a listening test dataset with human-annotated scores. Although each speech sample in the dataset is rated by several listeners, most…

Sound · Computer Science 2021-10-19 Wen-Chin Huang , Erica Cooper , Junichi Yamagishi , Tomoki Toda

Assessing the naturalness of speech using mean opinion score (MOS) prediction models has positive implications for the automatic evaluation of speech synthesis systems. Early MOS prediction models took the raw waveform or amplitude spectrum…

Sound · Computer Science 2024-11-19 Yu-Fei Shi , Yang Ai , Ye-Xin Lu , Hui-Peng Du , Zhen-Hua Ling

Current state-of-the-art methods for automatic synthetic speech evaluation are based on MOS prediction neural models. Such MOS prediction models include MOSNet and LDNet that use spectral features as input, and SSL-MOS that relies on a…

Self-supervised learning (SSL) speech representations learned from large amounts of diverse, mixed-quality speech data without transcriptions are gaining ground in many speech technology applications. Prior work has shown that SSL is an…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-12 Siyang Wang , Gustav Eje Henter , Joakim Gustafson , Éva Székely

Recently, researchers have shown an increasing interest in automatically predicting the subjective evaluation for speech synthesis systems. This prediction is a challenging task, especially on the out-of-domain test set. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-20 Zili Qi , Xinhui Hu , Wangjin Zhou , Sheng Li , Hao Wu , Jian Lu , Xinkang Xu

We participated in the mean opinion score (MOS) prediction challenge, 2022. This challenge aims to predict MOS scores of synthetic speech on two tracks, the main track and a more challenging sub-track: out-of-domain (OOD). To improve the…

Sound · Computer Science 2022-04-12 Zhengdong Yang , Wangjin Zhou , Chenhui Chu , Sheng Li , Raj Dabre , Raphael Rubino , Yi Zhao

In online conferencing applications, estimating the perceived quality of an audio signal is crucial to ensure high quality of experience for the end user. The most reliable way to assess the quality of a speech signal is through human…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-24 Bastiaan Tamm , Rik Vandenberghe , Hugo Van hamme

Mean opinion score (MOS) is a popular subjective metric to assess the quality of synthesized speech, and usually involves multiple human judges to evaluate each speech utterance. To reduce the labor cost in MOS test, multiple methods have…

Sound · Computer Science 2021-03-02 Yichong Leng , Xu Tan , Sheng Zhao , Frank Soong , Xiang-Yang Li , Tao Qin

Recent work has explored using self-supervised learning (SSL) speech representations such as wav2vec2.0 as the representation medium in standard two-stage TTS, in place of conventionally used mel-spectrograms. It is however unclear which…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-11 Siyang Wang , Gustav Eje Henter , Joakim Gustafson , Éva Székely

Speech quality assessment is a critical process in selecting text-to-speech synthesis (TTS) or voice conversion models. Evaluation of voice synthesis can be done using objective metrics or subjective metrics. Although there are many…

Sound · Computer Science 2025-06-04 Saurabh Agrawal , Raj Gohil , Gopal Kumar Agrawal , Vikram C M , Kushal Verma

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

Speech representation learning with self-supervised algorithms has resulted in notable performance boosts in many downstream tasks. Recent work combined self-supervised learning (SSL) and visually grounded speech (VGS) processing mechanisms…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-08 Khazar Khorrami , María Andrea Cruz Blandón , Tuomas Virtanen , Okko Räsänen

Several studies have proposed deep-learning-based models to predict the mean opinion score (MOS) of synthesized speech, showing the possibility of replacing human raters. However, inter- and intra-rater variability in MOSs makes it hard to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-03 Yeunju Choi , Youngmoon Jung , Hoirin Kim

We introduce our submission to the AudioMOS Challenge (AMC) 2025 Track 3: mean opinion score (MOS) prediction for speech with multiple sampling frequencies (SFs). Our submitted model integrates an SF-independent (SFI) convolutional layer…

‹ Prev 1 2 3 10 Next ›