English
Related papers

Related papers: CodecMOS-Accent: A MOS Benchmark of Resynthesized …

200 papers

In this work, we present the SOMOS dataset, the first large-scale mean opinion scores (MOS) dataset consisting of solely neural text-to-speech (TTS) samples. It can be employed to train automatic MOS prediction systems focused on the…

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

Speech quality assessment has been a critical component in many voice communication related applications such as telephony and online conferencing. Traditional intrusive speech quality assessment requires the clean reference of the degraded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Yuchen Liu , Li-Chia Yang , Alex Pawlicki , Marko Stamenovic

Training of multi-speaker text-to-speech (TTS) systems relies on curated datasets based on high-quality recordings or audiobooks. Such datasets often lack speaker diversity and are expensive to collect. As an alternative, recent studies…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-13 Sewade Ogun , Vincent Colotte , Emmanuel Vincent

Perceptual speech quality is an important performance metric for teleconferencing applications. The mean opinion score (MOS) is standardized for the perceptual evaluation of speech quality and is obtained by asking listeners to rate the…

Sound · Computer Science 2022-12-06 Haleh Akrami , Hannes Gamper

Text-to-Speech synthesis systems are generally evaluated using Mean Opinion Score (MOS) tests, where listeners score samples of synthetic speech on a Likert scale. A major drawback of MOS tests is that they only offer a general measure of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-07 Elijah Gutierrez , Pilar Oplustil-Gallegos , Catherine Lai

Speech quality assessment is a critical process in selecting text-to-speech synthesis (TTS) or voice conversion models. Evaluation of voice synthesis can be done using objective metrics or subjective metrics. Although there are many…

Sound · Computer Science 2025-06-04 Saurabh Agrawal , Raj Gohil , Gopal Kumar Agrawal , Vikram C M , Kushal Verma

Developers of text-to-speech synthesizers (TTS) often make use of human raters to assess the quality of synthesized speech. We demonstrate that we can model human raters' mean opinion scores (MOS) of synthesized speech using a deep…

Computation and Language · Computer Science 2016-11-29 Brian Patton , Yannis Agiomyrgiannakis , Michael Terry , Kevin Wilson , Rif A. Saurous , D. Sculley

State-of-the-art text-to-speech (TTS) systems realize high naturalness in monolingual environments, synthesizing speech with correct multilingual accents (especially for Indic languages) and context-relevant emotions still poses difficulty…

Machine Learning · Computer Science 2025-06-23 Pranav Pawar , Akshansh Dwivedi , Jenish Boricha , Himanshu Gohil , Aditya Dubey

While deep learning has made impressive progress in speech synthesis and voice conversion, the assessment of the synthesized speech is still carried out by human participants. Several recent papers have proposed deep-learning-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-10 Yeunju Choi , Youngmoon Jung , Hoirin Kim

Discrete audio tokenizers are fundamental to empowering large language models with native audio processing and generation capabilities. Despite recent progress, existing approaches often rely on pretrained encoders, semantic distillation,…

Objective speech quality models aim to predict human-perceived speech quality using automated methods. However, cross-lingual generalization remains a major challenge, as Mean Opinion Scores (MOS) vary across languages due to linguistic,…

Computation and Language · Computer Science 2025-02-19 Wafaa Wardah , Tuğçe Melike Koçak Büyüktaş , Kirill Shchegelskiy , Sebastian Möller , Robert P. Spang

Although recent neural text-to-speech (TTS) systems have achieved high-quality speech synthesis, there are cases where a TTS system generates low-quality speech, mainly caused by limited training data or information loss during knowledge…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Yeunju Choi , Youngmoon Jung , Youngjoo Suh , Hoirin Kim

As a subjective metric to evaluate the quality of synthesized speech, Mean opinion score~(MOS) usually requires multiple annotators to score the same speech. Such an annotation approach requires a lot of manpower and is also time-consuming.…

Sound · Computer Science 2023-06-21 Kexin Wang , Yunlong Zhao , Qianqian Dong , Tom Ko , Mingxuan Wang

Mean opinion score (MOS) is a popular subjective metric to assess the quality of synthesized speech, and usually involves multiple human judges to evaluate each speech utterance. To reduce the labor cost in MOS test, multiple methods have…

Sound · Computer Science 2021-03-02 Yichong Leng , Xu Tan , Sheng Zhao , Frank Soong , Xiang-Yang Li , Tao Qin

Current state-of-the-art methods for automatic synthetic speech evaluation are based on MOS prediction neural models. Such MOS prediction models include MOSNet and LDNet that use spectral features as input, and SSL-MOS that relies on a…

Existing objective evaluation metrics for voice conversion (VC) are not always correlated with human perception. Therefore, training VC models with such criteria may not effectively improve naturalness and similarity of converted speech. In…

Sound · Computer Science 2022-03-01 Chen-Chou Lo , Szu-Wei Fu , Wen-Chin Huang , Xin Wang , Junichi Yamagishi , Yu Tsao , Hsin-Min Wang

Prosody is essential for speech technology, shaping comprehension, naturalness, and expressiveness. However, current text-to-speech (TTS) systems still struggle to accurately capture human-like prosodic variation, in part because existing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-05 Cedric Chan , Jianjing Kuang

We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speech. This challenge drew 22 participating teams from academia…

Sound · Computer Science 2022-07-05 Wen-Chin Huang , Erica Cooper , Yu Tsao , Hsin-Min Wang , Tomoki Toda , Junichi Yamagishi

Neural TTS has shown it can generate high quality synthesized speech. In this paper, we investigate the multi-speaker latent space to improve neural TTS for adapting the system to new speakers with only several minutes of speech or…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-04 Yan Deng , Lei He , Frank Soong
‹ Prev 1 2 3 10 Next ›