English
Related papers

Related papers: MambaRate: Speech Quality Assessment Across Differ…

200 papers

In online conferencing applications, estimating the perceived quality of an audio signal is crucial to ensure high quality of experience for the end user. The most reliable way to assess the quality of a speech signal is through human…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-24 Bastiaan Tamm , Rik Vandenberghe , Hugo Van hamme

The acoustic environment can degrade speech quality during communication (e.g., video call, remote presentation, outside voice recording), and its impact is often unknown. Objective metrics for speech quality have proven challenging to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-30 Karl El Hajal , Milos Cernak , Pablo Mainar

Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated…

Sound · Computer Science 2024-06-11 Sarthak Yadav , Zheng-Hua Tan

As a subjective metric to evaluate the quality of synthesized speech, Mean opinion score~(MOS) usually requires multiple annotators to score the same speech. Such an annotation approach requires a lot of manpower and is also time-consuming.…

Sound · Computer Science 2023-06-21 Kexin Wang , Yunlong Zhao , Qianqian Dong , Tom Ko , Mingxuan Wang

Existing objective evaluation metrics for voice conversion (VC) are not always correlated with human perception. Therefore, training VC models with such criteria may not effectively improve naturalness and similarity of converted speech. In…

Sound · Computer Science 2022-03-01 Chen-Chou Lo , Szu-Wei Fu , Wen-Chin Huang , Xin Wang , Junichi Yamagishi , Yu Tsao , Hsin-Min Wang

In this study, we present SeMaScore, generated using a segment-wise mapping and scoring algorithm that serves as an evaluation metric for automatic speech recognition tasks. SeMaScore leverages both the error rate and a more robust…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-15 Zitha Sasindran , Harsha Yelchuri , T. V. Prabhakar

The ground truth used for training image, video, or speech quality prediction models is based on the Mean Opinion Scores (MOS) obtained from subjective experiments. Usually, it is necessary to conduct multiple experiments, mostly with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-15 Gabriel Mittag , Saman Zadtootaghaj , Thilo Michael , Babak Naderi , Sebastian Möller

The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary evaluation of the challenge submissions was done through…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Rohan Kumar Das , Tomi Kinnunen , Wen-Chin Huang , Zhenhua Ling , Junichi Yamagishi , Yi Zhao , Xiaohai Tian , Tomoki Toda

Automatic speech quality assessment is essential for audio researchers, developers, speech and language pathologists, and system quality engineers. The current state-of-the-art systems are based on framewise speech features (hand-engineered…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Karl El Hajal , Zihan Wu , Neil Scheidwasser-Clow , Gasser Elbanna , Milos Cernak

Ensuring that Text-to-Speech (TTS) systems deliver human-perceived quality at scale is a central challenge for modern speech technologies. Human subjective evaluation protocols such as Mean Opinion Score (MOS) and Side-by-Side (SBS)…

Computation and Language · Computer Science 2026-04-13 Ilya Trofimenko , David Kocharyan , Aleksandr Zaitsev , Pavel Repnikov , Mark Levin , Nikita Shevtsov

Mean opinion score (MOS) is a typical subjective evaluation metric for speech synthesis systems. Since collecting MOS is time-consuming, it would be desirable if there are accurate MOS prediction models for automatic evaluation. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee

Assessing the perceptual quality of synthetic speech is crucial for guiding the development and refinement of speech generation models. However, it has traditionally relied on human subjective ratings such as the Mean Opinion Score (MOS),…

One objective of Speech Quality Assessment (SQA) is to estimate the ranks of synthetic speech systems. However, recent SQA models are typically trained using low-precision direct scores such as mean opinion scores (MOS) as the training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-30 Cheng-Hung Hu , Yusuke Yasuda , Tomoki Toda

Predicting audio quality in voice synthesis and conversion systems is a critical yet challenging task, especially when traditional methods like Mean Opinion Scores (MOS) are cumbersome to collect at scale. This paper addresses the gap in…

Sound · Computer Science 2023-12-27 Aditya Ravuri , Erica Cooper , Junichi Yamagishi

Self-supervised learning (SSL) models like Wav2Vec2, HuBERT, and WavLM have been widely used in speech processing. These transformer-based models consist of multiple layers, each capturing different levels of representation. While prior…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Xinyu Liang , Fredrik Cumlin , Victor Ungureanu , Chandan K. A. Reddy , Christian Schuldt , Saikat Chatterjee

Token-free language models learn directly from raw bytes and remove the inductive bias of subword tokenization. Operating on bytes, however, results in significantly longer sequences. In this setting, standard autoregressive Transformers…

Computation and Language · Computer Science 2024-08-13 Junxiong Wang , Tushaar Gangavarapu , Jing Nathan Yan , Alexander M. Rush

Speech quality assessment has been a critical issue in speech processing for decades. Existing automatic evaluations usually require clean references or parallel ground truth data, which is infeasible when the amount of data soars.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-21 Wei-Cheng Tseng , Chien-yu Huang , Wei-Tsung Kao , Yist Y. Lin , Hung-yi Lee

The mean opinion score (MOS) is a standard metric for assessing speech quality, but its singular focus fails to identify specific distortions when low scores are observed. The NISQA dataset addresses this limitation by providing ratings…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-06 Fredrik Cumlin , Xinyu Liang , Victor Ungureanu , Chandan K. A. Reddy , Christian Schüldt , Saikat Chatterjee

We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speech. This challenge drew 22 participating teams from academia…

Sound · Computer Science 2022-07-05 Wen-Chin Huang , Erica Cooper , Yu Tsao , Hsin-Min Wang , Tomoki Toda , Junichi Yamagishi

We introduce MAVE (Mamba with Cross-Attention for Voice Editing and Synthesis), a novel autoregressive architecture for text-conditioned voice editing and high-fidelity text-to-speech (TTS) synthesis, built on a cross-attentive Mamba…

Sound · Computer Science 2025-10-07 Baher Mohammad , Magauiya Zhussip , Stamatios Lefkimmiatis