English
Related papers

Related papers: SingMOS: An extensive Open-Source Singing Voice Da…

200 papers

The mean opinion score (MOS) is a standard metric for assessing speech quality, but its singular focus fails to identify specific distortions when low scores are observed. The NISQA dataset addresses this limitation by providing ratings…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-06 Fredrik Cumlin , Xinyu Liang , Victor Ungureanu , Chandan K. A. Reddy , Christian Schüldt , Saikat Chatterjee

Discrete representation has shown advantages in speech generation tasks, wherein discrete tokens are derived by discretizing hidden features from self-supervised learning (SSL) pre-trained models. However, the direct application of speech…

Sound · Computer Science 2024-06-21 Yuxun Tang , Yuning Wu , Jiatong Shi , Qin Jin

This paper introduces a novel objective function for quality mean opinion score (MOS) prediction of unseen speech synthesis systems. The proposed function measures the similarity of relative positions of predicted MOS values, in a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Hemant Yadav , Erica Cooper , Junichi Yamagishi , Sunayana Sitaram , Rajiv Ratn Shah

The ground truth used for training image, video, or speech quality prediction models is based on the Mean Opinion Scores (MOS) obtained from subjective experiments. Usually, it is necessary to conduct multiple experiments, mostly with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-15 Gabriel Mittag , Saman Zadtootaghaj , Thilo Michael , Babak Naderi , Sebastian Möller

Automated singing assessment is crucial for education and entertainment. However, existing systems face two fundamental limitations: reliance on reference tracks, which stifles creative expression, and the simplification of complex…

The quantification of audio aesthetics remains a complex challenge in audio processing, primarily due to its subjective nature, which is influenced by human perception and cultural context. Traditional methods often depend on human…

Modern speech synthesis systems have improved significantly, with synthetic speech being indistinguishable from real speech. However, efficient and holistic evaluation of synthetic speech still remains a significant challenge. Human…

Computation and Language · Computer Science 2023-10-03 Dareen Alharthi , Roshan Sharma , Hira Dhamyal , Soumi Maiti , Bhiksha Raj , Rita Singh

The lack of a publicly-available large-scale and diverse dataset has long been a significant bottleneck for singing voice applications like Singing Voice Synthesis (SVS) and Singing Voice Conversion (SVC). To tackle this problem, we present…

Sound · Computer Science 2025-05-15 Yicheng Gu , Chaoren Wang , Junan Zhang , Xueyao Zhang , Zihao Fang , Haorui He , Zhizheng Wu

This paper introduces Opencpop, a publicly available high-quality Mandarin singing corpus designed for singing voice synthesis (SVS). The corpus consists of 100 popular Mandarin songs performed by a female professional singer. Audio files…

Sound · Computer Science 2022-01-21 Yu Wang , Xinsheng Wang , Pengcheng Zhu , Jie Wu , Hanzhao Li , Heyang Xue , Yongmao Zhang , Lei Xie , Mengxiao Bi

This is the summary paper for the AudioMOS Challenge 2025, the very first challenge for automatic subjective quality prediction for synthetic audio. The challenge consists of three tracks. The first track aims to assess text-to-music…

Text-to-Speech synthesis systems are generally evaluated using Mean Opinion Score (MOS) tests, where listeners score samples of synthetic speech on a Likert scale. A major drawback of MOS tests is that they only offer a general measure of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-07 Elijah Gutierrez , Pilar Oplustil-Gallegos , Catherine Lai

Even with recent advances in speech synthesis models, the evaluation of such models is based purely on human judgement as a single naturalness score, such as the Mean Opinion Score (MOS). The score-based metric does not give any further…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Kyumin Park , Keon Lee , Daeyoung Kim , Dongyeop Kang

Speech synthesis quality prediction has made remarkable progress with the development of supervised and self-supervised learning (SSL) MOS predictors but some aspects related to the data are still unclear and require further study. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-27 Alessandro Ragano , Emmanouil Benetos , Michael Chinen , Helard B. Martinez , Chandan K. A. Reddy , Jan Skoglund , Andrew Hines

Singing voice synthesis (SVS) has seen remarkable advancements in recent years. However, compared to speech and general audio data, publicly available singing datasets remain limited. In practice, this data scarcity often leads to…

Sound · Computer Science 2025-12-17 Yiwen Zhao , Jiatong Shi , Yuxun Tang , William Chen , Shinji Watanabe

A text-independent speaker recognition system relies on successfully encoding speech factors such as vocal pitch, intensity, and timbre to achieve good performance. A majority of such systems are trained and evaluated using spoken voice or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Anurag Chowdhury , Austin Cozzo , Arun Ross

The rapid proliferation of AI-Generated Content (AIGC) has necessitated robust metrics for perceptual quality assessment. However, automatic Mean Opinion Score (MOS) prediction models are often compromised by data scarcity, predisposing…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Kuan-Tang Huang , Chien-Chun Wang , Cheng-Yeh Yang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

Non-reference speech quality models are important for a growing number of applications. The VoiceMOS 2022 challenge provided a dataset of synthetic voice conversion and text-to-speech samples with subjective labels. This study looks at the…

Sound · Computer Science 2022-09-15 Michael Chinen , Jan Skoglund , Chandan K A Reddy , Alessandro Ragano , Andrew Hines

This paper introduces VoxSim, a dataset of perceptual voice similarity ratings. Recent efforts to automate the assessment of speech synthesis technologies have primarily focused on predicting mean opinion score of naturalness, leaving…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-29 Junseok Ahn , Youkyum Kim , Yeunju Choi , Doyeop Kwak , Ji-Hoon Kim , Seongkyu Mun , Joon Son Chung

The Talking Face Generation task has enormous potential for various applications in digital humans and agents, etc. Singing, as a common facial movement second only to talking, can be regarded as a universal language across ethnicities and…

Multimedia · Computer Science 2026-01-29 Zhilin Gao , Yunhao Li , Sijing Wu , Yucheng Zhu , Huiyu Duan , Guangtao Zhai

We are interested in a challenging task, Realistic-Music-Score based Singing Voice Synthesis (RMS-SVS). RMS-SVS aims to generate high-quality singing voices given realistic music scores with different note types (grace, slur, rest, etc.).…

Sound · Computer Science 2023-05-19 Jinzheng He , Jinglin Liu , Zhenhui Ye , Rongjie Huang , Chenye Cui , Huadai Liu , Zhou Zhao