中文
相关论文

相关论文: HighRateMOS: Sampling-Rate Aware Modeling for Spee…

200 篇论文

Human perception has the unique ability to focus on specific events in a mixture of signals--a challenging task for existing non-intrusive assessment methods. In this work, we introduce semi-intrusive assessment that emulates human…

音频与语音处理 · 电气工程与系统科学 2025-01-23 Jozef Coldenhoff , Milos Cernak

In this paper, we evaluate feature extraction models for predicting speech quality. We also propose a model architecture to compare embeddings of supervised learning and self-supervised learning models with embeddings of speaker…

Previous methods for predicting room acoustic parameters and speech quality metrics have focused on the single-channel case, where room acoustics and Mean Opinion Score (MOS) are predicted for a single recording device. However,…

音频与语音处理 · 电气工程与系统科学 2024-03-14 Jozef Coldenhoff , Andrew Harper , Paul Kendrick , Tijana Stojkovic , Milos Cernak

We present the CodecMOS-Accent dataset, a mean opinion score (MOS) benchmark designed to evaluate neural audio codec (NAC) models and the large language model (LLM)-based text-to-speech (TTS) models trained upon them, especially across…

声音 · 计算机科学 2026-03-17 Wen-Chin Huang , Nicholas Sanders , Erica Cooper

This is the summary paper for the AudioMOS Challenge 2025, the very first challenge for automatic subjective quality prediction for synthetic audio. The challenge consists of three tracks. The first track aims to assess text-to-music…

Automatic mean opinion score (MOS) prediction provides a more perceptual alternative to objective metrics, offering deeper insights into the evaluated models. With the rapid progress of multimodal large language models (MLLMs), their…

声音 · 计算机科学 2025-09-23 Yuhang Jia , Xu Zhang , Yang Chen , Hui Wang , Enzhi Wang , Yong Qin

While deep learning has made impressive progress in speech synthesis and voice conversion, the assessment of the synthesized speech is still carried out by human participants. Several recent papers have proposed deep-learning-based…

音频与语音处理 · 电气工程与系统科学 2020-11-10 Yeunju Choi , Youngmoon Jung , Hoirin Kim

There has been significant research effort developing neural-network-based predictors of SQ in recent years. While a primary objective has been to develop non-intrusive, i.e.~reference-free, metrics to assess the performance of SE systems,…

声音 · 计算机科学 2025-08-05 George Close , Kris Hong , Thomas Hain , Stefan Goetze

Singing voice generation progresses rapidly, yet evaluating singing quality remains a critical challenge. Human subjective assessment, typically in the form of listening tests, is costly and time consuming, while existing objective metrics…

声音 · 计算机科学 2026-01-28 Yuxun Tang , Lan Liu , Wenhao Feng , Yiwen Zhao , Jionghao Han , Yifeng Yu , Jiatong Shi , Qin Jin

This paper introduces a novel objective function for quality mean opinion score (MOS) prediction of unseen speech synthesis systems. The proposed function measures the similarity of relative positions of predicted MOS values, in a…

音频与语音处理 · 电气工程与系统科学 2023-10-10 Hemant Yadav , Erica Cooper , Junichi Yamagishi , Sunayana Sitaram , Rajiv Ratn Shah

Speech synthesis quality prediction has made remarkable progress with the development of supervised and self-supervised learning (SSL) MOS predictors but some aspects related to the data are still unclear and require further study. In this…

音频与语音处理 · 电气工程与系统科学 2023-11-27 Alessandro Ragano , Emmanouil Benetos , Michael Chinen , Helard B. Martinez , Chandan K. A. Reddy , Jan Skoglund , Andrew Hines

Recently, researchers have shown an increasing interest in automatically predicting the subjective evaluation for speech synthesis systems. This prediction is a challenging task, especially on the out-of-domain test set. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2023-11-20 Zili Qi , Xinhui Hu , Wangjin Zhou , Sheng Li , Hao Wu , Jian Lu , Xinkang Xu

In this paper, we propose a highly efficient method to estimate an image's mean opinion score (MOS) from a single opinion score (SOS). Assuming that each SOS is the observed sample of a normal distribution and the MOS is its unknown…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Lei Wang , Desen Yuan

Recent research on speech enhancement (SE) has seen the emergence of deep-learning-based methods. It is still a challenging task to determine the effective ways to increase the generalizability of SE under diverse test conditions. In this…

音频与语音处理 · 电气工程与系统科学 2021-09-01 Ryandhimas E. Zezario , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary evaluation of the challenge submissions was done through…

音频与语音处理 · 电气工程与系统科学 2020-09-09 Rohan Kumar Das , Tomi Kinnunen , Wen-Chin Huang , Zhenhua Ling , Junichi Yamagishi , Yi Zhao , Xiaohai Tian , Tomoki Toda

Training of multi-speaker text-to-speech (TTS) systems relies on curated datasets based on high-quality recordings or audiobooks. Such datasets often lack speaker diversity and are expensive to collect. As an alternative, recent studies…

音频与语音处理 · 电气工程与系统科学 2022-10-13 Sewade Ogun , Vincent Colotte , Emmanuel Vincent

This research introduces an enhanced version of the multi-objective speech assessment model--MOSA-Net+, by leveraging the acoustic features from Whisper, a large-scaled weakly supervised model. We first investigate the effectiveness of…

音频与语音处理 · 电气工程与系统科学 2024-04-30 Ryandhimas E. Zezario , Yu-Wen Chen , Szu-Wei Fu , Yu Tsao , Hsin-Min Wang , Chiou-Shann Fuh

Without the need for a clean reference, non-intrusive speech assessment methods have caught great attention for objective evaluations. While deep learning models have been used to develop non-intrusive speech assessment methods with…

音频与语音处理 · 电气工程与系统科学 2023-11-16 Hsin-Tien Chiang , Szu-Wei Fu , Hsin-Min Wang , Yu Tsao , John H. L. Hansen

Current state-of-the-art methods for automatic synthetic speech evaluation are based on MOS prediction neural models. Such MOS prediction models include MOSNet and LDNet that use spectral features as input, and SSL-MOS that relies on a…

An ideal multimodal agent should be aware of the quality of its input modalities. Recent advances have enabled large language models (LLMs) to incorporate auditory systems for handling various speech-related tasks. However, most audio LLMs…