English
Related papers

Related papers: Robust Generative Audio Quality Assessment: Disent…

200 papers

To achieve successful deployment of AI research, it is crucial to understand the demands of the industry. In this paper, we present the results of a survey conducted with professional audio engineers, in order to determine research…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-11 Sangshin Oh , Minsung Kang , Hyeongi Moon , Keunwoo Choi , Ben Sangbae Chon

This study investigates the evaluation of multimedia quality models, focusing on the inherent uncertainties in subjective Mean Opinion Score (MOS) ratings due to factors like rater inconsistency and bias. Traditional statistical measures…

Multimedia · Computer Science 2024-11-12 Alessandro Ragano , Helard Becerra Martinez , Andrew Hines

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

Speech quality assessment has been a critical issue in speech processing for decades. Existing automatic evaluations usually require clean references or parallel ground truth data, which is infeasible when the amount of data soars.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-21 Wei-Cheng Tseng , Chien-yu Huang , Wei-Tsung Kao , Yist Y. Lin , Hung-yi Lee

Developers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations. However, image captioning metrics have struggled to give accurate learned estimates of the semantic and…

Computation and Language · Computer Science 2022-03-21 Mert İnan , Piyush Sharma , Baber Khalid , Radu Soricut , Matthew Stone , Malihe Alikhani

Accurately interpreting cardiac auscultation signals plays a crucial role in diagnosing and managing cardiovascular diseases. However, the paucity of labelled data inhibits classification models' training. Researchers have turned to…

Sound · Computer Science 2025-06-18 Leigh Abbott , Milan Marocchi , Matthew Fynn , Yue Rong , Sven Nordholm

The widespread adoption of generative AI models has raised growing concerns about representational harm and potential discriminatory outcomes. Yet, despite growing literature on this topic, the mechanisms by which bias emerges - especially…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Xiaofeng Zhang , Michelle Lin , Simon Lacoste-Julien , Aaron Courville , Yash Goyal

Sentence specificity quantifies the level of detail in a sentence, characterizing the organization of information in discourse. While this information is useful for many downstream applications, specificity prediction systems predict very…

Computation and Language · Computer Science 2018-11-16 Wei-Jen Ko , Greg Durrett , Junyi Jessy Li

The perceptual task of speech quality assessment (SQA) is a challenging task for machines to do. Objective SQA methods that rely on the availability of the corresponding clean reference have been the primary go-to approaches for SQA.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Pranay Manocha , Buye Xu , Anurag Kumar

Traditional image quality assessment (IQA) methods rely on mean opinion scores (MOS), which are resource-intensive to collect and fail to provide interpretable, localized feedback on specific image distortions. We overcome these limitations…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Fadeel Sher Khan , Long N. Le , Abhinau K. Venkataramanan , Seok-Jun Lee , Hamid R. Sheikh

Speech quality assessment has been a critical component in many voice communication related applications such as telephony and online conferencing. Traditional intrusive speech quality assessment requires the clean reference of the degraded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Yuchen Liu , Li-Chia Yang , Alex Pawlicki , Marko Stamenovic

We introduce Diffusion-based Audio Captioning (DAC), a non-autoregressive diffusion model tailored for diverse and efficient audio captioning. Although existing captioning models relying on language backbones have achieved remarkable…

Computation and Language · Computer Science 2025-06-03 Manjie Xu , Chenxing Li , Xinyi Tu , Yong Ren , Ruibo Fu , Wei Liang , Dong Yu

Objective audio quality measurement systems often use perceptual models to predict the subjective quality scores of processed signals, as reported in listening tests. Most systems map different metrics of perceived degradation into a single…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Pablo M. Delgado , Jürgen Herre

This paper describes a general, scalable, end-to-end framework that uses the generative adversarial network (GAN) objective to enable robust speech recognition. Encoders trained with the proposed approach enjoy improved invariance by…

Computation and Language · Computer Science 2017-11-07 Anuroop Sriram , Heewoo Jun , Yashesh Gaur , Sanjeev Satheesh

Generative Adversarial Networks (GANs) have achieved excellent audio synthesis quality in the last years. However, making them operable with semantically meaningful controls remains an open challenge. An obvious approach is to control the…

Sound · Computer Science 2021-08-04 Javier Nistal , Stefan Lattner , Gaël Richard

Generative adversarial network-based models have shown remarkable performance in the field of speech enhancement. However, the current optimization strategies for these models predominantly focus on refining the architecture of the…

Sound · Computer Science 2025-09-10 Xihao Yuan , Siqi Liu , Yan Chen , Hang Zhou , Chang Liu , Hanting Chen , Jie Hu

Domain-adapted sentiment classification refers to training on a labeled source domain to well infer document-level sentiment on an unlabeled target domain. Most existing relevant models involve a feature extractor and a sentiment…

Computation and Language · Computer Science 2020-02-06 Qianming Xue , Wei Zhang , Hongyuan Zha

In speech generation tasks, human subjective ratings, usually referred to as the opinion score, are considered the "gold standard" for speech quality evaluation, with the mean opinion score (MOS) serving as the primary evaluation metric.…

Sound · Computer Science 2024-06-21 Yuxun Tang , Jiatong Shi , Yuning Wu , Qin Jin

Automatically generating descriptive captions for images is a well-researched area in computer vision. However, existing evaluation approaches focus on measuring the similarity between two sentences disregarding fine-grained semantics of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Philipp Harzig , Dan Zecha , Rainer Lienhart , Carolin Kaiser , René Schallner

In this paper, we propose the coarse-to-fine optimization for the task of speech enhancement. Cosine similarity loss [1] has proven to be an effective metric to measure similarity of speech signals. However, due to the large variance of the…

Sound · Computer Science 2019-08-23 Jian Yao , Ahmad Al-Dahle