English
Related papers

Related papers: Towards Automatic Evaluation and High-Quality Pseu…

200 papers

We propose a novel objective evaluation metric for synthesized audio in text-to-audio (TTA), aiming to improve the performance of TTA models. In TTA, subjective evaluation of the synthesized sound is an important, but its implementation…

Sound · Computer Science 2025-07-02 Minoru Kishi , Ryosuke Sakai , Shinnosuke Takamichi , Yusuke Kanamori , Yuki Okamoto

Sound effect editing-modifying audio by adding, removing, or replacing elements-remains constrained by existing approaches that rely solely on low-level signal processing or coarse text prompts, often resulting in limited flexibility and…

Multimedia · Computer Science 2025-11-27 Xinyue Guo , Xiaoran Yang , Lipan Zhang , Jianxuan Yang , Zhao Wang , Jian Luan

The Open Dataset of Audio Quality (ODAQ) was recently introduced to address the scarcity of openly available audio datasets with corresponding subjective quality scores. The dataset, released under permissive licenses, comprises audio…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-02 Sascha Dick , Christoph Thompson , Chih-Wei Wu , Matteo Torcoli , Pablo Delgado , Phillip A. Williams , Emanuel Habets

With the emergence of audio-language models, constructing large-scale paired audio-language datasets has become essential yet challenging for model development, primarily due to the time-intensive and labour-heavy demands involved. While…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-02 Jisheng Bai , Haohe Liu , Mou Wang , Dongyuan Shi , Wenwu Wang , Mark D. Plumbley , Woon-Seng Gan , Jianfeng Chen

With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio…

Sound · Computer Science 2024-06-13 Zeyu Xie , Baihan Li , Xuenan Xu , Zheng Liang , Kai Yu , Mengyue Wu

The INTERSPEECH 2020 Deep Noise Suppression Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

Data quality issues such as off-topic samples, near duplicates, and label errors often limit the performance of audio-based systems. This paper addresses these issues by adapting SelfClean, a representation-to-rank data auditing framework,…

AudioSet is a widely used benchmark in the audio research community and has significantly advanced various audio-related tasks. However, persistent issues with label accuracy and completeness remain critical bottlenecks that limit…

Sound · Computer Science 2025-08-25 Yulin Sun , Qisheng Xu , Yi Su , Qian Zhu , Yong Dou , Xinwang Liu , Kele Xu

The technology for generating music from textual descriptions has seen rapid advancements. However, evaluating text-to-music (TTM) systems remains a significant challenge, primarily due to the difficulty of balancing performance and cost…

Sound · Computer Science 2025-03-25 Cheng Liu , Hui Wang , Jinghua Zhao , Shiwan Zhao , Hui Bu , Xin Xu , Jiaming Zhou , Haoqin Sun , Yong Qin

Text to speech (TTS) has made rapid progress in both academia and industry in recent years. Some questions naturally arise that whether a TTS system can achieve human-level quality, how to define/judge that quality and how to achieve it. In…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-11 Xu Tan , Jiawei Chen , Haohe Liu , Jian Cong , Chen Zhang , Yanqing Liu , Xi Wang , Yichong Leng , Yuanhao Yi , Lei He , Frank Soong , Tao Qin , Sheng Zhao , Tie-Yan Liu

Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal…

Sound · Computer Science 2026-01-21 Ye Tao , Wen Wu , Chao Zhang , Mengyue Wu , Shuai Wang , Xuenan Xu

Audio chaptering, the task of segmenting long-form audio into coherent sections, is increasingly important for navigating podcasts, lectures, and videos. Despite its relevance, research remains limited and text-based, leaving key questions…

Sound · Computer Science 2026-05-29 Fabian Retkowski , Maike Züfle , Thai Binh Nguyen , Jan Niehues , Alexander Waibel

Universal sound separation aims to extract clean audio tracks corresponding to distinct events from mixed audio, which is critical for artificial auditory perception. However, current methods heavily rely on artificially mixed audio for…

Sound · Computer Science 2025-04-25 Xize Cheng , Slytherin Wang , Zehan Wang , Rongjie Huang , Tao Jin , Zhou Zhao

Diverse promising datasets have been designed to hold back the development of fake audio detection, such as ASVspoof databases. However, previous datasets ignore an attacking situation, in which the hacker hides some small fake clips in…

Sound · Computer Science 2023-12-19 Jiangyan Yi , Ye Bai , Jianhua Tao , Haoxin Ma , Zhengkun Tian , Chenglong Wang , Tao Wang , Ruibo Fu

Diffusion-based text-to-audio (TTA) generation has made substantial progress, leveraging latent diffusion model (LDM) to produce high-quality, diverse and instruction-relevant audios. However, beyond generation, the task of audio editing…

Sound · Computer Science 2024-10-01 Yuhang Jia , Yang Chen , Jinghua Zhao , Shiwan Zhao , Wenjia Zeng , Yong Chen , Yong Qin

Objective evaluation of audio processed with Time-Scale Modification (TSM) remains an open problem. Recently, a dataset of time-scaled audio with subjective quality labels was published and used to create an initial objective measure of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-07 Timothy Roberts , Kuldip K. Paliwal

An ideal multimodal agent should be aware of the quality of its input modalities. Recent advances have enabled large language models (LLMs) to incorporate auditory systems for handling various speech-related tasks. However, most audio LLMs…

We present the third edition of the VoiceMOS Challenge, a scientific initiative designed to advance research into automatic prediction of human speech ratings. There were three tracks. The first track was on predicting the quality of…

Speech style editing refers to modifying the stylistic properties of speech while preserving its linguistic content and speaker identity. However, most existing approaches depend on explicit labels or reference audio, which limits both…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Yun Chen , Qi Chen , Zheqi Dai , Arshdeep Singh , Philip J. B. Jackson , Mark D. Plumbley

Automated audio captioning (AAC), a task that mimics human perception as well as innovatively links audio processing and natural language processing, has overseen much progress over the last few years. AAC requires recognizing contents such…

Sound · Computer Science 2023-11-17 Xuenan Xu , Zeyu Xie , Mengyue Wu , Kai Yu