English
Related papers

Related papers: The Voice Timbre Attribute Detection 2025 Challeng…

200 papers

Using unsupervised learning to disentangle speech into content, rhythm, pitch, and timbre for voice conversion has become a hot research topic. Existing works generally take into account disentangling speech components through human-crafted…

Sound · Computer Science 2024-05-01 Ziqi Liang , Jianzong Wang , Xulong Zhang , Yong Zhang , Ning Cheng , Jing Xiao

Person search by natural language aims at retrieving a specific person in a large-scale image pool that matches the given textual descriptions. While most of the current methods treat the task as a holistic visual and textual feature…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Zhe Wang , Zhiyuan Fang , Jun Wang , Yezhou Yang

Evaluating audio generation systems, including text-to-music (TTM), text-to-speech (TTS), and text-to-audio (TTA), remains challenging due to the subjective and multi-dimensional nature of human perception. Existing methods treat mean…

Sound · Computer Science 2025-08-13 Chien-Chun Wang , Kuan-Tang Huang , Cheng-Yeh Yang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

For new participants - Executive summary: (1) The task is to develop a voice anonymization system for speech data which conceals the speaker's voice identity while protecting linguistic content, paralinguistic attributes, intelligibility…

Recent advancements in Text-to-Speech (TTS) systems have enabled the generation of natural and expressive speech from textual input. Accented TTS aims to enhance user experience by making the synthesized speech more relatable to minority…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Jan Melechovsky , Ambuj Mehrish , Berrak Sisman , Dorien Herremans

Real-world speech communication is rarely affected by a single type of degradation. Instead, it suffers from a complex interplay of acoustic interference, codec compression, and, increasingly, secondary artifacts introduced by upstream…

Sound · Computer Science 2025-12-30 Junan Zhang , Mengyao Zhu , Xin Xu , Hui Bu , Zhenhua Ling , Zhizheng Wu

Voice conversion (VC) aims at conversion of speaker characteristic without altering content. Due to training data limitations and modeling imperfections, it is difficult to achieve believable speaker mimicry without introducing processing…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-05 Tomi Kinnunen , Jaime Lorenzo-Trueba , Junichi Yamagishi , Tomoki Toda , Daisuke Saito , Fernando Villavicencio , Zhenhua Ling

The difficulty of acquiring abundant, high-quality data, especially in multi-lingual contexts, has sparked interest in addressing low-resource scenarios. Moreover, current literature rely on fixed expressions from language IDs, which…

Sound · Computer Science 2024-09-30 Youngjae Kim , Yejin Jeon , Gary Geunbae Lee

The Consensus Auditory-Perceptual Evaluation of Voice is a widely employed tool in clinical voice quality assessment that is significant for streaming communication among clinical professionals and benchmarking for the determination of…

Sound · Computer Science 2023-11-28 Yi-Heng Lin , Wen-Hsuan Tseng , Li-Chin Chen , Ching-Ting Tan , Yu Tsao

We explore a new task for audio-visual-language modeling called fine-grained audible video description (FAVD). It aims to provide detailed textual descriptions for the given audible videos, including the appearance and spatial locations of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Xuyang Shen , Dong Li , Jinxing Zhou , Zhen Qin , Bowen He , Xiaodong Han , Aixuan Li , Yuchao Dai , Lingpeng Kong , Meng Wang , Yu Qiao , Yiran Zhong

Recent years has witnessed an increase in technologies that use speech for the sensing of the health of the talker. This survey paper proposes a general taxonomy of the technologies and a broad overview of current progress and challenges.…

Neurons and Cognition · Quantitative Biology 2024-08-12 Aki Härmä , Bert den Brinker , Ulf Grossekathofer , Okke Ouweltjes , Srikanth Nallanthighal , Sidharth Abrol , Vibhu Sharma

This challenge aims to evaluate the capabilities of audio encoders, especially in the context of multi-task learning and real-world applications. Participants are invited to submit pre-trained audio encoders that map raw waveforms to…

Vision-language modeling has enabled open-vocabulary tasks where predictions can be queried using any text prompt in a zero-shot manner. Existing open-vocabulary tasks focus on object classes, whereas research on object attributes is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 María A. Bravo , Sudhanshu Mittal , Simon Ging , Thomas Brox

Voice conversion methods have advanced rapidly over the last decade. Studies have shown that speaker characteristics are captured by spectral feature as well as various prosodic features. Most existing conversion methods focus on the…

Sound · Computer Science 2015-12-08 Hy Quy Nguyen , Siu Wa Lee , Xiaohai Tian , Minghui Dong , Eng Siong Chng

Individual vocal differences are ubiquitous in the animal kingdom. In humans, these differences pervade the entire vocal repertoire and constitute a "voice print". Apes, our closest-living relatives, possess individual signatures within…

Machine Learning · Computer Science 2021-12-16 Mael Leroux , Orestes Gutierrez Al-Khudhairy , Nicolas Perony , Simon W. Townsend

Automatic speech quality assessment is essential for audio researchers, developers, speech and language pathologists, and system quality engineers. The current state-of-the-art systems are based on framewise speech features (hand-engineered…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Karl El Hajal , Zihan Wu , Neil Scheidwasser-Clow , Gasser Elbanna , Milos Cernak

Meetings are a valuable yet challenging scenario for speech applications due to complex acoustic conditions. This paper summarizes the outcomes of the MISP 2025 Challenge, hosted at Interspeech 2025, which focuses on multi-modal,…

Speaker Identification refers to the process of identifying a person using one's voice from a collection of known speakers. Environmental noise, reverberation and distortion make the task of automatic speaker identification challenging as…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Sabbir Ahmed , Nursadul Mamun , Md Azad Hossain

In a recent work, we presented a discriminative backend for speaker verification that achieved good out-of-the-box calibration performance on most tested conditions containing varying levels of mismatch to the training conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Luciana Ferrer , Mitchell McLaren

Recent advances in Visual Anomaly Detection (VAD) have introduced sophisticated algorithms leveraging embeddings generated by pre-trained feature extractors. Inspired by these developments, we investigate the adaptation of such algorithms…