English
Related papers

Related papers: Training Dynamics-Aware Multi-Factor Curriculum Le…

200 papers

Target speaker extraction (TSE) aims to isolate individual speaker voices from complex speech environments. The effectiveness of TSE systems is often compromised when the speaker characteristics are similar to each other. Recent research…

Sound · Computer Science 2024-10-08 Yun Liu , Xuechen Liu , Junichi Yamagishi

This paper presents a novel approach to target speaker extraction (TSE) using Curriculum Learning (CL) techniques, addressing the challenge of distinguishing a target speaker's voice from a mixture containing interfering speakers. For…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

Target speaker extraction (TSE) aims to isolate a specific voice from multiple mixed speakers relying on a registerd sample. Since voiceprint features usually vary greatly, current end-to-end neural networks require large model parameters…

Sound · Computer Science 2024-01-08 Shulin He , Jinjiang liu , Hao Li , Yang Yang , Fei Chen , Xueliang Zhang

Target Speaker Extraction (TSE) uses a reference cue to extract the target speech from a mixture. In TSE systems relying on audio cues, the speaker embedding from the enrolled speech is crucial to performance. However, these embeddings may…

Sound · Computer Science 2025-08-12 Shu Wu , Anbin Qi , Yanzhang Xie , Xiang Xie

In many situations, we would like to hear desired sound events (SEs) while being able to ignore interference. Target sound extraction (TSE) tackles this problem by estimating the audio signal of the sounds of target SE classes in a mixture…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Marc Delcroix , Jorge Bennasar Vázquez , Tsubasa Ochiai , Keisuke Kinoshita , Yasunori Ohishi , Shoko Araki

Large-scale pre-trained self-supervised learning (SSL) models have shown remarkable advancements in speech-related tasks. However, the utilization of these models in complex multi-talker scenarios, such as extracting a target speaker in a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Junyi Peng , Marc Delcroix , Tsubasa Ochiai , Oldrich Plchot , Takanori Ashihara , Shoko Araki , Jan Cernocky

Target speaker extraction (TSE) is essential in speech processing applications, particularly in scenarios with complex acoustic environments. Current TSE systems face challenges in limited data diversity and a lack of robustness in…

Sound · Computer Science 2024-12-18 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

Target Speaker Extraction (TSE) aims to extract the clean speech of the target speaker in an audio mixture, eliminating irrelevant background noise and speech. While prior work has explored various auxiliary cues including pre-recorded…

Sound · Computer Science 2026-04-28 Ziyang Jiang , Jiahe Lei , Xueyan Chen , Yifan Zhang , Zexu Pan , Wei Xue , Xinyuan Qian

Target speaker extraction (TSE) aims to extract the speech of a target speaker from mixtures containing multiple competing speakers. Conventional TSE systems predominantly rely on speaker cues, such as pre-enrolled speech, to identify and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-10 Haoyu Li , Yu Xi , Yidi Jiang , Shuai Wang , Kate Knill , Mark Gales , Haizhou Li , Kai Yu

Target speaker extraction (TSE) aims to recover a target speaker's speech from a mixture using a reference utterance as a cue. Most TSE systems adopt conditional auto-encoder architectures with one-step inference. Inspired by test-time…

Sound · Computer Science 2026-03-12 Zhenghai You , Ying Shi , Lantian Li , Dong Wang

Target speaker extraction (TSE) aims to isolate a specific speaker's speech from a mixture using speaker enrollment as a reference. While most existing approaches are discriminative, recent generative methods for TSE achieve strong results.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Aviv Navon , Aviv Shamsian , Yael Segal-Feldman , Neta Glazer , Gil Hetz , Joseph Keshet

Target Sound Extraction (TSE) focuses on the problem of separating sources of interest, indicated by a user's cue, from the input mixture. Most existing solutions operate in an offline fashion and are not suited to the low-latency causal…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-22 Shrishail Baligar , Mikolaj Kegler , Bryce Irvin , Marko Stamenovic , Shawn Newsam

Target speaker extraction (TSE) aims to isolate a desired speaker's voice from a multi-speaker mixture using auxiliary information such as a reference utterance. Although recent advances in diffusion and flow-matching models have improved…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-23 Riki Shimizu , Xilin Jiang , Nima Mesgarani

Automatic target sound extraction (TSE) is a machine learning approach to mimic the human auditory perception capability of attending to a sound source of interest from a mixture of sources. It often uses a model conditioned on a fixed form…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-16 Chenda Li , Yao Qian , Zhuo Chen , Dongmei Wang , Takuya Yoshioka , Shujie Liu , Yanmin Qian , Michael Zeng

Target speaker extraction (TSE) aims to extract the target speaker's voice from the input mixture. Previous studies have concentrated on high-overlapping scenarios. However, real-world applications usually meet more complex scenarios like…

Sound · Computer Science 2024-01-30 He Zhao , Hangting Chen , Jianwei Yu , Yuehai Wang

Target speaker extraction (TSE) relies on a reference cue of the target to extract the target speech from a speech mixture. While a speaker embedding is commonly used as the reference cue, such embedding pre-trained with a large number of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-12 Ke Zhang , Junjie Li , Shuai Wang , Yangjie Wei , Yi Wang , Yannan Wang , Haizhou Li

Target speech extraction (TSE) focuses on extracting the speech of a specific target speaker from a mixture of signals. Existing TSE models typically utilize static embeddings as conditions for extracting the target speaker's voice.…

Sound · Computer Science 2024-12-11 Yiwen Wang , Zeyu Yuan , Xihong Wu

The primary goal of multi-modal TSE (MTSE) is to extract a target speaker from a speech mixture using complementary information from different modalities, such as audio enrolment and visual feeds corresponding to the target speaker. MTSE…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-10 Srikanth Korse , Mohamed Elminshawi , Emanuel A. P. Habets , Srikanth Raj Chetupalli

Developing a robust speech emotion recognition (SER) system in noisy conditions faces challenges posed by different noise properties. Most previous studies have not considered the impact of human speech noise, thus limiting the application…

Sound · Computer Science 2024-12-18 Jinyi Mi , Xiaohan Shi , Ding Ma , Jiajun He , Takuya Fujimura , Tomoki Toda

Target speech extraction (TSE) isolates the speech of a specific speaker from a multi-talker overlapped speech mixture. Most existing TSE models rely on discriminative methods, typically predicting a time-frequency spectrogram mask for the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-22 Hao Ma , Rujin Chen , Xiao-Lei Zhang , Ju Liu , Xuelong Li
‹ Prev 1 2 3 10 Next ›