中文
相关论文

相关论文: Mask2Flow-TSE: Two-Stage Target Speaker Extraction…

200 篇论文

Target speaker extraction (TSE) aims to extract the speech of a target speaker from mixtures containing multiple competing speakers. Conventional TSE systems predominantly rely on speaker cues, such as pre-enrolled speech, to identify and…

音频与语音处理 · 电气工程与系统科学 2026-02-10 Haoyu Li , Yu Xi , Yidi Jiang , Shuai Wang , Kate Knill , Mark Gales , Haizhou Li , Kai Yu

Target Speech Extraction (TSE) aims to isolate a target speaker's voice from a mixture of multiple speakers by leveraging speaker-specific cues, typically provided as auxiliary audio (a.k.a. cue audio). Although recent advancements in TSE…

音频与语音处理 · 电气工程与系统科学 2025-09-09 Helin Wang , Jiarui Hai , Dongchao Yang , Chen Chen , Kai Li , Junyi Peng , Thomas Thebaud , Laureano Moro Velazquez , Jesus Villalba , Najim Dehak

While generative models have set new benchmarks for Target Speaker Extraction (TSE), their inherent reliance on global context precludes deployment in real-time applications. Direct adaptation to streaming scenarios often leads to…

As a practical alternative of speech separation, target speaker extraction (TSE) aims to extract the speech from the desired speaker using additional speaker cue extracted from the speaker. Its main challenge lies in how to properly extract…

声音 · 计算机科学 2023-01-18 Kai Liu , Xucheng Wan , Ziqing Du , Huan Zhou

Diffusion models have gained attention in speech enhancement tasks, providing an alternative to conventional discriminative methods. However, research on target speech extraction under multi-speaker noisy conditions remains relatively…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Leying Zhang , Yao Qian , Linfeng Yu , Heming Wang , Hemin Yang , Long Zhou , Shujie Liu , Yanmin Qian

Audio-Visual Target Speaker Extraction (AVTSE) aims to isolate a target speaker's voice in a multi-speaker environment with visual cues as auxiliary. Most of the existing AVTSE methods encode visual and audio features simultaneously,…

声音 · 计算机科学 2025-11-13 Zixuan Li , Xueliang Zhang , Lei Miao , Zhipeng Yan , Ying Sun , Chong Zhu

Target speaker extraction (TSE) aims to isolate a specific speaker's voice from multi-speaker mixtures. Despite strong benchmark results, real-world performance often degrades due to different interacting factors. Previous curriculum…

声音 · 计算机科学 2026-03-06 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

We present the first neural target speech extraction (TSE) system that uses human feedback for iterative refinement. Our approach allows users to mark specific segments of the TSE output, generating an edit mask. The refinement system then…

声音 · 计算机科学 2025-08-06 Malek Itani , Ashton Graves , Sefik Emre Eskimez , Shyamnath Gollakota

Target speaker extraction aims to separate the voice of a specific speaker from mixed speech. Traditionally, this process has relied on extracting a speaker embedding from a reference speech, in which a speaker recognition model is…

音频与语音处理 · 电气工程与系统科学 2025-05-21 Bang Zeng , Ming Li

Target speech extraction (TSE) systems are designed to extract target speech from a multi-talker mixture. The popular training objective for most prior TSE networks is to enhance reconstruction performance of extracted speech waveform.…

音频与语音处理 · 电气工程与系统科学 2023-03-10 Kai Liu , Ziqing Du , Xucheng Wan , Huan Zhou

Target Speaker Extraction (TSE) aims to isolate a specific speaker's voice from a mixture, guided by a pre-recorded enrollment. While TSE bypasses the global permutation ambiguity of blind source separation, it remains vulnerable to speaker…

音频与语音处理 · 电气工程与系统科学 2026-04-10 Zikai Liu , Ziqian Wang , Xingchen Li , Yike Zhu , Shuai Wang , Longshuai Xiao , Lei Xie

Pre-trained self-supervised learning (SSL) models have achieved remarkable success in various speech tasks. However, their potential in target speech extraction (TSE) has not been fully exploited. TSE aims to extract the speech of a target…

音频与语音处理 · 电气工程与系统科学 2024-02-21 Junyi Peng , Marc Delcroix , Tsubasa Ochiai , Oldrich Plchot , Shoko Araki , Jan Cernocky

This paper investigates the use of relative cues for text-based target speech extraction (TSE). We first provide a theoretical justification for relative cues from the perspectives of human perception and label quantization, showing that…

音频与语音处理 · 电气工程与系统科学 2026-04-03 Wang Dai , Archontis Politis , Tuomas Virtanen

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

We propose a Beamformer-guided Target Speaker Extraction (BG-TSE) method to extract a target speaker's voice from a multi-channel recording informed by the direction of arrival of the target. The proposed method employs a front-end…

音频与语音处理 · 电气工程与系统科学 2023-03-16 Mohamed Elminshawi , Srikanth Raj Chetupalli , Emanuël A. P. Habets

Target speech extraction (TSE) extracts the speech of a target speaker in a mixture given auxiliary clues characterizing the speaker, such as an enrollment utterance. TSE addresses thus the challenging problem of simultaneously performing…

音频与语音处理 · 电气工程与系统科学 2022-07-15 Marc Delcroix , Keisuke Kinoshita , Tsubasa Ochiai , Katerina Zmolikova , Hiroshi Sato , Tomohiro Nakatani

Target speaker extraction (TSE) is a technique for isolating a target speaker's voice from mixed speech using auxiliary features associated with the target speaker. It is another attempt at addressing the cocktail party problem and is…

声音 · 计算机科学 2024-11-26 Chang Sun , Bo Qin

This paper presents a novel approach to target speaker extraction (TSE) using Curriculum Learning (CL) techniques, addressing the challenge of distinguishing a target speaker's voice from a mixture containing interfering speakers. For…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

Target speech extraction (TSE) focuses on extracting the speech of a specific target speaker from a mixture of signals. Existing TSE models typically utilize static embeddings as conditions for extracting the target speaker's voice.…

声音 · 计算机科学 2024-12-11 Yiwen Wang , Zeyu Yuan , Xihong Wu

Common target sound extraction (TSE) approaches primarily relied on discriminative approaches in order to separate the target sound while minimizing interference from the unwanted sources, with varying success in separating the target from…

音频与语音处理 · 电气工程与系统科学 2023-10-11 Jiarui Hai , Helin Wang , Dongchao Yang , Karan Thakkar , Najim Dehak , Mounya Elhilali