中文
相关论文

相关论文: Detect, Attend and Extract: Keyword Guided Target …

200 篇论文

Diffusion model-based speech enhancement has received increased attention since it can generate very natural enhanced signals and generalizes well to unseen conditions. Diffusion models have been explored for several sub-tasks of speech…

音频与语音处理 · 电气工程与系统科学 2023-08-21 Naoyuki Kamo , Marc Delcroix , Tomohiro Nakatani

In many situations, we would like to hear desired sound events (SEs) while being able to ignore interference. Target sound extraction (TSE) tackles this problem by estimating the audio signal of the sounds of target SE classes in a mixture…

音频与语音处理 · 电气工程与系统科学 2022-11-03 Marc Delcroix , Jorge Bennasar Vázquez , Tsubasa Ochiai , Keisuke Kinoshita , Yasunori Ohishi , Shoko Araki

We propose listen to extract (LExt), a highly-effective while extremely-simple algorithm for monaural target speaker extraction (TSE). Given an enrollment utterance of a target speaker, LExt aims at extracting the target speaker from the…

音频与语音处理 · 电气工程与系统科学 2025-11-06 Pengjie Shen , Kangrui Chen , Shulin He , Pengru Chen , Shuqi Yuan , He Kong , Xueliang Zhang , Zhong-Qiu Wang

Real-time target speaker extraction (TSE) is intended to extract the desired speaker's voice from the observed mixture of multiple speakers in a streaming manner. Implementing real-time TSE is challenging as the computational complexity…

音频与语音处理 · 电气工程与系统科学 2024-07-03 Hiroshi Sato , Takafumi Moriya , Masato Mimura , Shota Horiguchi , Tsubasa Ochiai , Takanori Ashihara , Atsushi Ando , Kentaro Shinayama , Marc Delcroix

Target speaker extraction focuses on isolating a specific speaker's voice from an audio mixture containing multiple speakers. To provide information about the target speaker's identity, prior works have utilized clean audio samples as…

声音 · 计算机科学 2025-12-09 Shitong Xu , Yiyuan Yang , Niki Trigoni , Andrew Markham

Target speaker extraction (TSE) relies on a reference cue of the target to extract the target speech from a speech mixture. While a speaker embedding is commonly used as the reference cue, such embedding pre-trained with a large number of…

音频与语音处理 · 电气工程与系统科学 2024-12-12 Ke Zhang , Junjie Li , Shuai Wang , Yangjie Wei , Yi Wang , Yannan Wang , Haizhou Li

Target speaker extraction (TSE) focuses on isolating the speech of a specific target speaker from overlapped multi-talker speech, which is a typical setup in the cocktail party problem. In recent years, TSE draws increasing attention due to…

音频与语音处理 · 电气工程与系统科学 2024-09-25 Shuai Wang , Ke Zhang , Shaoxiong Lin , Junjie Li , Xuefei Wang , Meng Ge , Jianwei Yu , Yanmin Qian , Haizhou Li

Sound separation (SS) and target sound extraction (TSE) are fundamental techniques for addressing complex acoustic scenarios. While existing SS methods struggle with determining the unknown number of sound sources, TSE approaches require…

音频与语音处理 · 电气工程与系统科学 2025-12-25 Hongyu Wang , Chenda Li , Xin Zhou , Shuai Wang , Yanmin Qian

Humans can easily isolate a single speaker from a complex acoustic environment, a capability referred to as the "Cocktail Party Effect." However, replicating this ability has been a significant challenge in the field of target speaker…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Xiang Hao , Jibin Wu , Jianwei Yu , Chenglin Xu , Kay Chen Tan

Target speaker extraction (TSE) aims to isolate a specific speaker's voice from multi-speaker mixtures. Despite strong benchmark results, real-world performance often degrades due to different interacting factors. Previous curriculum…

声音 · 计算机科学 2026-03-06 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

Previously, Target Speaker Extraction (TSE) has yielded outstanding performance in certain application scenarios for speech enhancement and source separation. However, obtaining auxiliary speaker-related information is still challenging in…

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

This paper proposes the target speaker enhancement based speaker verification network (TASE-SVNet), an all neural model that couples target speaker enhancement and speaker embedding extraction for robust speaker verification (SV).…

音频与语音处理 · 电气工程与系统科学 2021-03-17 Chunlei Zhang , Meng Yu , Chao Weng , Dong Yu

Target speaker extraction (TSE) aims to isolate a desired speaker's voice from a multi-speaker mixture using auxiliary information such as a reference utterance. Although recent advances in diffusion and flow-matching models have improved…

音频与语音处理 · 电气工程与系统科学 2025-12-23 Riki Shimizu , Xilin Jiang , Nima Mesgarani

This paper investigates the use of relative cues for text-based target speech extraction (TSE). We first provide a theoretical justification for relative cues from the perspectives of human perception and label quantization, showing that…

音频与语音处理 · 电气工程与系统科学 2026-04-03 Wang Dai , Archontis Politis , Tuomas Virtanen

This paper presents a novel approach to target speaker extraction (TSE) using Curriculum Learning (CL) techniques, addressing the challenge of distinguishing a target speaker's voice from a mixture containing interfering speakers. For…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Yun Liu , Xuechen Liu , Xiaoxiao Miao , Junichi Yamagishi

Audio-visual target speaker extraction (AV-TSE) models primarily rely on visual cues from the target speaker. However, humans also leverage linguistic knowledge, such as syntactic constraints, next word prediction, and prior knowledge of…

声音 · 计算机科学 2025-11-11 Wenxuan Wu , Shuai Wang , Xixin Wu , Helen Meng , Haizhou Li

Target speaker extraction (TSE) is a technique for isolating a target speaker's voice from mixed speech using auxiliary features associated with the target speaker. It is another attempt at addressing the cocktail party problem and is…

声音 · 计算机科学 2024-11-26 Chang Sun , Bo Qin

Target speaker extraction (TSE) aims to isolate individual speaker voices from complex speech environments. The effectiveness of TSE systems is often compromised when the speaker characteristics are similar to each other. Recent research…

声音 · 计算机科学 2024-10-08 Yun Liu , Xuechen Liu , Junichi Yamagishi

Target speaker extraction (TSE) aims to recover a target speaker's speech from a mixture using a reference utterance as a cue. Most TSE systems adopt conditional auto-encoder architectures with one-step inference. Inspired by test-time…

声音 · 计算机科学 2026-03-12 Zhenghai You , Ying Shi , Lantian Li , Dong Wang