English
Related papers

Related papers: SpEx: Multi-Scale Time Domain Speaker Extraction N…

200 papers

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

Speech separation has been very successful with deep learning techniques. Substantial effort has been reported based on approaches over spectrogram, which is well known as the standard time-and-frequency cross-domain representation for…

Sound · Computer Science 2019-04-17 Gene-Ping Yang , Chao-I Tuan , Hung-Yi Lee , Lin-shan Lee

We propose an explainable probabilistic framework for characterizing spoofed speech by decomposing it into probabilistic attribute embeddings. Unlike raw high-dimensional countermeasure embeddings, which lack interpretability, the proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Jagabandhu Mishra , Manasi Chhibber , Hye-jin Shim , Tomi H. Kinnunen

Speaker embedding extractors significantly influence the performance of clustering-based speaker diarisation systems. Conventionally, only one embedding is extracted from each speech segment. However, because of the sliding window approach,…

Sound · Computer Science 2022-11-09 Hee-Soo Heo , Youngki Kwon , Bong-Jin Lee , You Jin Kim , Jee-weon Jung

In this study, we propose a modulation decoupling based single channel speech enhancement subspace framework, in which the spectrogram of noisy speech is decoupled as the product of a spectral envelop subspace and a spectral details…

Sound · Computer Science 2017-02-24 Pengfei Sun , Jun Qin

We propose listen to extract (LExt), a highly-effective while extremely-simple algorithm for monaural target speaker extraction (TSE). Given an enrollment utterance of a target speaker, LExt aims at extracting the target speaker from the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-06 Pengjie Shen , Kangrui Chen , Shulin He , Pengru Chen , Shuqi Yuan , He Kong , Xueliang Zhang , Zhong-Qiu Wang

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

Target Speaker Extraction (TSE) aims to extract the clean speech of the target speaker in an audio mixture, eliminating irrelevant background noise and speech. While prior work has explored various auxiliary cues including pre-recorded…

Sound · Computer Science 2026-04-28 Ziyang Jiang , Jiahe Lei , Xueyan Chen , Yifan Zhang , Zexu Pan , Wei Xue , Xinyuan Qian

Speaker verification aims to verify whether an input speech corresponds to the claimed speaker, and conventionally, this kind of system is deployed based on single-stream scenario, wherein the feature extractor operates in full frequency…

Sound · Computer Science 2025-09-03 Wei Yao , Shen Chen , Jiamin Cui , Yaolin Lou

Speaker identification typically involves three stages. First, a front-end speaker embedding model is trained to embed utterance and speaker profiles. Second, a scoring function is applied between a runtime utterance and each speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Zhenning Tan , Yuguang Yang , Eunjung Han , Andreas Stolcke

Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information. However, in the task of target speech extraction, certain elements of global and local semantic information in the…

Sound · Computer Science 2024-08-27 Zhaoxi Mu , Xinyu Yang , Sining Sun , Qing Yang

This paper presents a robust multi-channel speaker extraction algorithm designed to handle inaccuracies in reference information. While existing approaches often rely solely on either spatial or spectral cues to identify the target speaker,…

Sound · Computer Science 2025-12-24 Aviad Eisenberg , Sharon Gannot , Shlomo E. Chazan

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

Sound · Computer Science 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Speech enhancement aims to improve the perceptual quality of the speech signal by suppression of the background noise. However, excessive suppression may lead to speech distortion and speaker information loss, which degrades the performance…

Sound · Computer Science 2021-10-05 Yi Ma , Kong Aik Lee , Ville Hautamaki , Haizhou Li

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

Speaker verification has been studied mostly under the single-talker condition. It is adversely affected in the presence of interference speakers. Inspired by the study on target speaker extraction, e.g., SpEx, we propose a unified speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-05 Chenglin Xu , Wei Rao , Jibin Wu , Haizhou Li

Target speech extraction (TSE) systems are designed to extract target speech from a multi-talker mixture. The popular training objective for most prior TSE networks is to enhance reconstruction performance of extracted speech waveform.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-10 Kai Liu , Ziqing Du , Xucheng Wan , Huan Zhou

Target Language Extraction aims to extract speech in a specific language from a mixture waveform that contains multiple speakers speaking different languages. The human auditory system is adept at performing this task with the knowledge of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Mehmet Sinan Yıldırım , Ruijie Tao , Wupeng Wang , Junyi Ao , Haizhou Li

The target speech extraction has attracted widespread attention in recent years. In this work, we focus on investigating the dynamic interaction between different mixtures and the target speaker to exploit the discriminative target speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-20 Jiangyu Han , Wei Rao , Yanhua Long , Jiaen Liang

Separating different speaker properties from a multi-speaker environment is challenging. Instead of separating a two-speaker signal in signal space like speech source separation, a speaker embedding de-mixing approach is proposed. The…

Sound · Computer Science 2021-02-08 Yanpei Shi , Thomas Hain