English
Related papers

Related papers: In search of strong embedding extractors for speak…

200 papers

Recent advancements in speaker verification techniques show promise, but their performance often deteriorates significantly in challenging acoustic environments. Although speech enhancement methods can improve perceived audio quality, they…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Adam Katav , Yair Moshe , Israel Cohen

We introduce a monaural neural speaker embeddings extractor that computes an embedding for each speaker present in a speech mixture. To allow for supervised training, a teacher-student approach is employed: the teacher computes the target…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

Since its introduction in 2019, the whole end-to-end neural diarization (EEND) line of work has been addressing speaker diarization as a frame-wise multi-label classification problem with permutation-invariant training. Despite EEND showing…

Sound · Computer Science 2023-10-23 Alexis Plaquet , Hervé Bredin

Sharing real-world speech utterances is key to the training and deployment of voice-based services. However, it also raises privacy risks as speech contains a wealth of personal data. Speaker anonymization aims to remove speaker information…

Speaker extraction aims to mimic humans' selective auditory attention by extracting a target speaker's voice from a multi-talker environment. It is common to perform the extraction in frequency-domain, and reconstruct the time-domain signal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-20 Chenglin Xu , Wei Rao , Eng Siong Chng , Haizhou Li

In this paper, different online speaker diarization systems are evaluated on the same hardware with the same test data with regard to their latency. The latency is the time span from audio input to the output of the corresponding speaker…

Computation and Language · Computer Science 2024-07-08 Roman Aperdannier , Sigurd Schacht , Alexander Piazza

Target speaker extraction (TSE) relies on a reference cue of the target to extract the target speech from a speech mixture. While a speaker embedding is commonly used as the reference cue, such embedding pre-trained with a large number of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-12 Ke Zhang , Junjie Li , Shuai Wang , Yangjie Wei , Yi Wang , Yannan Wang , Haizhou Li

We propose an algorithm to denoise speakers from a single microphone in the presence of non-stationary and dynamic noise. Our approach is inspired by the recent success of neural network models separating speakers from other speakers and…

Sound · Computer Science 2018-05-01 Jeff Hetherly , Paul Gamble , Maria Barrios , Cory Stephenson , Karl Ni

Recent speaker diarization studies showed that integration of end-to-end neural diarization (EEND) and clustering-based diarization is a promising approach for achieving state-of-the-art performance on various tasks. Such an approach first…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-29 Keisuke Kinoshita , Thilo von Neumann , Marc Delcroix , Christoph Boeddeker , Reinhold Haeb-Umbach

This paper proposes the target speaker enhancement based speaker verification network (TASE-SVNet), an all neural model that couples target speaker enhancement and speaker embedding extraction for robust speaker verification (SV).…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-17 Chunlei Zhang , Meng Yu , Chao Weng , Dong Yu

In speaker diarisation, speaker embedding extraction models often suffer from the mismatch between their training loss functions and the speaker clustering method. In this paper, we propose the method of spectral clustering-aware learning…

Sound · Computer Science 2023-03-16 Evonne P. C. Lee , Guangzhi Sun , Chao Zhang , Philip C. Woodland

We consider the problem of speaker diarization, the problem of segmenting an audio recording of a meeting into temporal segments corresponding to individual speakers. The problem is rendered particularly difficult by the fact that we are…

Methodology · Statistics 2015-03-13 Emily B. Fox , Erik B. Sudderth , Michael I. Jordan , Alan S. Willsky

Recently, researchers have utilized neural network-based speaker embedding techniques in speaker-recognition tasks to identify speakers accurately. However, speaker-discriminative embeddings do not always represent speech features such as…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-24 Kwangje Baeg , Yeong-Gwan Kim , Young-Sub Han , Byoung-Ki Jeon

Speaker verification is a task of confirming an individual's identity through the analysis of their voice. Whispered speech differs from phonated speech in acoustic characteristics, which degrades the performance of speaker verification…

Sound · Computer Science 2026-05-08 Magdalena Gołębiowska , Piotr Syga

End-to-end neural diarization (EEND) models offer significant improvements over traditional embedding-based Speaker Diarization (SD) approaches but falls short on generalizing to long-form audio with large number of speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Xiang Li , Vivek Govindan , Rohit Paturi , Sundararajan Srinivasan

Speaker tracking methods often rely on spatial observations to assign coherent track identities over time. This raises limits in scenarios with intermittent and moving speakers, i.e., speakers that may change position when they are…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-26 Taous Iatariene , Can Cui , Alexandre Guérin , Romain Serizel

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

Target speaker extraction aims to isolate a specific speaker's voice from a composite of multiple sound sources, guided by an enrollment utterance or called anchor. Current methods predominantly derive speaker embeddings from the anchor and…

Sound · Computer Science 2024-01-08 Shulin He , Huaiwen Zhang , Wei Rao , Kanghao Zhang , Yukai Ju , Yang Yang , Xueliang Zhang

In the era of advanced artificial intelligence and human-computer interaction, identifying emotions in spoken language is paramount. This research explores the integration of deep learning techniques in speech emotion recognition, offering…

Sound · Computer Science 2023-10-20 Hanan Hamza , Fiza Gafoor , Fathima Sithara , Gayathri Anil , V. S. Anoop

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Hassan Taherian , DeLiang Wang