English
Related papers

Related papers: Toeplitz Inverse Covariance based Robust Speaker C…

200 papers

Noise robustness in keyword spotting remains a challenge as many models fail to overcome the heavy influence of noises, causing the deterioration of the quality of feature embeddings. We proposed a contrastive regularization method called…

Sound · Computer Science 2022-09-15 Dianwen Ng , Jia Qi Yip , Tanmay Surana , Zhao Yang , Chong Zhang , Yukun Ma , Chongjia Ni , Eng Siong Chng , Bin Ma

This paper describes system setup of our submission to speaker diarisation track (Track 4) of VoxCeleb Speaker Recognition Challenge 2020. Our diarisation system consists of a well-trained neural network based speech enhancement model as…

Sound · Computer Science 2020-10-26 Renyu Wang , Ruilin Tong , Yu Ting Yeung , Xiao Chen

More and more neural network approaches have achieved considerable improvement upon submodules of speaker diarization system, including speaker change detection and segment-wise speaker embedding extraction. Still, in the clustering stage,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-02 Qingjian Lin , Ruiqing Yin , Ming Li , Hervé Bredin , Claude Barras

Zero-shot voice conversion (VC) converts source speech into the voice of any desired speaker using only one utterance of the speaker without requiring additional model updates. Typical methods use a speaker representation from a pre-trained…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Zhichao Wang , Liumeng Xue , Qiuqiang Kong , Lei Xie , Yuanzhe Chen , Qiao Tian , Yuping Wang

Current speaker diarization systems rely on an external voice activity detection model prior to speaker embedding extraction on the detected speech segments. In this paper, we establish that the attention system of a speaker embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-16 Jenthe Thienpondt , Kris Demuynck

In this paper, we propose a quality-aware end-to-end audio-visual neural speaker diarization framework, which comprises three key techniques. First, our audio-visual model takes both audio and visual features as inputs, utilizing a series…

Multimedia · Computer Science 2024-10-31 Mao-Kui He , Jun Du , Shu-Tong Niu , Qing-Feng Liu , Chin-Hui Lee

The predominant metric for evaluating speech recognizers, the Word Error Rate (WER) has been extended in different ways to handle transcripts produced by long-form multi-talker speech recognizers. These systems process long transcripts…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-05 Thilo von Neumann , Christoph Boeddeker , Marc Delcroix , Reinhold Haeb-Umbach

This paper proposes a method for extracting speaker embedding for each speaker from a variable-length recording containing multiple speakers. Speaker embeddings are crucial not only for speaker recognition but also for various multi-speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-02 Shota Horiguchi , Atsushi Ando , Takafumi Moriya , Takanori Ashihara , Hiroshi Sato , Naohiro Tawara , Marc Delcroix

Automatic meeting analysis comprises the tasks of speaker counting, speaker diarization, and the separation of overlapped speech, followed by automatic speech recognition. This all has to be carried out on arbitrarily long sessions and,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-22 Thilo von Neumann , Keisuke Kinoshita , Marc Delcroix , Shoko Araki , Tomohiro Nakatani , Reinhold Haeb-Umbach

Utterance clustering is one of the actively researched topics in audio signal processing and machine learning. This study aims to improve the performance of utterance clustering by processing multichannel (stereo) audio signals. Processed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-22 Yingjun Dong , Neil G. MacLaren , Yiding Cao , Francis J. Yammarino , Shelley D. Dionne , Michael D. Mumford , Shane Connelly , Hiroki Sayama , Gregory A. Ruark

Speaker verification has been studied mostly under the single-talker condition. It is adversely affected in the presence of interference speakers. Inspired by the study on target speaker extraction, e.g., SpEx, we propose a unified speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-05 Chenglin Xu , Wei Rao , Jibin Wu , Haizhou Li

We propose an algorithm to separate simultaneously speaking persons from each other, the "cocktail party problem", using a single microphone. Our approach involves a deep recurrent neural networks regression to a vector space that is…

Sound · Computer Science 2017-05-22 Cory Stephenson , Patrick Callier , Abhinav Ganesh , Karl Ni

The evolving speech processing landscape is increasingly focused on complex scenarios like meetings or cocktail parties with multiple simultaneous speakers and far-field conditions. Existing methodologies for addressing these challenges…

Speech Segmentation is the process change point detection for partitioning an input audio stream into regions each of which corresponds to only one audio source or one speaker. One application of this system is in Speaker Diarization…

Artificial Intelligence · Computer Science 2012-05-09 Behrouz Abdolali , Hossein Sameti

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

Speaker diarization has been mainly developed based on the clustering of speaker embeddings. However, the clustering-based approach has two major problems; i.e., (i) it is not optimized to minimize diarization errors directly, and (ii) it…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

This paper describes an effective unsupervised speaker indexing approach. We suggest a two stage algorithm to speed-up the state-of-the-art algorithm based on the Bayesian Information Criterion (BIC). In the first stage of the merging…

Sound · Computer Science 2010-09-27 Konstantin Biatov

Recent diarization technologies can be categorized into two approaches, i.e., clustering and end-to-end neural approaches, which have different pros and cons. The clustering-based approaches assign speaker labels to speech regions by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-08 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

In recent years, speaker diarization has attracted widespread attention. To achieve better performance, some studies propose to diarize speech in multiple stages. Although these methods might bring additional benefits, most of them are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Jiangyu Han , Yuhang Cao , Heng Lu , Yanhua Long

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu