中文
相关论文

相关论文: Multi-class Spectral Clustering with Overlaps for …

200 篇论文

Obtaining high-quality speaker embeddings in multi-speaker conditions is crucial for many applications. A recently proposed guided speaker embedding framework, which utilizes speech activities of target and non-target speakers as clues,…

音频与语音处理 · 电气工程与系统科学 2025-06-17 Shota Horiguchi , Takanori Ashihara , Marc Delcroix , Atsushi Ando , Naohiro Tawara

We propose a new method for speaker diarization that can handle overlapping speech with 2+ people. Our method is based on compositional embeddings [1]: Like standard speaker embedding methods such as x-vector [2], compositional embedding…

声音 · 计算机科学 2021-02-11 Zeqian Li , Jacob Whitehill

In this paper, we present the submitted system for the second DIHARD Speech Diarization Challenge from the DKULENOVO team. Our diarization system includes multiple modules, namely voice activity detection (VAD), segmentation, speaker…

音频与语音处理 · 电气工程与系统科学 2020-05-06 Qingjian Lin , Weicheng Cai , Lin Yang , Junjie Wang , Jun Zhang , Ming Li

In many real-world scenarios, such as meetings, multiple speakers are present with an unknown number of participants, and their utterances often overlap. We address these multi-speaker challenges by a novel attention-based encoder-decoder…

计算与语言 · 计算机科学 2024-09-25 Yosuke Kashiwagi , Hayato Futami , Emiru Tsunoo , Siddhant Arora , Shinji Watanabe

Diarization is a crucial component in meeting transcription systems to ease the challenges of speech enhancement and attribute the transcriptions to the correct speaker. Particularly in the presence of overlapping or noisy speech, these…

音频与语音处理 · 电气工程与系统科学 2024-06-06 Christoph Boeddeker , Tobias Cord-Landwehr , Reinhold Haeb-Umbach

Speaker diarization has been mainly developed based on the clustering of speaker embeddings. However, the clustering-based approach has two major problems; i.e., (i) it is not optimized to minimize diarization errors directly, and (ii) it…

音频与语音处理 · 电气工程与系统科学 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

Deep clustering is a deep neural network-based speech separation algorithm that first trains the mixed component of signals with high-dimensional embeddings, and then uses a clustering algorithm to separate each mixture of sources. In this…

音频与语音处理 · 电气工程与系统科学 2019-01-16 Soyeon Choe , Soo-Whan Chung , Youna Ji , Hong-Goo Kang

Significant performance degradation of automatic speech recognition (ASR) systems is observed when the audio signal contains cross-talk. One of the recently proposed approaches to solve the problem of multi-speaker ASR is the deep…

声音 · 计算机科学 2019-09-26 Tobias Menne , Ilya Sklyar , Ralf Schlüter , Hermann Ney

Using a Teacher-Student training approach we developed a speaker embedding extraction system that outputs embeddings at frame rate. Given this high temporal resolution and the fact that the student produces sensible speaker embeddings even…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

We recently proposed DOVER-Lap, a method for combining overlap-aware speaker diarization system outputs. DOVER-Lap improved upon its predecessor DOVER by using a label mapping method based on globally-informed greedy search. In this paper,…

音频与语音处理 · 电气工程与系统科学 2021-06-07 Desh Raj , Sanjeev Khudanpur

The performance of speaker diarization is strongly affected by its clustering algorithm at the test stage. However, it is known that clustering algorithms are sensitive to random noises and small variations, particularly when the clustering…

音频与语音处理 · 电气工程与系统科学 2019-10-25 Meng-Zhen Li , Xiao-Lei Zhang

Recent diarization technologies can be categorized into two approaches, i.e., clustering and end-to-end neural approaches, which have different pros and cons. The clustering-based approaches assign speaker labels to speech regions by…

音频与语音处理 · 电气工程与系统科学 2021-02-08 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

In this paper, we propose a fully supervised speaker diarization approach, named unbounded interleaved-state recurrent neural networks (UIS-RNN). Given extracted speaker-discriminative embeddings (a.k.a. d-vectors) from input utterances,…

音频与语音处理 · 电气工程与系统科学 2019-02-20 Aonan Zhang , Quan Wang , Zhenyao Zhu , John Paisley , Chong Wang

Speaker diarization, the task of segmenting an audio recording based on speaker identity, constitutes an important speech pre-processing step for several downstream applications.The conventional approach to diarization involves multiple…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Prachi Singh , Sriram Ganapathy

This study examines domain effects in speaker diarization for African-accented English. We evaluate multiple production and open systems on general and clinical dialogues under a strict DER protocol that scores overlap. A consistent domain…

计算与语言 · 计算机科学 2025-09-29 Chibuzor Okocha , Kelechi Ezema , Christan Grant

Speaker diarization aims to segment audio recordings into regions corresponding to individual speakers. Although unsupervised speaker diarization is inherently challenging, the prospect of identifying speaker regions without pretraining or…

音频与语音处理 · 电气工程与系统科学 2026-01-30 Nikhil Raghav , Avisek Gupta , Swagatam Das , Md Sahidullah

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings. By…

音频与语音处理 · 电气工程与系统科学 2023-10-16 Weiqing Wang , Ming Li

We propose a separation guided speaker diarization (SGSD) approach by fully utilizing a complementarity of speech separation and speaker clustering. Since the conventional clustering-based speaker diarization (CSD) approach cannot well…

音频与语音处理 · 电气工程与系统科学 2021-07-07 Shu-Tong Niu , Jun Du , Lei Sun , Chin-Hui Lee

Speaker diarization systems segment a conversation recording based on the speakers' identity. Such systems can misclassify the speaker of a portion of audio due to a variety of factors, such as speech pattern variation, background noise,…

声音 · 计算机科学 2024-06-26 Anurag Chowdhury , Abhinav Misra , Mark C. Fuhs , Monika Woszczyna

This paper describes the system developed by the XMUSPEECH team for the Multi-channel Multi-party Meeting Transcription Challenge (M2MeT). For the speaker diarization task, we propose a multi-channel speaker diarization system that obtains…

音频与语音处理 · 电气工程与系统科学 2022-02-14 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li1 , Shipeng Xia , Jiayang Zhang , Lin Li1 , Qingyang Hong , Feng Tong