中文
相关论文

相关论文: Auto-Tuning Spectral Clustering for Speaker Diariz…

200 篇论文

Speaker diarization remains challenging due to the need for structured speaker representations, efficient modeling, and robustness to varying conditions. We propose a performant, compact diarization framework that integrates conformer…

声音 · 计算机科学 2025-06-16 David Palzer , Matthew Maciejewski , Eric Fosler-Lussier

Conventional methods for speaker diarization involve windowing an audio file into short segments to extract speaker embeddings, followed by an unsupervised clustering of the embeddings. This multi-step approach generates speaker assignments…

声音 · 计算机科学 2023-02-27 Prachi Singh , Amrit Kaul , Sriram Ganapathy

Many modern systems for speaker diarization, such as the recently-developed VBx approach, rely on clustering of DNN speaker embeddings followed by resegmentation. Two problems with this approach are that the DNN is not directly optimized…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Kiran Karra , Alan McCree

In the task of speaker diarization, the number of small-scale meetings accounts for a large proportion. When microphone arrays are employed as a recording device, its spatial information is usually ignored by most researchers. In this…

声音 · 计算机科学 2022-10-27 Yuxuan Du , Ruohua Zhou

This work presents a novel approach to leverage lexical information for speaker diarization. We introduce a speaker diarization system that can directly integrate lexical as well as acoustic information into a speaker clustering process.…

计算与语言 · 计算机科学 2019-01-08 Tae Jin Park , Kyu Han , Ian Lane , Panayiotis Georgiou

This paper investigates the utilization of an end-to-end diarization model as post-processing of conventional clustering-based diarization. Clustering-based diarization methods partition frames into clusters of the number of speakers; thus,…

音频与语音处理 · 电气工程与系统科学 2020-12-24 Shota Horiguchi , Paola Garcia , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

We address the problem of acoustic source separation in a deep learning framework we call "deep clustering." Rather than directly estimating signals or masking functions, we train a deep network to produce spectrogram embeddings that are…

神经与进化计算 · 计算机科学 2015-08-19 John R. Hershey , Zhuo Chen , Jonathan Le Roux , Shinji Watanabe

The goal of this paper is to adapt speaker embeddings for solving the problem of speaker diarisation. The quality of speaker embeddings is paramount to the performance of speaker diarisation systems. Despite this, prior works in the field…

音频与语音处理 · 电气工程与系统科学 2021-04-08 Youngki Kwon , Jee-weon Jung , Hee-Soo Heo , You Jin Kim , Bong-Jin Lee , Joon Son Chung

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings. By…

音频与语音处理 · 电气工程与系统科学 2023-10-16 Weiqing Wang , Ming Li

Majority of speech signals across different scenarios are never available with well-defined audio segments containing only a single speaker. A typical conversation between two speakers consists of segments where their voices overlap,…

音频与语音处理 · 电气工程与系统科学 2022-05-20 Siddharth S. Nijhawan , Homayoon Beigi

Recently, we proposed a novel speaker diarization method called End-to-End-Neural-Diarization-vector clustering (EEND-vector clustering) that integrates clustering-based and end-to-end neural network-based diarization approaches into one…

音频与语音处理 · 电气工程与系统科学 2021-09-01 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

For online speaker diarization, samples arrive incrementally, and the overall distribution of the samples is invisible. Moreover, in most existing clustering-based methods, the training objective of the embedding extractor is not designed…

音频与语音处理 · 电气工程与系统科学 2022-06-29 Yifan Chen , Yifan Guo , Qingxuan Li , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

We propose a new speaker diarization system based on a recently introduced unsupervised clustering technique namely, generative adversarial network mixture model (GANMM). The proposed system uses x-vectors as front-end representation.…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Shrikanth Narayanan

Recent studies have shown that pseudo labels can contribute to unsupervised domain adaptation (UDA) for speaker verification. Inspired by the self-training strategies that use an existing classifier to label the unlabeled data for…

机器学习 · 计算机科学 2023-06-21 Haiquan Mao , Feng Hong , Man-wai Mak

Speaker diarization has been investigated extensively as an important central task for meeting analysis. Recent trend shows that integration of end-to-end neural (EEND)-and clustering-based diarization is a promising approach to handle…

音频与语音处理 · 电气工程与系统科学 2022-02-15 Keisuke Kinoshita , Marc Delcroix , Tomoharu Iwata

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

声音 · 计算机科学 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

Speaker diarization, the task of segmenting an audio recording based on speaker identity, constitutes an important speech pre-processing step for several downstream applications.The conventional approach to diarization involves multiple…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Prachi Singh , Sriram Ganapathy

Spectral clustering has shown a superior performance in analyzing the cluster structure. However, its computational complexity limits its application in analyzing large-scale data. To address this problem, many low-rank matrix approximating…

机器学习 · 计算机科学 2020-07-23 Djallel Bouneffouf

Speaker diarization relies on the assumption that speech segments corresponding to a particular speaker are concentrated in a specific region of the speaker space; a region which represents that speaker's identity. These identities are not…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Nikolaos Flemotomos , Panayiotis Georgiou , Shrikanth Narayanan