中文
相关论文

相关论文: Speaker Diarization using Two-pass Leave-One-Out G…

200 篇论文

The state-of-the-art speaker diarization systems use agglomerative hierarchical clustering (AHC) which performs the clustering of previously learned neural embeddings. While the clustering approach attempts to identify speaker clusters, the…

音频与语音处理 · 电气工程与系统科学 2021-04-07 Prachi Singh , Sriram Ganapathy

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

音频与语音处理 · 电气工程与系统科学 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

We propose a new method for speaker diarization that can handle overlapping speech with 2+ people. Our method is based on compositional embeddings [1]: Like standard speaker embedding methods such as x-vector [2], compositional embedding…

声音 · 计算机科学 2021-02-11 Zeqian Li , Jacob Whitehill

Speaker diarization is an important pre-processing step for many speech applications, and it aims to solve the "who spoke when" problem. Although the standard diarization systems can achieve satisfactory results in various scenarios, they…

音频与语音处理 · 电气工程与系统科学 2020-02-18 Zili Huang , Shinji Watanabe , Yusuke Fujita , Paola Garcia , Yiwen Shao , Daniel Povey , Sanjeev Khudanpur

Majority of speech signals across different scenarios are never available with well-defined audio segments containing only a single speaker. A typical conversation between two speakers consists of segments where their voices overlap,…

音频与语音处理 · 电气工程与系统科学 2022-05-20 Siddharth S. Nijhawan , Homayoon Beigi

This paper details our speaker diarization system designed for multi-domain, multi-microphone casual conversations. The proposed diarization pipeline uses weighted prediction error (WPE)-based dereverberation as a front end, then applies…

音频与语音处理 · 电气工程与系统科学 2023-09-25 Naohiro Tawara , Marc Delcroix , Atsushi Ando , Atsunori Ogawa

Speaker diarization (SD) is typically used with an automatic speech recognition (ASR) system to ascribe speaker labels to recognized words. The conventional approach reconciles outputs from independently optimized ASR and SD systems, where…

音频与语音处理 · 电气工程与系统科学 2023-06-20 Rohit Paturi , Sundararajan Srinivasan , Xiang Li

In speaker diarization, traditional clustering-based methods remain widely used in real-world applications. However, these methods struggle with the complex distribution of speaker embeddings and overlapping speech segments. To address…

声音 · 计算机科学 2025-06-04 Zhaoyang Li , Jie Wang , XiaoXiao Li , Wangjie Li , Longjie Luo , Lin Li , Qingyang Hong

In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consisting of similarity scores. These scores are computed between…

音频与语音处理 · 电气工程与系统科学 2021-09-15 Prachi Singh , Sriram Ganapathy

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

声音 · 计算机科学 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

Recently, hybrid systems of clustering and neural diarization models have been successfully applied in multi-party meeting analysis. However, current models always treat overlapped speaker diarization as a multi-label classification…

声音 · 计算机科学 2022-11-21 Zhihao Du , Shiliang Zhang , Siqi Zheng , Zhijie Yan

In this paper, different online speaker diarization systems are evaluated on the same hardware with the same test data with regard to their latency. The latency is the time span from audio input to the output of the corresponding speaker…

计算与语言 · 计算机科学 2024-07-08 Roman Aperdannier , Sigurd Schacht , Alexander Piazza

Attractor-based end-to-end diarization is achieving comparable accuracy to the carefully tuned conventional clustering-based methods on challenging datasets. However, the main drawback is that it cannot deal with the case where the number…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yawen Xue , Yuki Takashima , Yohei Kawaguchi

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

音频与语音处理 · 电气工程与系统科学 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu

Automatic speaker diarization techniques typically involve a two-stage processing approach where audio segments of fixed duration are converted to vector representations in the first stage. This is followed by an unsupervised clustering of…

音频与语音处理 · 电气工程与系统科学 2021-06-15 Prachi Singh , Sriram Ganapathy

Significant progress has recently been made in speaker diarisation after the introduction of d-vectors as speaker embeddings extracted from neural network (NN) speaker classifiers for clustering speech segments. To extract better-performing…

声音 · 计算机科学 2021-05-10 Guangzhi Sun , Chao Zhang , Phil Woodland

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

机器学习 · 计算机科学 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

We propose a separation guided speaker diarization (SGSD) approach by fully utilizing a complementarity of speech separation and speaker clustering. Since the conventional clustering-based speaker diarization (CSD) approach cannot well…

音频与语音处理 · 电气工程与系统科学 2021-07-07 Shu-Tong Niu , Jun Du , Lei Sun , Chin-Hui Lee

In this study, we propose a new spectral clustering framework that can auto-tune the parameters of the clustering algorithm in the context of speaker diarization. The proposed framework uses normalized maximum eigengap (NME) values to…

音频与语音处理 · 电气工程与系统科学 2020-06-29 Tae Jin Park , Kyu J. Han , Manoj Kumar , Shrikanth Narayanan

For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio…

音频与语音处理 · 电气工程与系统科学 2022-01-25 Quan Wang , Carlton Downey , Li Wan , Philip Andrew Mansfield , Ignacio Lopez Moreno