English
Related papers

Related papers: Low-Latency Online Speaker Diarization with Graph-…

200 papers

The LEAP submission for DIHARD-III challenge is described in this paper. The proposed system is composed of a speech bandwidth classifier, and diarization systems fine-tuned for narrowband and wideband speech separately. We use an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Prachi Singh , Rajat Varma , Venkat Krishnamohan , Srikanth Raj Chetupalli , Sriram Ganapathy

Speaker embeddings (x-vectors) extracted from very short segments of speech have recently been shown to give competitive performance in speaker diarization. We generalize this recipe by extracting from each speech segment, in parallel with…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-09 Anna Silnova , Niko Brümmer , Johan Rohdin , Themos Stafylakis , Lukáš Burget

This report presents the system developed by the ABSP Laboratory team for the third DIHARD speech diarization challenge. Our main contribution in this work is to develop a simple and efficient solution for acoustic domain dependent speech…

Sound · Computer Science 2021-01-26 A Kishore Kumar , Shefali Waldekar , Goutam Saha , Md Sahidullah

Automatic speaker diarization techniques typically involve a two-stage processing approach where audio segments of fixed duration are converted to vector representations in the first stage. This is followed by an unsupervised clustering of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Prachi Singh , Sriram Ganapathy

Speaker diarization is a task to label an audio or video recording with the identity of the speaker at each given time stamp. In this work, we propose a novel machine learning framework to conduct real-time multi-speaker diarization and…

Sound · Computer Science 2023-02-23 Baihan Lin , Xinxin Zhang

We present an end-to-end deep network model that performs meeting diarization from single-channel audio recordings. End-to-end diarization models have the advantage of handling speaker overlap and enabling straightforward handling of…

Sound · Computer Science 2021-05-06 Soumi Maiti , Hakan Erdogan , Kevin Wilson , Scott Wisdom , Shinji Watanabe , John R. Hershey

The performance of speaker verification degrades significantly in adverse acoustic environments with strong reverberation and noise. To address this issue, this paper proposes a spatial-temporal graph convolutional network (GCN) method for…

Sound · Computer Science 2023-07-06 Yijiang Chen , Chengdong Liang , Xiao-Lei Zhang

This paper describes the ByteDance speaker diarization system for the fourth track of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). The VoxSRC-21 provides both the dev set and test set of VoxConverse for use in validation and…

Sound · Computer Science 2021-09-07 Keke Wang , Xudong Mao , Hao Wu , Chen Ding , Chuxiang Shang , Rui Xia , Yuxuan Wang

This report describes the speaker diarization system developed by the ABSP Laboratory team for the third DIHARD speech diarization challenge. Our primary contribution is to develop acoustic domain identification (ADI) system for speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 A Kishore Kumar , Shefali Waldekar , Goutam Saha , Md Sahidullah

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

In this paper we describe a speaker diarization system that enables localization and identification of all speakers present in a conversation or meeting. We propose a novel systematic approach to tackle several long-standing challenges in…

Sound · Computer Science 2021-07-21 Siqi Zheng , Weilong Huang , Xianliang Wang , Hongbin Suo , Jinwei Feng , Zhijie Yan

Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Marc Delcroix , Naohiro Tawara , Mireia Diez , Federico Landini , Anna Silnova , Atsunori Ogawa , Tomohiro Nakatani , Lukas Burget , Shoko Araki

Speaker identification in noisy audio recordings, specifically those from collaborative learning environments, can be extremely challenging. There is a need to identify individual students talking in small groups from other students talking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-05 Antonio Gomez

In this paper, we propose Discriminative Neural Clustering (DNC) that formulates data clustering with a maximum number of clusters as a supervised sequence-to-sequence learning problem. Compared to traditional unsupervised clustering…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-24 Qiujia Li , Florian L. Kreyssig , Chao Zhang , Philip C. Woodland

Most studies on speaker verification systems focus on long-duration utterances, which are composed of sufficient phonetic information. However, the performances of these systems are known to degrade when short-duration utterances are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Seung-bin Kim , Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Ha-Jin Yu

We present TagSpeech, a unified LLM-based framework that utilizes Temporal Anchor Grounding for joint multi-speaker ASR and diarization. The framework is built on two key designs: (1) decoupled semantic and speaker streams fine-tuned via…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 Mingyue Huo , Yiwen Shao , Yuheng Zhang

Target speaker extraction aims to isolate a specific speaker's voice from a composite of multiple sound sources, guided by an enrollment utterance or called anchor. Current methods predominantly derive speaker embeddings from the anchor and…

Sound · Computer Science 2024-01-08 Shulin He , Huaiwen Zhang , Wei Rao , Kanghao Zhang , Yukai Ju , Yang Yang , Xueliang Zhang

This paper investigates the utilization of an end-to-end diarization model as post-processing of conventional clustering-based diarization. Clustering-based diarization methods partition frames into clusters of the number of speakers; thus,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-24 Shota Horiguchi , Paola Garcia , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

Clustering-based speaker diarization has stood firm as one of the major approaches in reality, despite recent development in end-to-end diarization. However, clustering methods have not been explored extensively for speaker diarization.…

Sound · Computer Science 2022-04-27 Siqi Zheng , Hongbin Suo

Utilizing the large-scale unlabeled data from the target domain via pseudo-label clustering algorithms is an important approach for addressing domain adaptation problems in speaker verification tasks. In this paper, we propose a novel…

Sound · Computer Science 2023-05-23 Zhuo Li , Jingze Lu , Zhenduo Zhao , Wenchao Wang , Pengyuan Zhang