中文
相关论文

相关论文: Multi-Channel Sequence-to-Sequence Neural Diarizat…

200 篇论文

In this paper, we present a neural spoken language diarization model that supports an unconstrained span of languages within a single framework. Our approach integrates a learnable query-based architecture grounded in multilingual…

计算与语言 · 计算机科学 2025-10-02 Sangmin Lee , Woongjib Choi , Jihyun Kim , Hong-Goo Kang

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

机器学习 · 计算机科学 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

声音 · 计算机科学 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez

This paper presents our system submission for the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) Challenge, which focuses on speaker diarization and speech recognition in complex multi-speaker scenarios. To address these…

声音 · 计算机科学 2024-05-10 Jingguang Tian , Shuaishuai Ye , Shunfei Chen , Yang Xiang , Zhaohui Yin , Xinhui Hu , Xinkang Xu

The performance of speaker diarization is strongly affected by its clustering algorithm at the test stage. However, it is known that clustering algorithms are sensitive to random noises and small variations, particularly when the clustering…

音频与语音处理 · 电气工程与系统科学 2019-10-25 Meng-Zhen Li , Xiao-Lei Zhang

Neural speaker diarization is widely used for overlap-aware speaker diarization, but it requires large multi-speaker datasets for training. To meet this data requirement, large datasets are often constructed by combining multiple corpora,…

音频与语音处理 · 电气工程与系统科学 2025-08-26 Shota Horiguchi , Naohiro Tawara , Takanori Ashihara , Atsushi Ando , Marc Delcroix

Existing speaker diarization systems typically rely on large amounts of manually annotated data, which is labor-intensive and difficult to obtain, especially in real-world scenarios. Additionally, language-specific constraints in these…

音频与语音处理 · 电气工程与系统科学 2024-09-13 Phat Lam , Lam Pham , Truong Nguyen , Dat Ngo , Thinh Pham , Tin Nguyen , Loi Khanh Nguyen , Alexander Schindler

In this paper, we propose Discriminative Neural Clustering (DNC) that formulates data clustering with a maximum number of clusters as a supervised sequence-to-sequence learning problem. Compared to traditional unsupervised clustering…

音频与语音处理 · 电气工程与系统科学 2020-11-24 Qiujia Li , Florian L. Kreyssig , Chao Zhang , Philip C. Woodland

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

机器学习 · 计算机科学 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

音频与语音处理 · 电气工程与系统科学 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu

Automatic speaker diarization techniques typically involve a two-stage processing approach where audio segments of fixed duration are converted to vector representations in the first stage. This is followed by an unsupervised clustering of…

音频与语音处理 · 电气工程与系统科学 2021-06-15 Prachi Singh , Sriram Ganapathy

This report presents the system developed by the ABSP Laboratory team for the third DIHARD speech diarization challenge. Our main contribution in this work is to develop a simple and efficient solution for acoustic domain dependent speech…

声音 · 计算机科学 2021-01-26 A Kishore Kumar , Shefali Waldekar , Goutam Saha , Md Sahidullah

This paper investigates the utilization of an end-to-end diarization model as post-processing of conventional clustering-based diarization. Clustering-based diarization methods partition frames into clusters of the number of speakers; thus,…

音频与语音处理 · 电气工程与系统科学 2020-12-24 Shota Horiguchi , Paola Garcia , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

This paper describes SHNU multilingual conversational speech recognition system (SHNU-mASR, team name-"maybe"), submitted to Track 1 of the INTERSPEECH 2025 MLC-SLM Challenge. Our system integrates a parallel-speech-encoder architecture…

计算与语言 · 计算机科学 2025-07-09 Yuxiang Mei , Yuang Zheng , Dongxing Xu , Yanhua Long

This paper describes the ByteDance speaker diarization system for the fourth track of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). The VoxSRC-21 provides both the dev set and test set of VoxConverse for use in validation and…

声音 · 计算机科学 2021-09-07 Keke Wang , Xudong Mao , Hao Wu , Chen Ding , Chuxiang Shang , Rui Xia , Yuxuan Wang

In this report, we describe our submitted system for track 2 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). We fuse a variety of good-performing models ranging from supervised models to self-supervised learning(SSL)…

声音 · 计算机科学 2022-09-26 Gang Liu , Tianyan Zhou , Yong Zhao , Yu Wu , Zhuo Chen , Yao Qian , Jian Wu

Traditional speaker diarization seeks to detect ``who spoke when'' according to speaker characteristics. Extending to target speech diarization, we detect ``when target event occurs'' according to the semantic characteristics of speech. We…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Yidi Jiang , Ruijie Tao , Zhengyang Chen , Yanmin Qian , Haizhou Li

Attractor-based end-to-end diarization is achieving comparable accuracy to the carefully tuned conventional clustering-based methods on challenging datasets. However, the main drawback is that it cannot deal with the case where the number…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yawen Xue , Yuki Takashima , Yohei Kawaguchi

In this paper, we present our system developed by the team from the New Technologies for the Information Society (NTIS) research center of the University of West Bohemia in Pilsen, for the Second DIHARD Speech Diarization Challenge. The…

音频与语音处理 · 电气工程与系统科学 2019-09-26 Zbyněk Zajíc , Marie Kunešová , Marek Hrúz , Jan Vaněk

We introduce DIVE, an end-to-end speaker diarization algorithm. Our neural algorithm presents the diarization task as an iterative process: it repeatedly builds a representation for each speaker before predicting the voice activity of each…

声音 · 计算机科学 2021-05-31 Neil Zeghidour , Olivier Teboul , David Grangier