中文
相关论文

相关论文: Online End-to-End Neural Diarization with Speaker-…

200 篇论文

We present a Conformer-based end-to-end neural diarization (EEND) model that uses both acoustic input and features derived from an automatic speech recognition (ASR) model. Two categories of features are explored: features derived directly…

计算与语言 · 计算机科学 2022-07-13 Aparna Khare , Eunjung Han , Yuguang Yang , Andreas Stolcke

We propose a new end-to-end neural diarization (EEND) system that is based on Conformer, a recently proposed neural architecture that combines convolutional mappings and Transformer to model both local and global dependencies in speech. We…

计算与语言 · 计算机科学 2022-02-22 Yi Chieh Liu , Eunjung Han , Chul Lee , Andreas Stolcke

While standard speaker diarization attempts to answer the question "who spoken when", most of relevant applications in reality are more interested in determining "who spoken what". Whether it is the conventional modularized approach or the…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Yiling Huang , Weiran Wang , Guanlong Zhao , Hank Liao , Wei Xia , Quan Wang

In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a…

音频与语音处理 · 电气工程与系统科学 2025-01-29 Naijun Zheng , Xucheng Wan , Kai Liu , Zhou Huan

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings.…

音频与语音处理 · 电气工程与系统科学 2022-07-14 Weiqing Wang , Qingjian Lin , Ming Li

Speaker diarization is usually referred to as the task that determines ``who spoke when'' in a recording. Until a few years ago, all competitive approaches were modular. Systems based on this framework reached state-of-the-art performance…

音频与语音处理 · 电气工程与系统科学 2024-07-15 Federico Landini

In recent years, speaker diarization has attracted widespread attention. To achieve better performance, some studies propose to diarize speech in multiple stages. Although these methods might bring additional benefits, most of them are…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Jiangyu Han , Yuhang Cao , Heng Lu , Yanhua Long

Speaker diarization is connected to semantic segmentation in computer vision. Inspired from MaskFormer \cite{cheng2021per} which treats semantic segmentation as a set-prediction problem, we propose an end-to-end approach to predict a set of…

声音 · 计算机科学 2021-12-15 Yongquan Lai , Xin Tang , Yuanyuan Fu , Rui Fang

End-to-end neural diarization (EEND) is nowadays one of the most prominent research topics in speaker diarization. EEND presents an attractive alternative to standard cascaded diarization systems since a single system is trained at once to…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Federico Landini , Alicia Lozano-Diez , Mireia Diez , Lukáš Burget

We performed an experimental review of current diarization systems for the conversational telephone speech (CTS) domain. In detail, we considered a total of eight different algorithms belonging to clustering-based, end-to-end neural…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Luca Serafini , Samuele Cornell , Giovanni Morrone , Enrico Zovato , Alessio Brutti , Stefano Squartini

In this paper, we present a novel speaker diarization system for streaming on-device applications. In this system, we use a transformer transducer to detect the speaker turns, represent each speaker turn by a speaker embedding, then cluster…

音频与语音处理 · 电气工程与系统科学 2022-01-26 Wei Xia , Han Lu , Quan Wang , Anshuman Tripathi , Yiling Huang , Ignacio Lopez Moreno , Hasim Sak

Recent progress on end-to-end neural diarization (EEND) has enabled overlap-aware speaker diarization with a single neural network. This paper proposes to enhance EEND by using multi-channel signals from distributed microphones. We replace…

音频与语音处理 · 电气工程与系统科学 2022-03-29 Shota Horiguchi , Yuki Takashima , Paola Garcia , Shinji Watanabe , Yohei Kawaguchi

In this paper we describe a speaker diarization system that enables localization and identification of all speakers present in a conversation or meeting. We propose a novel systematic approach to tackle several long-standing challenges in…

声音 · 计算机科学 2021-07-21 Siqi Zheng , Weilong Huang , Xianliang Wang , Hongbin Suo , Jinwei Feng , Zhijie Yan

Recent speaker diarization studies showed that integration of end-to-end neural diarization (EEND) and clustering-based diarization is a promising approach for achieving state-of-the-art performance on various tasks. Such an approach first…

音频与语音处理 · 电气工程与系统科学 2022-07-29 Keisuke Kinoshita , Thilo von Neumann , Marc Delcroix , Christoph Boeddeker , Reinhold Haeb-Umbach

End-to-end neural diarization (EEND) with encoder-decoder-based attractors (EDA) is a promising method to handle the whole speaker diarization problem simultaneously with a single neural network. While the EEND model can produce all…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Robin Scheibler , Yusuke Kida , Tetsuji Ogawa

In this paper, we present state-of-the-art diarization error rates (DERs) on multiple publicly available datasets, including AliMeeting-far, AliMeeting-near, AMI-Mix, AMI-SDM, DIHARD III, and MagicData RAMC. Leveraging EEND-TA, a single…

声音 · 计算机科学 2025-09-19 Samuel J. Broughton , Lahiru Samarakoon

In this paper we propose a new method of speaker diarization that employs a deep learning architecture to learn speaker embeddings. In contrast to the traditional approaches that build their speaker embeddings using manually hand-crafted…

声音 · 计算机科学 2017-09-18 Pawel Cyrta , Tomasz Trzciński , Wojciech Stokowiec

This paper presents Transcribe-to-Diarize, a new approach for neural speaker diarization that uses an end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR). The E2E SA-ASR is a joint model that was recently proposed for…

音频与语音处理 · 电气工程与系统科学 2022-01-25 Naoyuki Kanda , Xiong Xiao , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

End-to-end speaker diarization enables accurate overlap-aware diarization by jointly estimating multiple speakers' speech activities in parallel. This approach is data-hungry, requiring a large amount of labeled conversational data, which…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Shota Horiguchi , Atsushi Ando , Marc Delcroix , Naohiro Tawara

In recent years, there have been studies to further improve the end-to-end neural speaker diarization (EEND) systems. This letter proposes the EEND-DEMUX model, a novel framework utilizing demultiplexed speaker embeddings. In this work, we…

音频与语音处理 · 电气工程与系统科学 2023-12-12 Sung Hwan Mun , Min Hyun Han , Canyeong Moon , Nam Soo Kim