English
Related papers

Related papers: Multi-Channel End-to-End Neural Diarization with D…

200 papers

End-to-end neural diarization (EEND) is nowadays one of the most prominent research topics in speaker diarization. EEND presents an attractive alternative to standard cascaded diarization systems since a single system is trained at once to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Federico Landini , Alicia Lozano-Diez , Mireia Diez , Lukáš Burget

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

Sound · Computer Science 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

We propose a new end-to-end neural diarization (EEND) system that is based on Conformer, a recently proposed neural architecture that combines convolutional mappings and Transformer to model both local and global dependencies in speech. We…

Computation and Language · Computer Science 2022-02-22 Yi Chieh Liu , Eunjung Han , Chul Lee , Andreas Stolcke

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu

Recent diarization technologies can be categorized into two approaches, i.e., clustering and end-to-end neural approaches, which have different pros and cons. The clustering-based approaches assign speaker labels to speech regions by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-08 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

In this paper, we present a conditional multitask learning method for end-to-end neural speaker diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 Yuki Takashima , Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Paola García , Kenji Nagamatsu

Recently, we proposed a novel speaker diarization method called End-to-End-Neural-Diarization-vector clustering (EEND-vector clustering) that integrates clustering-based and end-to-end neural network-based diarization approaches into one…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-01 Keisuke Kinoshita , Marc Delcroix , Naohiro Tawara

In this paper, we propose a novel end-to-end neural-network-based speaker diarization method. Unlike most existing methods, our proposed method does not have separate modules for extraction and clustering of speaker representations.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Kenji Nagamatsu , Shinji Watanabe

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

Sound · Computer Science 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez

End-to-end neural diarization (EEND) with encoder-decoder-based attractors (EDA) is a promising method to handle the whole speaker diarization problem simultaneously with a single neural network. While the EEND model can produce all…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Robin Scheibler , Yusuke Kida , Tetsuji Ogawa

Due to the high performance of multi-channel speech processing, we can use the outputs from a multi-channel model as teacher labels when training a single-channel model with knowledge distillation. To the contrary, it is also known that…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Shota Horiguchi , Yuki Takashima , Shinji Watanabe , Paola Garcia

This paper investigates a method for simulating natural conversation in the model training of end-to-end neural diarization (EEND). Due to the lack of any annotated real conversational dataset, EEND is usually pretrained on a large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Natsuo Yamashita , Shota Horiguchi , Takeshi Homma

This paper investigates an end-to-end neural diarization (EEND) method for an unknown number of speakers. In contrast to the conventional cascaded approach to speaker diarization, EEND methods are better in terms of speaker overlap…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-29 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Paola Garcia

In this paper, we present a novel framework that jointly performs three tasks: speaker diarization, speech separation, and speaker counting. Our proposed framework integrates speaker diarization based on end-to-end neural diarization (EEND)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-19 Soumi Maiti , Yushi Ueda , Shinji Watanabe , Chunlei Zhang , Meng Yu , Shi-Xiong Zhang , Yong Xu

We present an end-to-end deep network model that performs meeting diarization from single-channel audio recordings. End-to-end diarization models have the advantage of handling speaker overlap and enabling straightforward handling of…

Sound · Computer Science 2021-05-06 Soumi Maiti , Hakan Erdogan , Kevin Wilson , Scott Wisdom , Shinji Watanabe , John R. Hershey

Overlapping speech diarization has been traditionally treated as a multi-label classification problem. In this paper, we reformulate this task as a single-label prediction problem by encoding multiple binary labels into a single label with…

Sound · Computer Science 2022-04-01 Zhihao Du , Shiliang Zhang , Siqi Zheng , Zhijie Yan

End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-27 Federico Landini , Mireia Diez , Alicia Lozano-Diez , Lukáš Burget

This paper investigates the utilization of an end-to-end diarization model as post-processing of conventional clustering-based diarization. Clustering-based diarization methods partition frames into clusters of the number of speakers; thus,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-24 Shota Horiguchi , Paola Garcia , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

End-to-End Neural Diarization with Encoder-Decoder based Attractor (EEND-EDA) is an end-to-end neural model for automatic speaker segmentation and labeling. It achieves the capability to handle flexible number of speakers by estimating the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-22 PeiYing Lee , HauYun Guo , Berlin Chen

End-to-end neural diarization (EEND) models offer significant improvements over traditional embedding-based Speaker Diarization (SD) approaches but falls short on generalizing to long-form audio with large number of speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Xiang Li , Vivek Govindan , Rohit Paturi , Sundararajan Srinivasan
‹ Prev 1 2 3 10 Next ›