中文
相关论文

相关论文: Improving Transformer-based End-to-End Speaker Dia…

200 篇论文

End-to-End Neural Diarization with Encoder-Decoder based Attractor (EEND-EDA) is an end-to-end neural model for automatic speaker segmentation and labeling. It achieves the capability to handle flexible number of speakers by estimating the…

音频与语音处理 · 电气工程与系统科学 2024-03-22 PeiYing Lee , HauYun Guo , Berlin Chen

End-to-end neural diarization (EEND) with self-attention directly predicts speaker labels from inputs and enables the handling of overlapped speech. Although the EEND outperforms clustering-based speaker diarization (SD), it cannot be…

音频与语音处理 · 电气工程与系统科学 2022-09-27 Yechan Yu , Dongkeon Park , Hong Kook Kim

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

声音 · 计算机科学 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

We propose a new end-to-end neural diarization (EEND) system that is based on Conformer, a recently proposed neural architecture that combines convolutional mappings and Transformer to model both local and global dependencies in speech. We…

计算与语言 · 计算机科学 2022-02-22 Yi Chieh Liu , Eunjung Han , Chul Lee , Andreas Stolcke

We present a Conformer-based end-to-end neural diarization (EEND) model that uses both acoustic input and features derived from an automatic speech recognition (ASR) model. Two categories of features are explored: features derived directly…

计算与语言 · 计算机科学 2022-07-13 Aparna Khare , Eunjung Han , Yuguang Yang , Andreas Stolcke

This paper describes a speaker diarization model based on target speaker voice activity detection (TS-VAD) using transformers. To overcome the original TS-VAD model's drawback of being unable to handle an arbitrary number of speakers, we…

音频与语音处理 · 电气工程与系统科学 2022-09-27 Dongmei Wang , Xiong Xiao , Naoyuki Kanda , Takuya Yoshioka , Jian Wu

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly, (ii) it cannot…

音频与语音处理 · 电气工程与系统科学 2020-03-09 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu

End-to-end neural diarization (EEND) with encoder-decoder-based attractors (EDA) is a promising method to handle the whole speaker diarization problem simultaneously with a single neural network. While the EEND model can produce all…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Robin Scheibler , Yusuke Kida , Tetsuji Ogawa

While standard speaker diarization attempts to answer the question "who spoken when", most of relevant applications in reality are more interested in determining "who spoken what". Whether it is the conventional modularized approach or the…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Yiling Huang , Weiran Wang , Guanlong Zhao , Hank Liao , Wei Xia , Quan Wang

This paper proposes a novel Attention-based Encoder-Decoder network for End-to-End Neural speaker Diarization (AED-EEND). In AED-EEND system, we incorporate the target speaker enrollment information used in target speaker voice activity…

声音 · 计算机科学 2023-08-16 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

声音 · 计算机科学 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped…

音频与语音处理 · 电气工程与系统科学 2021-06-11 Hervé Bredin , Antoine Laurent

In this paper, we present a conditional multitask learning method for end-to-end neural speaker diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Yuki Takashima , Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Paola García , Kenji Nagamatsu

Speaker diarization has been mainly developed based on the clustering of speaker embeddings. However, the clustering-based approach has two major problems; i.e., (i) it is not optimized to minimize diarization errors directly, and (ii) it…

音频与语音处理 · 电气工程与系统科学 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

In this paper, we present a novel framework that jointly performs three tasks: speaker diarization, speech separation, and speaker counting. Our proposed framework integrates speaker diarization based on end-to-end neural diarization (EEND)…

音频与语音处理 · 电气工程与系统科学 2022-12-19 Soumi Maiti , Yushi Ueda , Shinji Watanabe , Chunlei Zhang , Meng Yu , Shi-Xiong Zhang , Yong Xu

In this paper, we propose a novel end-to-end neural-network-based speaker diarization method. Unlike most existing methods, our proposed method does not have separate modules for extraction and clustering of speaker representations.…

音频与语音处理 · 电气工程与系统科学 2019-09-16 Yusuke Fujita , Naoyuki Kanda , Shota Horiguchi , Kenji Nagamatsu , Shinji Watanabe

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is…

音频与语音处理 · 电气工程与系统科学 2020-10-06 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Kenji Nagamatsu

This paper proposes a novel online speaker diarization algorithm based on a fully supervised self-attention mechanism (SA-EEND). Online diarization inherently presents a speaker's permutation problem due to the possibility to assign speaker…

音频与语音处理 · 电气工程与系统科学 2021-03-09 Yawen Xue , Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

Recent progress on end-to-end neural diarization (EEND) has enabled overlap-aware speaker diarization with a single neural network. This paper proposes to enhance EEND by using multi-channel signals from distributed microphones. We replace…

音频与语音处理 · 电气工程与系统科学 2022-03-29 Shota Horiguchi , Yuki Takashima , Paola Garcia , Shinji Watanabe , Yohei Kawaguchi

Speaker diarization is a task concerned with partitioning an audio recording by speaker identity. End-to-end neural diarization with encoder-decoder based attractor calculation (EEND-EDA) aims to solve this problem by directly outputting…

声音 · 计算机科学 2023-06-27 Samuel J. Broughton , Lahiru Samarakoon
‹ 上一页 1 2 3 10 下一页 ›