中文
相关论文

相关论文: Speaker diarisation using 2D self-attentive combin…

200 篇论文

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

声音 · 计算机科学 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

声音 · 计算机科学 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

This paper proposes a serialized multi-layer multi-head attention for neural speaker embedding in text-independent speaker verification. In prior works, frame-level features from one layer are aggregated to form an utterance-level…

声音 · 计算机科学 2021-07-15 Hongning Zhu , Kong Aik Lee , Haizhou Li

Current speaker diarization systems rely on an external voice activity detection model prior to speaker embedding extraction on the detected speech segments. In this paper, we establish that the attention system of a speaker embedding…

音频与语音处理 · 电气工程与系统科学 2024-05-16 Jenthe Thienpondt , Kris Demuynck

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

音频与语音处理 · 电气工程与系统科学 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

In spite of the popularity of end-to-end diarization systems nowadays, modular systems comprised of voice activity detection (VAD), speaker embedding extraction plus clustering, and overlapped speech detection (OSD) plus handling still…

音频与语音处理 · 电气工程与系统科学 2024-11-05 Petr Pálka , Federico Landini , Dominik Klement , Mireia Diez , Anna Silnova , Marc Delcroix , Lukáš Burget

Majority of speech signals across different scenarios are never available with well-defined audio segments containing only a single speaker. A typical conversation between two speakers consists of segments where their voices overlap,…

音频与语音处理 · 电气工程与系统科学 2022-05-20 Siddharth S. Nijhawan , Homayoon Beigi

One of the most popular speaker embeddings is x-vectors, which are obtained from an architecture that gradually builds a larger temporal context with layers. In this paper, we propose to derive speaker embeddings from Transformer's encoder…

音频与语音处理 · 电气工程与系统科学 2021-12-14 N J Metilda Sagaya Mary , S Umesh , Sandesh V Katta

In multi-speaker applications is common to have pre-computed models from enrolled speakers. Using these models to identify the instances in which these speakers intervene in a recording is the task of speaker tracking. In this paper, we…

Speaker diarisation systems nowadays use embeddings generated from speech segments in a bottleneck layer, which are needed to be discriminative for unseen speakers. It is well-known that large-margin training can improve the generalisation…

音频与语音处理 · 电气工程与系统科学 2020-07-07 Yassir Fathullah , Chao Zhang , Philip C. Woodland

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to…

声音 · 计算机科学 2024-07-02 Juan Ignacio Alvarez-Trejos , Beltrán Labrador , Alicia Lozano-Diez

Speaker recognition deals with recognizing speakers by their speech. Most speaker recognition systems are built upon two stages, the first stage extracts low dimensional correlation embeddings from speech, and the second performs the…

Despite the recent success of deep learning for many speech processing tasks, single-microphone, speaker-independent speech separation remains challenging for two main reasons. The first reason is the arbitrary order of the target and…

声音 · 计算机科学 2018-04-19 Yi Luo , Zhuo Chen , Nima Mesgarani

An embedding-based speaker adaptive training (SAT) approach is proposed and investigated in this paper for deep neural network acoustic modeling. In this approach, speaker embedding vectors, which are a constant given a particular speaker,…

计算与语言 · 计算机科学 2017-10-20 Xiaodong Cui , Vaibhava Goel , George Saon

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is…

音频与语音处理 · 电气工程与系统科学 2020-10-06 Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Yawen Xue , Kenji Nagamatsu

This work presents a novel approach for speaker diarization to leverage lexical information provided by automatic speech recognition. We propose a speaker diarization system that can incorporate word-level speaker turn probabilities with…

音频与语音处理 · 电气工程与系统科学 2020-04-16 Tae Jin Park , Kyu J. Han , Jing Huang , Xiaodong He , Bowen Zhou , Panayiotis Georgiou , Shrikanth Narayanan

In this work, we propose deep latent space clustering for speaker diarization using generative adversarial network (GAN) backprojection with the help of an encoder network. The proposed diarization system is trained jointly with GAN loss,…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Tae Jin Park , So Hyun Kim , Catherine Lord , Somer Bishop , Shrikanth Narayanan

In the task of speaker diarization, the number of small-scale meetings accounts for a large proportion. When microphone arrays are employed as a recording device, its spatial information is usually ignored by most researchers. In this…

声音 · 计算机科学 2022-10-27 Yuxuan Du , Ruohua Zhou

Over the recent years, various deep learning-based embedding methods have been proposed and have shown impressive performance in speaker verification. However, as in most of the classical embedding techniques, the deep learning-based…

音频与语音处理 · 电气工程与系统科学 2020-08-10 Woo Hyun Kang , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

Attractor-based end-to-end diarization is achieving comparable accuracy to the carefully tuned conventional clustering-based methods on challenging datasets. However, the main drawback is that it cannot deal with the case where the number…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yawen Xue , Yuki Takashima , Yohei Kawaguchi