中文
相关论文

相关论文: Exploring Speaker Diarization with Mixture of Expe…

200 篇论文

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

We propose a separation guided speaker diarization (SGSD) approach by fully utilizing a complementarity of speech separation and speaker clustering. Since the conventional clustering-based speaker diarization (CSD) approach cannot well…

音频与语音处理 · 电气工程与系统科学 2021-07-07 Shu-Tong Niu , Jun Du , Lei Sun , Chin-Hui Lee

Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialized output training…

音频与语音处理 · 电气工程与系统科学 2025-06-09 Yuke Lin , Ming Cheng , Ze Li , Beilong Tang , Ming Li

In this paper two different approaches to enhance the performance of the most challenging component of a Speaker Diarization system are presented, i.e. the speaker clustering part. A processing step is proposed enhancing the input features…

音频与语音处理 · 电气工程与系统科学 2019-09-04 Dimitrios Dimitriadis

This paper proposes novel algorithms for speaker embedding using subjective inter-speaker similarity based on deep neural networks (DNNs). Although conventional DNN-based speaker embedding such as a $d$-vector can be applied to…

音频与语音处理 · 电气工程与系统科学 2019-07-22 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

In recent years, end-to-end approaches have made notable progress in addressing the challenge of speaker diarization, which involves segmenting and identifying speakers in multi-talker recordings. One such approach, Encoder-Decoder…

声音 · 计算机科学 2025-06-09 David Palzer , Matthew Maciejewski , Eric Fosler-Lussier

Modern speaker recognition systems represent utterances by embedding vectors. Conventional embedding vectors are dense and non-structural. In this paper, we propose an ordered binary embedding approach that sorts the dimensions of the…

声音 · 计算机科学 2023-05-26 Jiaying Wang , Xianglong Wang , Namin Wang , Lantian Li , Dong Wang

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

声音 · 计算机科学 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

This paper describes the TSUP team's submission to the ISCSLP 2022 conversational short-phrase speaker diarization (CSSD) challenge which particularly focuses on short-phrase conversations with a new evaluation metric called conversational…

声音 · 计算机科学 2023-10-26 Bowen Pang , Huan Zhao , Gaosheng Zhang , Xiaoyue Yang , Yang Sun , Li Zhang , Qing Wang , Lei Xie

Despite the recent success of deep learning for many speech processing tasks, single-microphone, speaker-independent speech separation remains challenging for two main reasons. The first reason is the arbitrary order of the target and…

声音 · 计算机科学 2018-04-19 Yi Luo , Zhuo Chen , Nima Mesgarani

Recently, hyperspherical embeddings have established themselves as a dominant technique for face and voice recognition. Specifically, Euclidean space vector embeddings are learned to encode person-specific information in their direction…

音频与语音处理 · 电气工程与系统科学 2022-10-25 Nikita Kuzmin , Igor Fedorov , Alexey Sholokhov

Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode…

音频与语音处理 · 电气工程与系统科学 2021-01-12 Miquel India , Pooyan Safari , Javier Hernando

In this paper, different online speaker diarization systems are evaluated on the same hardware with the same test data with regard to their latency. The latency is the time span from audio input to the output of the corresponding speaker…

计算与语言 · 计算机科学 2024-07-08 Roman Aperdannier , Sigurd Schacht , Alexander Piazza

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

音频与语音处理 · 电气工程与系统科学 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Speaker diarization, the task of segmenting an audio recording based on speaker identity, constitutes an important speech pre-processing step for several downstream applications.The conventional approach to diarization involves multiple…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Prachi Singh , Sriram Ganapathy

End-to-end models are fast replacing the conventional hybrid models in automatic speech recognition. Transformer, a sequence-to-sequence model, based on self-attention popularly used in machine translation tasks, has given promising results…

音频与语音处理 · 电气工程与系统科学 2021-11-19 Vishwas M. Shetty , Metilda Sagaya Mary N J , S. Umesh

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped…

音频与语音处理 · 电气工程与系统科学 2021-06-11 Hervé Bredin , Antoine Laurent

Single domain generalization (SDG) has recently attracted growing attention in medical image segmentation. One promising strategy for SDG is to leverage consistent semantic shape priors across different imaging protocols, scanner vendors,…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Jia Wei , Xiaoqi Zhao , Jonghye Woo , Jinsong Ouyang , Georges El Fakhri , Qingyu Chen , Xiaofeng Liu

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

End-to-end neural diarization (EEND) with encoder-decoder-based attractors (EDA) is a promising method to handle the whole speaker diarization problem simultaneously with a single neural network. While the EEND model can produce all…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Robin Scheibler , Yusuke Kida , Tetsuji Ogawa