中文
相关论文

相关论文: Systematic Evaluation of Online Speaker Diarizatio…

200 篇论文

Speaker diarization systems are challenged by a trade-off between the temporal resolution and the fidelity of the speaker representation. By obtaining a superior temporal resolution with an enhanced accuracy, a multi-scale approach is a way…

音频与语音处理 · 电气工程与系统科学 2022-03-31 Tae Jin Park , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

In multi-speaker applications is common to have pre-computed models from enrolled speakers. Using these models to identify the instances in which these speakers intervene in a recording is the task of speaker tracking. In this paper, we…

Peer-led team learning (PLTL) is a model for teaching STEM courses where small student groups meet periodically to collaboratively discuss coursework. Automatic analysis of PLTL sessions would help education researchers to get insight into…

声音 · 计算机科学 2016-06-24 Harishchandra Dubey , Lakshmish Kaushik , Abhijeet Sangwan , John H. L. Hansen

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped…

音频与语音处理 · 电气工程与系统科学 2021-06-11 Hervé Bredin , Antoine Laurent

State-of-the-art speaker diarization systems utilize knowledge from external data, in the form of a pre-trained distance metric, to effectively determine relative speaker identities to unseen data. However, much of recent focus has been on…

The objective of this work is effective speaker diarisation using multi-scale speaker embeddings. Typically, there is a trade-off between the ability to recognise short speaker segments and the discriminative power of the embedding,…

音频与语音处理 · 电气工程与系统科学 2021-10-11 Youngki Kwon , Hee-Soo Heo , Jee-weon Jung , You Jin Kim , Bong-Jin Lee , Joon Son Chung

In spite of the popularity of end-to-end diarization systems nowadays, modular systems comprised of voice activity detection (VAD), speaker embedding extraction plus clustering, and overlapped speech detection (OSD) plus handling still…

音频与语音处理 · 电气工程与系统科学 2024-11-05 Petr Pálka , Federico Landini , Dominik Klement , Mireia Diez , Anna Silnova , Marc Delcroix , Lukáš Burget

Deep speaker embedding models have been commonly used as a building block for speaker diarization systems; however, the speaker embedding model is usually trained according to a global loss defined on the training data, which could be…

音频与语音处理 · 电气工程与系统科学 2020-05-26 Jixuan Wang , Xiong Xiao , Jian Wu , Ranjani Ramamurthy , Frank Rudzicz , Michael Brudno

A robust multichannel speaker diarization and separation system is proposed by exploiting the spatio-temporal activity of the speakers. The system is realized in a hybrid architecture that combines the array signal processing units and the…

音频与语音处理 · 电气工程与系统科学 2024-01-31 Yicheng Hsu , Ssuhan Chen , Mingsian R. Bai

In this paper, we analyze the behavior and performance of speaker embeddings and the back-end scoring model under domain and language mismatch. We present our findings regarding ResNet-based speaker embedding architectures and show that…

音频与语音处理 · 电气工程与系统科学 2022-03-22 Anna Silnova , Themos Stafylakis , Ladislav Mosner , Oldrich Plchot , Johan Rohdin , Pavel Matejka , Lukas Burget , Ondrej Glembek , Niko Brummer

Speaker diarization is an essential step for processing multi-speaker audio. Although an end-to-end neural diarization (EEND) method achieved state-of-the-art performance, it is limited to a fixed number of speakers. In this paper, we solve…

音频与语音处理 · 电气工程与系统科学 2020-06-03 Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Yawen Xue , Jing Shi , Kenji Nagamatsu

The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high…

音频与语音处理 · 电气工程与系统科学 2025-01-31 Miquel India , Javier Hernando , José A. R. Fonollosa

In this paper, we present a novel speaker diarization system for streaming on-device applications. In this system, we use a transformer transducer to detect the speaker turns, represent each speaker turn by a speaker embedding, then cluster…

音频与语音处理 · 电气工程与系统科学 2022-01-26 Wei Xia , Han Lu , Quan Wang , Anshuman Tripathi , Yiling Huang , Ignacio Lopez Moreno , Hasim Sak

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

声音 · 计算机科学 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

This paper presents a streaming extension for the Sortformer speaker diarization framework, whose key property is the arrival-time ordering of output speakers. The proposed approach employs an Arrival-Order Speaker Cache (AOSC) to store…

音频与语音处理 · 电气工程与系统科学 2025-07-25 Ivan Medennikov , Taejin Park , Weiqing Wang , He Huang , Kunal Dhawan , Jinhan Wang , Jagadeesh Balam , Boris Ginsburg

This work presents a novel approach for speaker diarization to leverage lexical information provided by automatic speech recognition. We propose a speaker diarization system that can incorporate word-level speaker turn probabilities with…

音频与语音处理 · 电气工程与系统科学 2020-04-16 Tae Jin Park , Kyu J. Han , Jing Huang , Xiaodong He , Bowen Zhou , Panayiotis Georgiou , Shrikanth Narayanan

A method to perform offline and online speaker diarization for an unlimited number of speakers is described in this paper. End-to-end neural diarization (EEND) has achieved overlap-aware speaker diarization by formulating it as a…

音频与语音处理 · 电气工程与系统科学 2023-05-29 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yuki Takashima , Yohei Kawaguchi

This paper describes the system developed by the XMUSPEECH team for the Multi-channel Multi-party Meeting Transcription Challenge (M2MeT). For the speaker diarization task, we propose a multi-channel speaker diarization system that obtains…

音频与语音处理 · 电气工程与系统科学 2022-02-14 Jie Wang , Yuji Liu , Binling Wang , Yiming Zhi , Song Li1 , Shipeng Xia , Jiayang Zhang , Lin Li1 , Qingyang Hong , Feng Tong

Recent works show that speech separation guided diarization (SSGD) is an increasingly promising direction, mainly thanks to the recent progress in speech separation. It performs diarization by first separating the speakers and then applying…

音频与语音处理 · 电气工程与系统科学 2024-05-24 Giovanni Morrone , Samuele Cornell , Luca Serafini , Enrico Zovato , Alessio Brutti , Stefano Squartini

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

音频与语音处理 · 电气工程与系统科学 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy