中文
相关论文

相关论文: Low-Latency Online Speaker Diarization with Graph-…

200 篇论文

This paper presents a streaming extension for the Sortformer speaker diarization framework, whose key property is the arrival-time ordering of output speakers. The proposed approach employs an Arrival-Order Speaker Cache (AOSC) to store…

音频与语音处理 · 电气工程与系统科学 2025-07-25 Ivan Medennikov , Taejin Park , Weiqing Wang , He Huang , Kunal Dhawan , Jinhan Wang , Jagadeesh Balam , Boris Ginsburg

The performance of most speaker diarization systems with x-vector embeddings is both vulnerable to noisy environments and lacks domain robustness. Earlier work on speaker diarization using generative adversarial network (GAN) with an…

音频与语音处理 · 电气工程与系统科学 2020-07-21 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Tae Jin Park , So Hyun Kim , Catherine Lord , Somer Bishop , Shrikanth Narayanan

In this paper, we present a novel speaker diarization system for streaming on-device applications. In this system, we use a transformer transducer to detect the speaker turns, represent each speaker turn by a speaker embedding, then cluster…

音频与语音处理 · 电气工程与系统科学 2022-01-26 Wei Xia , Han Lu , Quan Wang , Anshuman Tripathi , Yiling Huang , Ignacio Lopez Moreno , Hasim Sak

Agglomerative hierarchical clustering (AHC) requires only the similarity between objects to be known. This is attractive when clustering signals of varying length, such as speech, which are not readily represented in fixed-dimensional…

机器学习 · 计算机科学 2018-10-31 Lerato Lerato , Thomas Niesler

Overlapped speech is notoriously problematic for speaker diarization systems. Consequently, the use of speech separation has recently been proposed to improve their performance. Although promising, speech separation models struggle with…

音频与语音处理 · 电气工程与系统科学 2024-02-02 Elio Gruttadauria , Mathieu Fontaine , Slim Essid

While recent research advances in speaker diarization mostly focus on improving the quality of diarization results, there is also an increasing interest in improving the efficiency of diarization systems. In this paper, we demonstrate that…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Quan Wang , Yiling Huang , Han Lu , Guanlong Zhao , Ignacio Lopez Moreno

Existing speaker diarization systems typically rely on large amounts of manually annotated data, which is labor-intensive and difficult to obtain, especially in real-world scenarios. Additionally, language-specific constraints in these…

音频与语音处理 · 电气工程与系统科学 2024-09-13 Phat Lam , Lam Pham , Truong Nguyen , Dat Ngo , Thinh Pham , Tin Nguyen , Loi Khanh Nguyen , Alexander Schindler

Speaker diarization remains challenging due to the need for structured speaker representations, efficient modeling, and robustness to varying conditions. We propose a performant, compact diarization framework that integrates conformer…

声音 · 计算机科学 2025-06-16 David Palzer , Matthew Maciejewski , Eric Fosler-Lussier

This paper describes system setup of our submission to speaker diarisation track (Track 4) of VoxCeleb Speaker Recognition Challenge 2020. Our diarisation system consists of a well-trained neural network based speech enhancement model as…

声音 · 计算机科学 2020-10-26 Renyu Wang , Ruilin Tong , Yu Ting Yeung , Xiao Chen

This paper describes a method for overlap-aware speaker diarization. Given an overlap detector and a speaker embedding extractor, our method performs spectral clustering of segments informed by the output of the overlap detector. This is…

音频与语音处理 · 电气工程与系统科学 2020-11-06 Desh Raj , Zili Huang , Sanjeev Khudanpur

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. In this paper, a hierarchical attention network is proposed to solve a weakly labelled speaker identification problem. The use of…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

This paper describes the Royalflush speaker diarization system submitted to the Multi-channel Multi-party Meeting Transcription Challenge(M2MeT). Our system comprises speech enhancement, overlapped speech detection, speaker embedding…

声音 · 计算机科学 2022-02-21 Jingguang Tian , Xinhui Hu , Xinkang Xu

The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high…

音频与语音处理 · 电气工程与系统科学 2025-01-31 Miquel India , Javier Hernando , José A. R. Fonollosa

With the rise in multimedia content over the years, more variety is observed in the recording environments of audio. An audio processing system might benefit when it has a module to identify the acoustic domain at its front-end. In this…

声音 · 计算机科学 2022-08-09 A Kishore Kumar , Shefali Waldekar , Md Sahidullah , Goutam Saha

Speaker identification in the household scenario (e.g., for smart speakers) is typically based on only a few enrollment utterances but a much larger set of unlabeled data, suggesting semisupervised learning to improve speaker profiles. We…

声音 · 计算机科学 2022-02-22 Long Chen , Venkatesh Ravichandran , Andreas Stolcke

This work presents a novel approach to leverage lexical information for speaker diarization. We introduce a speaker diarization system that can directly integrate lexical as well as acoustic information into a speaker clustering process.…

计算与语言 · 计算机科学 2019-01-08 Tae Jin Park , Kyu Han , Ian Lane , Panayiotis Georgiou

Speaker diarization aims to segment audio recordings into regions corresponding to individual speakers. Although unsupervised speaker diarization is inherently challenging, the prospect of identifying speaker regions without pretraining or…

音频与语音处理 · 电气工程与系统科学 2026-01-30 Nikhil Raghav , Avisek Gupta , Swagatam Das , Md Sahidullah

The objective of this work is effective speaker diarisation using multi-scale speaker embeddings. Typically, there is a trade-off between the ability to recognise short speaker segments and the discriminative power of the embedding,…

音频与语音处理 · 电气工程与系统科学 2021-10-11 Youngki Kwon , Hee-Soo Heo , Jee-weon Jung , You Jin Kim , Bong-Jin Lee , Joon Son Chung

While there has been substantial amount of work in speaker diarization recently, there are few efforts in jointly employing lexical and acoustic information for speaker segmentation. Towards that, we investigate a speaker diarization system…

音频与语音处理 · 电气工程与系统科学 2018-05-29 Tae Jin Park , Panayiotis Georgiou