English
Related papers

Related papers: Investigating Confidence Estimation Measures for S…

200 papers

Eavesdropping from the user's smartphone is a well-known threat to the user's safety and privacy. Existing studies show that loudspeaker reverberation can inject speech into motion sensor readings, leading to speech eavesdropping. While…

Sound · Computer Science 2022-12-26 Ahmed Tanvir Mahdad , Cong Shi , Zhengkun Ye , Tianming Zhao , Yan Wang , Yingying Chen , Nitesh Saxena

This work presents a novel approach to leverage lexical information for speaker diarization. We introduce a speaker diarization system that can directly integrate lexical as well as acoustic information into a speaker clustering process.…

Computation and Language · Computer Science 2019-01-08 Tae Jin Park , Kyu Han , Ian Lane , Panayiotis Georgiou

Detecting and mitigating bias in speaker verification systems is important, as datasets, processing choices and algorithms can lead to performance differences that systematically favour some groups of people while disadvantaging others.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-27 Wiebke Hutiri , Tanvina Patel , Aaron Yi Ding , Odette Scharenborg

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Speaker diarization of audio streams turns out to be particularly challenging when applied to fictional films, where many characters talk in various acoustic conditions (background music, sound effects, variations in intonation...). Despite…

Multimedia · Computer Science 2018-12-19 Xavier Bost , Georges Linares

In automatic speech processing systems, speaker diarization is a crucial front-end component to separate segments from different speakers. Inspired by the recent success of deep neural networks (DNNs) in semantic inferencing, triplet…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-07 Huan Song , Megan Willi , Jayaraman J. Thiagarajan , Visar Berisha , Andreas Spanias

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to their greater adaptability and robustness. Historically,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Ruoyu Wang , Shutong Niu , Gaobin Yang , Jun Du , Shuangqing Qian , Tian Gao , Jia Pan

In diarization, the PLDA is typically used to model an inference structure which assumes the variation in speech segments be induced by various speakers. The speaker variation is then learned from the training data. However, human…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-01 Jiamin Xie , Suzanna Sia , Paola Garcia , Daniel Povey , Sanjeev Khudanpur

In traditional speaker diarization systems, a well-trained speaker model is a key component to extract representations from consecutive and partially overlapping segments in a long speech session. To be more consistent with the back-end…

Sound · Computer Science 2022-04-01 Yu-Huai Peng , Hung-Shin Lee , Pin-Tuan Huang , Hsin-Min Wang

Attractor-based end-to-end diarization is achieving comparable accuracy to the carefully tuned conventional clustering-based methods on challenging datasets. However, the main drawback is that it cannot deal with the case where the number…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-24 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yawen Xue , Yuki Takashima , Yohei Kawaguchi

Speaker diarization is an important problem that is topical, and is especially useful as a preprocessor for conversational speech related applications. The objective of this paper is two-fold: (i) segment initialization by uniformly…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Nauman Dawalatabad , Srikanth Madikeri , C. Chandra Sekhar , Hema A. Murthy

Speaker diarization based on bottom-up clustering of speech segments by acoustic similarity is often highly sensitive to the choice of hyperparameters, such as the initial number of clusters and feature weighting. Optimizing these…

Computation and Language · Computer Science 2022-02-22 Andreas Stolcke

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

Sound · Computer Science 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

The media localization industry usually requires a verbatim script of the final film or TV production in order to create subtitles or dubbing scripts in a foreign language. In particular, the verbatim script (i.e. as-broadcast script) must…

Computation and Language · Computer Science 2023-08-07 Yogesh Virkar , Brian Thompson , Rohit Paturi , Sundararajan Srinivasan , Marcello Federico

Our focus lies in developing an online speaker diarisation framework which demonstrates robust performance across diverse domains. In online speaker diarisation, outputs generated in real-time are irreversible, and a few misjudgements in…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-10 Youngki Kwon , Hee-Soo Heo , Bong-Jin Lee , You Jin Kim , Jee-weon Jung

United States Courts make audio recordings of oral arguments available as public record, but these recordings rarely include speaker annotations. This paper addresses the Speech Audio Diarization problem, answering the question of "Who…

In this paper, different online speaker diarization systems are evaluated on the same hardware with the same test data with regard to their latency. The latency is the time span from audio input to the output of the corresponding speaker…

Computation and Language · Computer Science 2024-07-08 Roman Aperdannier , Sigurd Schacht , Alexander Piazza

Adolescent suicide is a critical global health issue, and speech provides a cost-effective modality for automatic suicide risk detection. Given the vulnerable population, protecting speaker identity is particularly important, as speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Ziyun Cui , Sike Jia , Yang Lin , Yinan Duan , Diyang Qu , Runsen Chen , Chao Zhang , Chang Lei , Wen Wu

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Hassan Taherian , DeLiang Wang