English
Related papers

Related papers: Speaker detection in the wild: Lessons learned fro…

200 papers

In spite of the popularity of end-to-end diarization systems nowadays, modular systems comprised of voice activity detection (VAD), speaker embedding extraction plus clustering, and overlapped speech detection (OSD) plus handling still…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Petr Pálka , Federico Landini , Dominik Klement , Mireia Diez , Anna Silnova , Marc Delcroix , Lukáš Burget

Diarization is a crucial component in meeting transcription systems to ease the challenges of speech enhancement and attribute the transcriptions to the correct speaker. Particularly in the presence of overlapping or noisy speech, these…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Christoph Boeddeker , Tobias Cord-Landwehr , Reinhold Haeb-Umbach

In this paper, we present a novel training method for speaker change detection models. Speaker change detection is often viewed as a binary sequence labelling problem. The main challenges with this approach are the vagueness of annotated…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-17 Joonas Kalda , Tanel Alumäe

Speaker identification, determining which character said each utterance in literary text, benefits many downstream tasks. Most existing approaches use expert-defined rules or rule-based features to directly approach this task, but these…

Computation and Language · Computer Science 2022-10-13 Ben Zhou , Dian Yu , Dong Yu , Dan Roth

Recently, hybrid systems of clustering and neural diarization models have been successfully applied in multi-party meeting analysis. However, current models always treat overlapped speaker diarization as a multi-label classification…

Sound · Computer Science 2022-11-21 Zhihao Du , Shiliang Zhang , Siqi Zheng , Zhijie Yan

Strong representations of target speakers can help extract important information about speakers and detect corresponding temporal regions in multi-speaker conversations. In this study, we propose a neural architecture that simultaneously…

Sound · Computer Science 2023-06-07 Chin-Yi Cheng , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has been an unsolved…

This paper summarises the findings from the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22), which was held in conjunction with INTERSPEECH 2022. The goal of this challenge was to evaluate how well state-of-the-art speaker…

In this paper two different approaches to enhance the performance of the most challenging component of a Speaker Diarization system are presented, i.e. the speaker clustering part. A processing step is proposed enhancing the input features…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-04 Dimitrios Dimitriadis

Traditional speech separation and speaker diarization approaches rely on prior knowledge of target speakers or a predetermined number of participants in audio signals. To address these limitations, recent advances focus on developing…

Speaker diarization, the process of identifying "who spoke when" in audio recordings, is essential for understanding classroom dynamics. However, classroom settings present distinct challenges, including poor recording quality, high levels…

Sound · Computer Science 2025-05-28 Ali Sartaz Khan , Tolulope Ogunremi , Ahmed Adel Attia , Dorottya Demszky

In multilingual societies, social conversations often involve code-mixed speech. The current speech technology may not be well equipped to extract information from multi-lingual multi-speaker conversations. The DISPLACE challenge entails a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Shikha Baghel , Shreyas Ramoji , Sidharth , Ranjana H , Prachi Singh , Somil Jain , Pratik Roy Chowdhuri , Kaustubh Kulkarni , Swapnil Padhi , Deepu Vijayasenan , Sriram Ganapathy

The Speaker Diarization and Recognition (SDR) task aims to predict "who spoke when and what" within an audio clip, which is a crucial task in various real-world multi-speaker scenarios such as meeting transcription and dialogue systems.…

Sound · Computer Science 2026-01-06 Han Yin , Yafeng Chen , Chong Deng , Luyao Cheng , Hui Wang , Chao-Hong Tan , Qian Chen , Wen Wang , Xiangang Li

Automating child speech analysis is crucial for applications such as neurocognitive assessments. Speaker diarization, which identifies ``who spoke when'', is an essential component of the automated analysis. However, publicly available…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Tiantian Feng , Helen Tager-Flusberg , Catherine Lord , Shrikanth Narayanan

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without…

Sound · Computer Science 2024-12-02 Amit Kumar Bhuyan , Hrishikesh Dutta , Subir Biswas

With the rise in multimedia content over the years, more variety is observed in the recording environments of audio. An audio processing system might benefit when it has a module to identify the acoustic domain at its front-end. In this…

Sound · Computer Science 2022-08-09 A Kishore Kumar , Shefali Waldekar , Md Sahidullah , Goutam Saha

We present a modular toolkit to perform joint speaker diarization and speaker identification. The toolkit can leverage on multiple models and algorithms which are defined in a configuration file. Such flexibility allows our system to work…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Giovanni Morrone , Enrico Zovato , Fabio Brugnara , Enrico Sartori , Leonardo Badino

This paper describes the Microsoft speaker diarization system for monaural multi-talker recordings in the wild, evaluated at the diarization track of the VoxCeleb Speaker Recognition Challenge(VoxSRC) 2020. We will first explain our system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Xiong Xiao , Naoyuki Kanda , Zhuo Chen , Tianyan Zhou , Takuya Yoshioka , Sanyuan Chen , Yong Zhao , Gang Liu , Yu Wu , Jian Wu , Shujie Liu , Jinyu Li , Yifan Gong

As the French, European and worldwide populations are aging, there is a strong interest for new systems that guarantee a reliable and privacy preserving home monitoring for frailty prevention. This work is a part of a global environmental…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Yannis Tevissen , Dan Istrate , Vincent Zalc , Jérôme Boudy , Gérard Chollet , Frédéric Petitpont , Sami Boutamine

This paper introduces the third DIHARD challenge, the third in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variation in recording equipment, noise conditions, and conversational…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Neville Ryant , Kenneth Church , Christopher Cieri , Jun Du , Sriram Ganapathy , Mark Liberman