English
Related papers

Related papers: Privacy-preserving Automatic Speaker Diarization

200 papers

Most of the existing speaker anonymization research has focused on single-speaker audio, leading to the development of techniques and evaluation metrics optimized for such condition. This study addresses the significant challenge of speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-13 Natalia Tomashenko , Junichi Yamagishi , Xin Wang , Yun Liu , Emmanuel Vincent

Anomalous sound detection (ASD) benchmarks typically assume that the identity of the monitored machine is known at test time and that recordings are evaluated in a machine-wise manner. However, in realistic monitoring scenarios with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-14 Kevin Wilkinghoff , Keisuke Imoto , Zheng-Hua Tan

The fast increase of web services and mobile apps, which collect personal data from users, increases the risk that their privacy may be severely compromised. In particular, the increasing variety of spoken language interfaces and voice…

With the wide use of Automatic Speech Recognition (ASR) in applications such as human machine interaction, simultaneous interpretation, audio transcription, etc., its security protection becomes increasingly important. Although recent…

Cryptography and Security · Computer Science 2021-08-02 Yuxuan Chen , Jiangshan Zhang , Xuejing Yuan , Shengzhi Zhang , Kai Chen , Xiaofeng Wang , Shanqing Guo

This paper proposes a novel online speaker diarization algorithm based on a fully supervised self-attention mechanism (SA-EEND). Online diarization inherently presents a speaker's permutation problem due to the possibility to assign speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Yawen Xue , Shota Horiguchi , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

Speaker extraction and diarization are two enabling techniques for real-world speech applications. Speaker extraction aims to extract a target speaker's voice from a speech mixture, while speaker diarization demarcates speech segments by…

Sound · Computer Science 2025-01-17 Junyi Ao , Mehmet Sinan Yıldırım , Ruijie Tao , Meng Ge , Shuai Wang , Yanmin Qian , Haizhou Li

The common target speech separation directly estimate the target source, ignoring the interrelationship between different speakers at each frame. We propose a multiple-target speech separation model (MTSS) to simultaneously extract each…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Bang Zeng , Hongbing Suo , Yulong Wan , Ming Li

In the age of personal voice assistants, the question of privacy arises. These digital companions often lack memory of past interactions, while relying heavily on the internet for speech processing, raising privacy concerns. Modern…

Human-Computer Interaction · Computer Science 2024-01-03 Gérard Chollet , Hugues Sansen , Yannis Tevissen , Jérôme Boudy , Mossaab Hariz , Christophe Lohr , Fathy Yassa

Communication efficiency and privacy protection are two critical issues in distributed machine learning. Existing methods tackle these two issues separately and may have a high implementation complexity that constrains their application in…

Machine Learning · Computer Science 2023-04-27 Guangfeng Yan , Tan Li , Kui Wu , Linqi Song

Emotion plays a significant role in speech interaction, conveyed through tone, pitch, and rhythm, enabling the expression of feelings and intentions beyond words to create a more personalized experience. However, most existing speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Jixun Yao , Hexin Liu , Eng Siong Chng , Lei Xie

In the era of big data, remarkable advancements have been achieved in personalized speech generation techniques that utilize speaker attributes, including voice and speaking style, to generate deepfake speech. This has also amplified global…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Liping Chen , Kong Aik Lee , Zhen-Hua Ling , Xin Wang , Rohan Kumar Das , Tomoki Toda , Haizhou Li

Speaker-role diarization (RD), such as doctor vs. patient or lawyer vs. client, is practically often more useful than conventional speaker diarization (SD), which assigns only generic labels (speaker-1, speaker-2). The state-of-the-art…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-23 Arindam Ghosh , Mark Fuhs , Bongjun Kim , Anurag Chowdhury , Monika Woszczyna

Current synthetic speech detection (SSD) methods perform well on certain datasets but still face issues of robustness and interpretability. A possible reason is that these methods do not analyze the deficiencies of synthetic speech. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Yuxiang Zhang , Zhuo Li , Jingze Lu , Wenchao Wang , Pengyuan Zhang

Automatic speech verification (ASV) is the technology to determine the identity of a person based on their voice. While being convenient for identity verification, we should aim for the highest system security standard given that it is the…

Machine Learning · Computer Science 2020-12-16 Shentong Mo , Haofan Wang , Pinxu Ren , Ta-Chung Chi

Accurate recognition of dysarthric and elderly speech remains challenging to date. While privacy concerns have driven a shift from centralized approaches to federated learning (FL) to ensure data confidentiality, this further exacerbates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Tao Zhong , Mengzhe Geng , Shujie Hu , Guinan Li , Xunying Liu

Automatic speech recognition (ASR) is a key area in computational linguistics, focusing on developing technologies that enable computers to convert spoken language into text. This field combines linguistics and machine learning. ASR models,…

Computation and Language · Computer Science 2024-06-27 Anish Saha , A. G. Ramakrishnan

Traditional speaker diarization seeks to detect ``who spoke when'' according to speaker characteristics. Extending to target speech diarization, we detect ``when target event occurs'' according to the semantic characteristics of speech. We…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Yidi Jiang , Ruijie Tao , Zhengyang Chen , Yanmin Qian , Haizhou Li

The widespread adoption of voice-activated systems has modified routine human-machine interaction but has also introduced new vulnerabilities. This paper investigates the susceptibility of automatic speech recognition (ASR) algorithms in…

Cryptography and Security · Computer Science 2024-04-09 Forrest McKee , David Noever

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings. By…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-16 Weiqing Wang , Ming Li

Speaker-attributed automatic speech recognition (SA-ASR) aims to transcribe speech while assigning transcripts to the corresponding speakers accurately. Existing methods often rely on complex modular systems or require extensive fine-tuning…

Computation and Language · Computer Science 2025-01-16 Thai-Binh Nguyen , Alexander Waibel