English
Related papers

Related papers: Privacy-Utility Balanced Voice De-Identification U…

200 papers

Adversarial examples have proven to threaten speaker identification systems, and several countermeasures against them have been proposed. In this paper, we propose a method to detect the presence of adversarial examples, i.e., a binary…

Sound · Computer Science 2024-03-01 Sonal Joshi , Thomas Thebaud , Jesús Villalba , Najim Dehak

Speech emotion sensing in communication networks has a wide range of applications in real life. In these applications, voice data are transmitted from the user to the central server for storage, processing, and decision making. However,…

Machine learning (ML) models are known to be vulnerable to adversarial examples. Applications of ML to voice biometrics authentication are no exception. Yet, the implications of audio adversarial examples on these real-world systems remain…

Disentangling speaker and content attributes of a speech signal into separate latent representations followed by decoding the content with an exchanged speaker representation is a popular approach for voice conversion, which can be trained…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-07 Michael Kuhlmann , Fritz Seebauer , Janek Ebbers , Petra Wagner , Reinhold Haeb-Umbach

Recent advancements in adversarial attacks have demonstrated their effectiveness in misleading speaker recognition models, making wrong predictions about speaker identities. On the other hand, defense techniques against speaker-adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-13 Liping Chen , Chenyang Guo , Kong Aik Lee , Zhen-Hua Ling , Wu Guo

Voice authentication has undergone significant changes from traditional systems that relied on handcrafted acoustic features to deep learning models that can extract robust speaker embeddings. This advancement has expanded its applications…

Cryptography and Security · Computer Science 2025-09-17 Kamel Kamel , Keshav Sood , Hridoy Sankar Dutta , Sunil Aryal

Speech data on the Internet are proliferating exponentially because of the emergence of social media, and the sharing of such personal data raises obvious security and privacy concerns. One solution to mitigate these concerns involves…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Jixun Yao , Qing Wang , Yi Lei , Pengcheng Guo , Lei Xie , Namin Wang , Jie Liu

Environmental sound recordings often contain intelligible speech, raising privacy concerns that limit analysis, sharing and reuse of data. In this paper, we introduce a method that renders speech unintelligible while preserving both the…

Sound · Computer Science 2025-07-14 Modan Tailleur , Mathieu Lagrange , Pierre Aumond , Vincent Tourre

Recent developments in large speech foundation models like Whisper have led to their widespread use in many automatic speech recognition (ASR) applications. These systems incorporate `special tokens' in their vocabulary, such as…

Computation and Language · Computer Science 2024-07-18 Vyas Raina , Rao Ma , Charles McGhee , Kate Knill , Mark Gales

Recently, cycle-consistent adversarial network (Cycle-GAN) has been successfully applied to voice conversion to a different speaker without parallel data, although in those approaches an individual model is needed for each target speaker.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-26 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee , Lin-shan Lee

With the rise of cameras and smart sensors, humanity generates an exponential amount of data. This valuable information, including underrepresented cases like AI in medical settings, can fuel new deep-learning tools. However, data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zikui Cai , Zhongpai Gao , Benjamin Planche , Meng Zheng , Terrence Chen , M. Salman Asif , Ziyan Wu

Automatic Speech Understanding (ASU) leverages the power of deep learning models for accurate interpretation of human speech, leading to a wide range of speech applications that enrich the human experience. However, training a robust ASU…

Sound · Computer Science 2023-06-14 Tiantian Feng , Digbalay Bose , Xuan Shi , Shrikanth Narayanan

The rapid proliferation of speech-enabled technologies, including virtual assistants, video conferencing platforms, and wearable devices, has raised significant privacy concerns, particularly regarding the inference of sensitive emotional…

Cryptography and Security · Computer Science 2025-02-11 Mohd. Farhan Israk Soumik , W. K. M. Mithsara , Abdur R. Shahid , Ahmed Imteaj

Speaker, author, and other biometric identification applications often compare a sample's similarity to a database of templates to determine the identity. Given that data may be noisy and similarity measures can be inaccurate, such a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-01 Tom Bäckström , Mohammad Hassan Vali , My Nguyen , Silas Rech

Voice anonymization techniques have been found to successfully obscure a speaker's acoustic identity in short, isolated utterances in benchmarks such as the VoicePrivacy Challenge. In practice, however, utterances seldom occur in isolation:…

Sound · Computer Science 2026-02-05 Cristina Aggazzotti , Ashi Garg , Zexin Cai , Nicholas Andrews

Speaker identification in multilingual settings presents unique challenges, particularly when conventional models are predominantly trained on English data. In this paper, we propose WSI (Whisper Speaker Identification), a framework that…

Sound · Computer Science 2025-03-14 Jakaria Islam Emon , Md Abu Salek , Kazi Tamanna Alam

Named Entity Recognition (NER) has been mostly studied in the context of written text. Specifically, NER is an important step in de-identification (de-ID) of medical records, many of which are recorded conversations between a patient and a…

Computation and Language · Computer Science 2019-05-07 Ido Cohn , Itay Laish , Genady Beryozkin , Gang Li , Izhak Shafran , Idan Szpektor , Tzvika Hartman , Avinatan Hassidim , Yossi Matias

This study investigated auditory self-recognition boundaries using AI voice morphing technology, examining when individuals cease recognizing their own voice. Through controlled morphing between participants' voices and demographically…

Human-Computer Interaction · Computer Science 2025-10-23 Kye Shimizu , Minghan Gao , Ananya Ganesh , Pattie Maes

Speaker attribute perturbation offers a feasible approach to asynchronous voice anonymization by employing adversarially perturbed speech as anonymized output. In order to enhance the identity unlinkability among anonymized utterances from…

Sound · Computer Science 2025-08-22 Liping Chen , Chenyang Guo , Rui Wang , Kong Aik Lee , Zhenhua Ling

Speech synthesis, voice cloning, and voice conversion techniques present severe privacy and security threats to users of voice user interfaces (VUIs). These techniques transform one or more elements of a speech signal, e.g., identity and…

Cryptography and Security · Computer Science 2021-07-23 Ranya Aloufi , Hamed Haddadi , David Boyle