English
Related papers

Related papers: Voice Privacy from an Attribute-based Perspective

200 papers

In this work, we address a novel, but potentially emerging, problem of discriminating the natural human voices and those played back by any kind of audio devices in the context of interactions with in-house voice user interface. The tackled…

Sound · Computer Science 2019-02-19 Thanh-Ha Le , Philippe Gilberton , Ngoc Q. K. Duong

We propose a novel approach for spoofed speech characterization through explainable probabilistic attribute embeddings. In contrast to high-dimensional raw embeddings extracted from a spoofing countermeasure (CM) whose dimensions are not…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Manasi Chhibber , Jagabandhu Mishra , Hyejin Shim , Tomi H. Kinnunen

Current speaker anonymization methods, especially with self-supervised learning (SSL) models, require massive computational resources when hiding speaker identity. This paper proposes an effective and parameter-efficient speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-20 Xiaojiao Chen , Sheng Li , Jiyi Li , Hao Huang , Yang Cao , Liang He

The quality of human voice plays an important role across various fields like music, speech therapy, and communication, yet it lacks a universally accepted, objective definition. Instead, voice quality is referred to using subjective…

Sound · Computer Science 2024-10-15 Hira Dhamyal , Rita Singh

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

While Audio Large Language Models (ALLMs) have achieved remarkable progress in understanding and generation, their potential privacy implications remain largely unexplored. This paper takes the first step to investigate whether ALLMs…

Computation and Language · Computer Science 2026-01-08 Jin Wang , Liang Lin , Kaiwen Luo , Weiliu Wang , Yitian Chen , Moayad Aloqaily , Xuehai Tang , Zhenhong Zhou , Kun Wang , Li Sun , Qingsong Wen

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda

Speaker recognition is a widely used voice-based biometric technology with applications in various industries, including banking, education, recruitment, immigration, law enforcement, healthcare, and well-being. However, while dataset…

Computers and Society · Computer Science 2023-08-21 Casandra Rusti , Anna Leschanowsky , Carolyn Quinlan , Michaela Pnacek , Lauriane Gorce , Wiebke Hutiri

Speaker anonymization aims to conceal a speaker's identity, without considering the linguistic content. In this study, we reveal a weakness of Librispeech, the dataset that is commonly used to evaluate anonymizers: the books read by the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Carlos Franzreb , Arnab Das , Tim Polzehl , Sebastian Möller

Sound event detection systems are widely used in various applications such as surveillance and environmental monitoring where data is automatically collected, processed, and sent to a cloud for sound recognition. However, this process may…

Sound · Computer Science 2024-01-04 Shayan Gharib , Minh Tran , Diep Luong , Konstantinos Drossos , Tuomas Virtanen

Unlike other data modalities such as text and vision, speech does not lend itself to easy interpretation. While lay people can understand how to describe an image or sentence via perception, non-expert descriptions of speech often end at…

Sound · Computer Science 2023-10-05 Robin Netzorg , Bohan Yu , Andrea Guzman , Peter Wu , Luna McNulty , Gopala Anumanchipalli

As Speech Language Models (SLMs) transition from personal devices to shared, multi-user environments such as smart homes, a new challenge emerges: the model is expected to distinguish between users to manage information flow appropriately.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-29 Yuxiang Wang , Hongyu Liu , Dekun Chen , Xueyao Zhang , Zhizheng Wu

Audio watermarking embeds auxiliary information into speech while maintaining speaker identity, linguistic content, and perceptual quality. Although recent advances in neural and digital signal processing-based watermarking methods have…

Sound · Computer Science 2026-03-17 Yigitcan Özer , Wanying Ge , Zhe Zhang , Xin Wang , Junichi Yamagishi

Users in various web and mobile applications are vulnerable to attribute inference attacks, in which an attacker leverages a machine learning classifier to infer a target user's private attributes (e.g., location, sexual orientation,…

Cryptography and Security · Computer Science 2020-04-15 Jinyuan Jia , Neil Zhenqiang Gong

Over the last few years, a rapidly increasing number of Internet-of-Things (IoT) systems that adopt voice as the primary user input have emerged. These systems have been shown to be vulnerable to various types of voice spoofing attacks.…

Cryptography and Security · Computer Science 2018-11-20 Yuan Gong , Christian Poellabauer

The First VoicePrivacy Attacker Challenge is a new kind of challenge organized as part of the VoicePrivacy initiative and supported by ICASSP 2025 as the SP Grand Challenge It focuses on developing attacker systems against voice…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Natalia Tomashenko , Xiaoxiao Miao , Emmanuel Vincent , Junichi Yamagishi

Preserving privacy of continuous and/or high-dimensional data such as images, videos and audios, can be challenging with syntactic anonymization methods which are designed for discrete attributes. Differential privacy, which provides a more…

Machine Learning · Computer Science 2017-12-04 Jihun Hamm

Anonymity is a powerful component of many participatory media platforms that can afford people greater freedom of expression and protection from external coercion and interference. However, it can be difficult to effectively implement on…

Human-Computer Interaction · Computer Science 2024-08-27 Wonjune Kang , Margaret A. Hughes , Deb Roy

We introduce Vox-Profile, a comprehensive benchmark to characterize rich speaker and speech traits using speech foundation models. Unlike existing works that focus on a single dimension of speaker traits, Vox-Profile provides holistic and…

Recently, speech assistant and speech verification have been used in many fields, which brings much benefit and convenience for us. However, when we enjoy these speech applications, our speech may be collected by attackers for speech…

Cryptography and Security · Computer Science 2025-09-03 Yuwen Pu , Zhou Feng , Chunyi Zhou , Jiahao Chen , Chunqiang Hu , Haibo Hu , Shouling Ji