English
Related papers

Related papers: Privacy-Preserving End-to-End Full-Duplex Speech D…

200 papers

Current Large Language Models (LLMs) cannot support users to precisely balance privacy protection and output performance during individual consultations. We introduce Adanonymizer, an anonymization plug-in that allows users to control this…

Human-Computer Interaction · Computer Science 2025-01-28 Shuning Zhang , Xin Yi , Haobin Xing , Lyumanshan Ye , Yongquan Hu , Hewu Li

Speaker anonymization aims to conceal a speaker's identity, without considering the linguistic content. In this study, we reveal a weakness of Librispeech, the dataset that is commonly used to evaluate anonymizers: the books read by the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Carlos Franzreb , Arnab Das , Tim Polzehl , Sebastian Möller

Full-duplex dialogue audio, in which each speaker is recorded on a separate track, is an important resource for spoken dialogue research, but is difficult to collect at scale. Most in-the-wild two-speaker dialogue is available only as…

Sound · Computer Science 2026-04-14 Wataru Nakata , Yuki Saito , Kazuki Yamauchi , Emiru Tsunoo , Hiroshi Saruwatari

End-to-end (E2E) models have shown to outperform state-of-the-art conventional models for streaming speech recognition [1] across many dimensions, including quality (as measured by word error rate (WER)) and endpointer latency [2]. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-12 Bo Li , Anmol Gulati , Jiahui Yu , Tara N. Sainath , Chung-Cheng Chiu , Arun Narayanan , Shuo-Yiin Chang , Ruoming Pang , Yanzhang He , James Qin , Wei Han , Qiao Liang , Yu Zhang , Trevor Strohman , Yonghui Wu

Social chatbots, also known as chit-chat chatbots, evolve rapidly with large pretrained language models. Despite the huge progress, privacy concerns have arisen recently: training data of large language models can be extracted via model…

Computation and Language · Computer Science 2022-05-23 Haoran Li , Yangqiu Song , Lixin Fan

Voice anonymization has been developed as a technique for preserving privacy by replacing the speaker's voice in a speech signal with that of a pseudo-speaker, thereby obscuring the original voice attributes from machine recognition and…

Sound · Computer Science 2024-11-13 Rui Wang , Liping Chen , Kong AiK Lee , Zhen-Hua Ling

Human speech conveys prosody, linguistic content, and speaker identity. This article investigates a novel speaker anonymization approach using an end-to-end network based on a Vector-Quantized Variational Auto-Encoder (VQ-VAE) to deal with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Sotheara Leang , Anderson Augusma , Eric Castelli , Frédérique Letué , Sethserey Sam , Dominique Vaufreydaz

Automatic Speaker Diarization (ASD) is an enabling technology with numerous applications, which deals with recordings of multiple speakers, raising special concerns in terms of privacy. In fact, in remote settings, where recordings are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Francisco Teixeira , Alberto Abad , Bhiksha Raj , Isabel Trancoso

The secure transmission of confidential information in cellular vehicle-to-everything (C-V2X) communication networks is vitally important for user's personal safety. However, for C-V2X there have not been much studies on the physical layer…

Information Theory · Computer Science 2020-10-08 Chao Wang , Zan Li , Gen Xiang Xia , Jia Shi , Jiangbo Si , Yulong Zou

Voice anonymisation can be used to help protect speaker privacy when speech data is shared with untrusted others. In most practical applications, while the voice identity should be sanitised, other attributes such as the spoken content…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-09 Michele Panariello , Massimiliano Todisco , Nicholas Evans

In this paper, we investigate secure transmission in a massive multiple-input multiple-output (MIMO) system adopting low-resolution digital-to-analog converters (DACs). Artificial noise (AN) is deliberately transmitted simultaneously with…

Information Theory · Computer Science 2019-01-30 Jindan Xu , Wei Xu , Jun Zhu , Derrick Wing Kwan Ng , A. Lee Swindlehurst

In this work, we describe our submissions for the Voice Privacy Challenge 2024. Rather than proposing a novel speech anonymization system, we enhance the provided baselines to meet all required conditions and improve evaluated metrics.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-11 Nikita Kuzmin , Hieu-Thi Luong , Jixun Yao , Lei Xie , Kong Aik Lee , Eng Siong Chng

Deep learning voice models are commonly used nowadays, but the safety processing of personal data, such as human identity and speech content, remains suspicious. To prevent malicious user identification, speaker anonymization methods were…

Sound · Computer Science 2025-05-27 Elvir Karimov , Alexander Varlamov , Danil Ivanov , Dmitrii Korzh , Oleg Y. Rogov

Voice anonymisation aims to conceal the voice identity of speakers in speech recordings. Privacy protection is usually estimated from the difficulty of using a speaker verification system to re-identify the speaker post-anonymisation.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Michele Panariello , Sarina Meyer , Pierre Champion , Xiaoxiao Miao , Massimiliano Todisco , Ngoc Thang Vu , Nicholas Evans

Audio is a rich sensing modality that is useful for a variety of human activity recognition tasks. However, the ubiquitous nature of smartphones and smart speakers with always-on microphones has led to numerous privacy concerns and a lack…

Machine recognition of an atypical speech like whispered speech, is a challenging task. We introduce whisper-to-natural-speech conversion using sequence-to-sequence approach by proposing enhanced transformer architecture, which uses both…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Abhishek Niranjan , Mukesh Sharma , Sai Bharath Chandra Gutha , M Ali Basha Shaik

This paper investigates physical layer security (PLS) in a movable antenna (MA)-assisted full-duplex (FD) system. In this system, an FD base station (BS) with multiple MAs for transmission and reception provides services for an uplink (UL)…

Information Theory · Computer Science 2025-03-18 Jingze Ding , Zijian Zhou , Chenbo Wang , Wenyao Li , Lifeng Lin , Bingli Jiao

In speech technologies, speaker's voice representation is used in many applications such as speech recognition, voice conversion, speech synthesis and, obviously, user authentication. Modern vocal representations of the speaker are based on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Paul-Gauthier Noé , Mohammad Mohammadamini , Driss Matrouf , Titouan Parcollet , Andreas Nautsch , Jean-François Bonastre

In this work, we propose a speaker anonymization pipeline that leverages high quality automatic speech recognition and synthesis systems to generate speech conditioned on phonetic transcriptions and anonymized speaker embeddings. Using…

Sound · Computer Science 2022-07-12 Sarina Meyer , Florian Lux , Pavel Denisov , Julia Koch , Pascal Tilli , Ngoc Thang Vu

We present results and analyses from the third VoicePrivacy Challenge held in 2024, which focuses on advancing voice anonymization technologies. The task was to develop a voice anonymization system for speech data that conceals a speaker's…