English
Related papers

Related papers: Privacy-Preserving End-to-End Full-Duplex Speech D…

200 papers

Protecting speaker identity is crucial for online voice applications, yet streaming speaker anonymization (SA) remains underexplored. Recent research has demonstrated that neural audio codec (NAC) provides superior speaker feature…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Nikita Kuzmin , Songting Liu , Kong Aik Lee , Eng Siong Chng

Speaker anonymization aims to conceal cues to speaker identity while preserving linguistic content. Current machine learning based approaches require substantial computational resources, hindering real-time streaming applications. To…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-04 Waris Quamer , Ricardo Gutierrez-Osuna

We address the challenge of preserving emotional content in streaming speaker anonymization (SA). Neural audio codec language models trained for audio continuation tend to degrade source emotion: content tokens discard emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Nikita Kuzmin , Kong Aik Lee , Eng Siong Chng

In recent years, the need for privacy preservation when manipulating or storing personal data, including speech , has become a major issue. In this paper, we present a system addressing the speaker-level anonymization problem. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Francesco Nespoli , Daniel Barreda , Joerg Bitzer , Patrick A. Naylor

Speaker anonymization aims to conceal a speaker's identity without degrading speech quality and intelligibility. Most speaker anonymization systems disentangle the speaker representation from the original speech and achieve anonymization by…

Sound · Computer Science 2023-10-10 Yuanjun Lv , Jixun Yao , Peikun Chen , Hongbin Zhou , Heng Lu , Lei Xie

Speech data on the Internet are proliferating exponentially because of the emergence of social media, and the sharing of such personal data raises obvious security and privacy concerns. One solution to mitigate these concerns involves…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Jixun Yao , Qing Wang , Yi Lei , Pengcheng Guo , Lei Xie , Namin Wang , Jie Liu

Voice anonymization masks vocal traits while preserving linguistic content, which may still leak speaker-specific patterns. To assess and strengthen privacy evaluation, we propose a dual-stream attacker that fuses spectral and…

Sound · Computer Science 2026-03-17 Ridwan Arefeen , Xiaoxiao Miao , Rong Tong , Aik Beng Ng , Simon See , Timothy Liu

This paper consider a new secure communication scene where a full-duplex transmitter (Alan) need to transmit confidential information to a half-duplex receiver (Bob), with a silent eavesdropper (Eve) that tries to eavesdrop the confidential…

Networking and Internet Architecture · Computer Science 2017-10-20 Xinyue Hu , Caihong Kai , Shengli Zhang , Zhongyi Guo , Jun Gao

Current speaker anonymization methods, especially with self-supervised learning (SSL) models, require massive computational resources when hiding speaker identity. This paper proposes an effective and parameter-efficient speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-20 Xiaojiao Chen , Sheng Li , Jiyi Li , Hao Huang , Yang Cao , Liang He

Advances in speech technology now allow unprecedented access to personally identifiable information through speech. To protect such information, the differential privacy field has explored ways to anonymize speech while preserving its…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Zexin Cai , Henry Li Xinyuan , Ashi Garg , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Nicholas Andrews , Matthew Wiesner

The requirements for many applications of state-of-the-art speech recognition systems include not only low word error rate (WER) but also low latency. Specifically, for many use-cases, the system must be able to decode utterances in a…

In speaker anonymization, speech recordings are modified in a way that the identity of the speaker remains hidden. While this technology could help to protect the privacy of individuals around the globe, current research restricts this by…

Computation and Language · Computer Science 2024-10-08 Sarina Meyer , Florian Lux , Ngoc Thang Vu

We propose DarkStream, a streaming speech synthesis model for real-time speaker anonymization. To improve content encoding under strict latency constraints, DarkStream combines a causal waveform encoder, a short lookahead buffer, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Waris Quamer , Ricardo Gutierrez-Osuna

The development of privacy-preserving automatic speaker verification systems has been the focus of a number of studies with the intent of allowing users to authenticate themselves without risking the privacy of their voice. However, current…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Francisco Teixeira , Alberto Abad , Bhiksha Raj , Isabel Trancoso

Sharing real-world speech utterances is key to the training and deployment of voice-based services. However, it also raises privacy risks as speech contains a wealth of personal data. Speaker anonymization aims to remove speaker information…

This paper presents our recent effort on end-to-end speaker-attributed automatic speech recognition, which jointly performs speaker counting, speech recognition and speaker identification for monaural multi-talker audio. Firstly, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-07 Naoyuki Kanda , Guoli Ye , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

In this paper, we make the explicit connection between image segmentation methods and end-to-end diarization methods. From these insights, we propose a novel, fully end-to-end diarization model, EEND-M2F, based on the Mask2Former…

Sound · Computer Science 2024-01-24 Marc Härkönen , Samuel J. Broughton , Lahiru Samarakoon

End-to-end speech recognition systems have achieved competitive results compared to traditional systems. However, the complex transformations involved between layers given highly variable acoustic signals are hard to analyze. In this paper,…

Computation and Language · Computer Science 2019-11-05 Chung-Yi Li , Pei-Chieh Yuan , Hung-Yi Lee

Smart devices serviced by large-scale AI models necessitates user data transfer to the cloud for inference. For speech applications, this means transferring private user information, e.g., speaker identity. Our paper proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-26 Md Asif Jalal , Pablo Peso Parada , Jisi Zhang , Karthikeyan Saravanan , Mete Ozay , Myoungji Han , Jung In Lee , Seokyeong Jung

Voice anonymization techniques have been found to successfully obscure a speaker's acoustic identity in short, isolated utterances in benchmarks such as the VoicePrivacy Challenge. In practice, however, utterances seldom occur in isolation:…

Sound · Computer Science 2026-02-05 Cristina Aggazzotti , Ashi Garg , Zexin Cai , Nicholas Andrews
‹ Prev 1 2 3 10 Next ›