English
Related papers

Related papers: VoiceCloak: A Multi-Dimensional Defense Framework …

200 papers

Generative models can reconstruct face images from encoded representations (templates) bearing remarkable likeness to the original face, raising security and privacy concerns. We present \textsc{FaceCloak}, a neural network framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Sudipta Banerjee , Anubhav Jain , Chinmay Hegde , Nasir Memon

Current audio deepfake detectors cannot be trusted. While they excel on controlled benchmarks, they fail when tested in the real world. We introduce Perturbed Public Voices (P$^{2}$V), an IRB-approved dataset capturing three critical…

Sound · Computer Science 2025-08-18 Chongyang Gao , Marco Postiglione , Isabel Gortner , Sarit Kraus , V. S. Subrahmanian

Detecting forgery videos is highly desirable due to the abuse of deepfake. Existing detection approaches contribute to exploring the specific artifacts in deepfake videos and fit well on certain data. However, the growing technique on these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Harry Cheng , Yangyang Guo , Tianyi Wang , Qi Li , Xiaojun Chang , Liqiang Nie

Voice anonymization systems aim to protect speaker privacy by obscuring vocal traits while preserving the linguistic content relevant for downstream applications. However, because these linguistic cues remain intact, they can be exploited…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Ahmad Aloradi , Ünal Ege Gaznepoglu , Emanuël A. P. Habets , Daniel Tenbrinck

Recent breakthroughs in text-to-speech (TTS) voice cloning have raised serious privacy concerns, allowing highly accurate vocal identity replication from just a few seconds of reference audio, while retaining the speaker's vocal…

Sound · Computer Science 2025-05-27 Renyuan Li , Zhibo Liang , Haichuan Zhang , Tianyu Shi , Zhiyuan Cheng , Jia Shi , Carl Yang , Mingjie Tang

While language models have made many milestones in text inference and classification tasks, they remain susceptible to adversarial attacks that can lead to unforeseen outcomes. Existing works alleviate this problem by equipping language…

Computation and Language · Computer Science 2024-01-10 Shilong Yuan , Wei Yuan , Hongzhi Yin , Tieke He

The rising use of deepfakes in criminal activities presents a significant issue, inciting widespread controversy. While numerous studies have tackled this problem, most primarily focus on deepfake detection. These reactive solutions are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jaehwan Jeong , Sumin In , Sieun Kim , Hannie Shin , Jongheon Jeong , Sang Ho Yoon , Jaewook Chung , Sangpil Kim

Diffusion Models (DMs) are state-of-the-art generative models that learn a reversible corruption process from iterative noise addition and denoising. They are the backbone of many generative AI applications, such as text-to-image…

Cryptography and Security · Computer Science 2024-01-01 Sheng-Yen Chou , Pin-Yu Chen , Tsung-Yi Ho

Speaker verification systems are increasingly deployed in security-sensitive applications but remain highly vulnerable to adversarial perturbations. In this work, we propose the Mask Diffusion Detector (MDD), a novel adversarial detection…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Yibo Bai , Sizhou Chen , Michele Panariello , Xiao-Lei Zhang , Massimiliano Todisco , Nicholas Evans

Speech synthesis, voice cloning, and voice conversion techniques present severe privacy and security threats to users of voice user interfaces (VUIs). These techniques transform one or more elements of a speech signal, e.g., identity and…

Cryptography and Security · Computer Science 2021-07-23 Ranya Aloufi , Hamed Haddadi , David Boyle

Modern Large audio-language models (LALMs) power intelligent voice interactions by tightly integrating audio and text. This integration, however, expands the attack surface beyond text and introduces vulnerabilities in the continuous,…

Cryptography and Security · Computer Science 2026-04-17 Meng Chen , Kun Wang , Li Lu , Jiaheng Zhang , Tianwei Zhang

Speech deepfake detection has achieved remarkable success in clean environments but faces significant challenges in complex, real-world scenarios where speech is often mixed with background music or noise. Current state-of-the-art methods…

Sound · Computer Science 2026-05-25 Qingcao Li , Yipeng Lin , Weichen Lian , Zhongjie Ba , Peng Cheng , Zhichao Lian

Text-to-Speech (TTS) and Voice Conversion (VC) models have exhibited remarkable performance in generating realistic and natural audio. However, their dark side, audio deepfake poses a significant threat to both society and individuals.…

Cryptography and Security · Computer Science 2024-09-17 Xinfeng Li , Kai Li , Yifan Zheng , Chen Yan , Xiaoyu Ji , Wenyuan Xu

Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity preservation is important, such as completing a recording, dubbing in a new language, or preserving the…

Sound · Computer Science 2026-05-28 Kaitlyn Zhou , Federico Bianchi , Martijn Bartelds , Anna Pot , Yongchan Kwon , James Zou

Recent progress in generative AI technology has made audio deepfakes remarkably more realistic. While current research on anti-spoofing systems primarily focuses on assessing whether a given audio sample is fake or genuine, there has been…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Nicholas Klein , Tianxiang Chen , Hemlata Tak , Ricardo Casal , Elie Khoury

Deepfake audio presents a growing threat to digital security, due to its potential for social engineering, fraud, and identity misuse. However, existing detection models suffer from poor generalization across datasets, due to implicit…

Sound · Computer Science 2025-05-13 Yasaman Ahmadiadli , Xiao-Ping Zhang , Naimul Khan

Recently, the application of diffusion probabilistic models has advanced speech enhancement through generative approaches. However, existing diffusion-based methods have focused on the generation process in high-dimensional waveform or…

Sound · Computer Science 2025-01-20 Shengkui Zhao , Zexu Pan , Kun Zhou , Yukun Ma , Chong Zhang , Bin Ma

With the rapid advancement of generative AI, multimodal deepfakes, which manipulate both audio and visual modalities, have drawn increasing public concern. Currently, deepfake detection has emerged as a crucial strategy in countering these…

Sound · Computer Science 2024-05-16 Yang Hou , Haitao Fu , Chuankai Chen , Zida Li , Haoyu Zhang , Jianjun Zhao

The rapid progress of subject-driven text-to-image synthesis, and in particular DreamBooth, has enabled a consent-free deepfake pipeline: an adversary needs only 4-8 publicly available face images to fine-tune a personalized diffusion model…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tanjim Rahaman Fardin , S M Zunaid Alam , Mahadi Hasan Fahim , Md Faysal Mahfuz

Audio deepfake detection has become a pivotal task over the last couple of years, as many recent speech synthesis and voice cloning systems generate highly realistic speech samples, thus enabling their use in malicious activities. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-15 David Combei , Adriana Stan , Dan Oneata , Horia Cucu