English
Related papers

Related papers: De-AntiFake: Rethinking the Protective Perturbatio…

200 papers

Facially manipulated images and videos or DeepFakes can be used maliciously to fuel misinformation or defame individuals. Therefore, detecting DeepFakes is crucial to increase the credibility of social media platforms and other media…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Paarth Neekhara , Brian Dolhansky , Joanna Bitton , Cristian Canton Ferrer

Recently, text-to-image generative models have been misused to create unauthorized malicious images of individuals, posing a growing social problem. Previous solutions, such as Anti-DreamBooth, add adversarial noise to images to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Takuto Onikubo , Yusuke Matsui

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

Sound · Computer Science 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel

Speaker attribute perturbation offers a feasible approach to asynchronous voice anonymization by employing adversarially perturbed speech as anonymized output. In order to enhance the identity unlinkability among anonymized utterances from…

Sound · Computer Science 2025-08-22 Liping Chen , Chenyang Guo , Rui Wang , Kong Aik Lee , Zhenhua Ling

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Recent research has proposed approaches that modify speech to defend against gender inference attacks. The goal of these protection algorithms is to control the availability of information about a speaker's gender, a privacy-sensitive…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-04 Loes van Bemmel , Zhuoran Liu , Nik Vaessen , Martha Larson

Latent diffusion models have recently demonstrated superior capabilities in many downstream image synthesis tasks. However, customization of latent diffusion models using unauthorized data can severely compromise the privacy and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Sen Peng , Mingyue Wang , Jianfei He , Jijia Yang , Xiaohua Jia

As parallel training data is scarce for one-shot voice conversion (VC) tasks, waveform reconstruction is typically performed by various VC systems. A typical one-shot VC system comprises a content encoder and a speaker encoder. However, two…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Songjun Cao , Qinghua Wu , Jie Chen , Jin Li , Long Ma

Vibrometry-based side channels pose a significant privacy risk, exploiting sensors like mmWave radars, light sensors, and accelerometers to detect vibrations from sound sources or proximate objects, enabling speech eavesdropping. Despite…

Cryptography and Security · Computer Science 2025-04-11 Jung-Woo Chang , Ke Sun , David Xia , Xinyu Zhang , Farinaz Koushanfar

Collecting speech data is an important step in training speech recognition systems and other speech-based machine learning models. However, the issue of privacy protection is an increasing concern that must be addressed. The current study…

The rapid advancement of voice deepfake technologies has raised serious concerns about user audio privacy, as attackers increasingly exploit publicly available voice data to generate convincing fake audio for malicious purposes such as…

Sound · Computer Science 2025-11-05 Zhou Feng , Jiahao Chen , Chunyi Zhou , Yuwen Pu , Qingming Li , Tianyu Du , Shouling Ji

Learning from demonstrations is a popular approach to train AI models; however, their vulnerability to adversarial attacks remains underexplored. We present the first systematic study of adversarial attacks, across a range of both classic…

Machine Learning · Computer Science 2026-04-27 Akansha Kalra , Basavasagar Patil , Guanhong Tao , Daniel S. Brown

Logical Access (LA) attacks, also known as audio deepfake attacks, use Text-to-Speech (TTS) or Voice Conversion (VC) methods to generate spoofed speech data. This can represent a serious threat to Automatic Speaker Verification (ASV)…

Sound · Computer Science 2026-03-17 Anacin , Angela , Shruti Kshirsagar , Anderson R. Avila

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophisticated Deepfake content, including speech Deepfakes, which pose…

Sound · Computer Science 2025-07-16 Menglu Li , Yasaman Ahmadiadli , Xiao-Ping Zhang

The rapid advancement of deepfake technology poses a significant threat to digital media integrity. Deepfakes, synthetic media created using AI, can convincingly alter videos and audio to misrepresent reality. This creates risks of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Kashish Gandhi , Prutha Kulkarni , Taran Shah , Piyush Chaudhari , Meera Narvekar , Kranti Ghag

The growing threat posed by deepfake videos, capable of manipulating realities and disseminating misinformation, drives the urgent need for effective detection methods. This work investigates and compares different approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Matheus Martins Batista

The increasing prevalence of audio deepfakes poses significant security threats, necessitating robust detection methods. While existing detection systems exhibit promise, their robustness against malicious audio manipulations remains…

Cryptography and Security · Computer Science 2024-04-25 Haolin Wu , Jing Chen , Ruiying Du , Cong Wu , Kun He , Xingcan Shang , Hao Ren , Guowen Xu

Neural networks have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to adversarial perturbations, which pose significant risks in safety-critical applications. With the rise of multimodality,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Xinxin Liu , Zhongliang Guo , Siyuan Huang , Chun Pong Lau

We propose SelfVC, a training strategy to iteratively improve a voice conversion model with self-synthesized examples. Previous efforts on voice conversion focus on factorizing speech into explicitly disentangled representations that…

With extensive face images being shared on social media, there has been a notable escalation in privacy concerns. In this paper, we propose AdvCloak, an innovative framework for privacy protection using generative models. AdvCloak is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xuannan Liu , Yaoyao Zhong , Xing Cui , Yuhang Zhang , Peipei Li , Weihong Deng