English
Related papers

Related papers: DiffMI: Breaking Face Recognition Privacy via Diff…

200 papers

Backdoor attacks pose a serious security threat for training neural networks as they surreptitiously introduce hidden functionalities into a model. Such backdoors remain silent during inference on clean inputs, evading detection due to…

Cryptography and Security · Computer Science 2023-12-15 Lukas Struppek , Martin B. Hentschel , Clifton Poth , Dominik Hintersdorf , Kristian Kersting

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

With the emerging trend of large generative models, ControlNet is introduced to enable users to fine-tune pre-trained models with their own data for various use cases. A natural question arises: how can we train ControlNet models while…

Machine Learning · Computer Science 2024-09-16 Dixi Yao

The past few years have witnessed substantial advances in image generation powered by diffusion models. However, it was shown that diffusion models are susceptible to training data memorization, raising significant concerns regarding…

Cryptography and Security · Computer Science 2025-08-01 Zhe Ma , Qingming Li , Xuhong Zhang , Tianyu Du , Ruixiao Lin , Zonghui Wang , Shouling Ji , Wenzhi Chen

Detecting diffusion-generated images has recently grown into an emerging research area. Existing diffusion-based datasets predominantly focus on general image generation. However, facial forgeries, which pose a more severe social risk, have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Harry Cheng , Yangyang Guo , Tianyi Wang , Liqiang Nie , Mohan Kankanhalli

The outstanding capability of diffusion models in generating high-quality images poses significant threats when misused by adversaries. In particular, we assume malicious adversaries exploiting diffusion models for inpainting tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Joonsung Jeon , Woo Jae Kim , Suhyeon Ha , Sooel Son , Sung-eui Yoon

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Transformer models have demonstrated exceptional performance and have become indispensable in computer vision (CV) and natural language processing (NLP) tasks. However, recent studies reveal that transformers are susceptible to backdoor…

Machine Learning · Computer Science 2025-08-15 Taibiao Zhao , Mingxuan Sun , Hao Wang , Xiaobing Chen , Xiangwei Zhou

Generally, privacy-enhancing face recognition systems are designed to offer permanent protection of face embeddings. Recently, so-called soft-biometric privacy-enhancement approaches have been introduced with the aim of canceling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Daile Osorio-Roig , Paul A. Gerlitz , Christian Rathgeb , Christoph Busch

Dramatic advances in the quality of the latent diffusion models (LDMs) also led to the malicious use of AI-generated images. While current AI-generated image detection methods assume the availability of real/AI-generated images for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sungik Choi , Hankook Lee , Jaehoon Lee , Seunghyun Kim , Stanley Jungkyu Choi , Moontae Lee

Current face de-identification methods that replace identifiable cues in the face region with other sacrifices utilities contributing to realism, such as age and gender. To retrieve the damaged realism, we present FLUID (Face…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jinhyeong Park , Shaheryar Muhammad , Seangmin Lee , Jong Taek Lee , Soon Ki Jung

Facial video editing has become increasingly important for content creators, enabling the manipulation of facial expressions and attributes. However, existing models encounter challenges such as poor editing quality, high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tharun Anand , Aryan Garg , Kaushik Mitra

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

Generative models now produce imperceptible, fine-grained manipulated faces, posing significant privacy risks. However, existing AI-generated face datasets generally lack focus on samples with fine-grained regional manipulations.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Feng Ding , Wenhui Yi , Xinan He , Mengyao Xiao , Jianfeng Xu , Jianqiang Du

Although deep learning-based visual tracking methods have made significant progress, they exhibit vulnerabilities when facing carefully designed adversarial attacks, which can lead to a sharp decline in tracking performance. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Long Xu , Peng Gao , Wen-Jia Tang , Fei Wang , Ru-Yue Yuan

Model inversion (MI) attacks have raised increasing concerns about privacy, which can reconstruct training data from public models. Indeed, MI attacks can be formalized as an optimization problem that seeks private data in a certain space.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xiaojian Yuan , Kejiang Chen , Jie Zhang , Weiming Zhang , Nenghai Yu , Yang Zhang

Tuning-free face personalization methods have developed along two distinct paradigms: text embedding approaches that map facial features into the text embedding space, and adapter-based methods that inject features through auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Lianyu Pang , Ji Zhou , Qiping Wang , Baoquan Zhao , Zhenguo Yang , Qing Li , Xudong Mao

Federated learning (FL) empowers privacypreservation in model training by only exposing users' model gradients. Yet, FL users are susceptible to gradient inversion attacks (GIAs) which can reconstruct ground-truth training data such as…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Can Liu , Jin Wang , and Yipeng Zhou , Yachao Yuan , Quanzheng Sheng , Kejie Lu

Recent developments in face restoration have achieved remarkable results in producing high-quality and lifelike outputs. The stunning results however often fail to be faithful with respect to the identity of the person as the models lack…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tuomas Varanka , Tapani Toivonen , Soumya Tripathy , Guoying Zhao , Erman Acar

Machine Learning (ML) is accelerating progress across fields and industries, but relies on accessible and high-quality training data. Some of the most important datasets are found in biomedical and financial domains in the form of…

Machine Learning · Computer Science 2023-08-30 Gianluca Truda