English
Related papers

Related papers: On enhancing the robustness of Vision Transformers…

200 papers

Recent developments in adversarial machine learning have highlighted the importance of building robust AI systems to protect against increasingly sophisticated attacks. While frameworks like AI Guardian are designed to defend against these…

Machine Learning · Computer Science 2024-05-06 Trinath Sai Subhash Reddy Pittala , Uma Maheswara Rao Meleti , Geethakrishna Puligundla

Recently, text-to-image generative models have been misused to create unauthorized malicious images of individuals, posing a growing social problem. Previous solutions, such as Anti-DreamBooth, add adversarial noise to images to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Takuto Onikubo , Yusuke Matsui

We present GIFT: a {G}radient-aware {I}mmunization technique to defend diffusion models against malicious {F}ine-{T}uning while preserving their ability to generate safe content. Existing safety mechanisms like safety checkers are easily…

Cryptography and Security · Computer Science 2025-07-21 Amro Abdalla , Ismail Shaheen , Dan DeGenaro , Rupayan Mallick , Bogdan Raita , Sarah Adel Bargal

Deep learning vision systems are increasingly deployed in safety-critical domains such as healthcare, yet they remain vulnerable to small adversarial patches that can trigger misclassifications. Most existing defenses assume a single patch…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Aja Khanal , Ahmed Faid , Apurva Narayan

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

Adversarial attacks induce misclassification by introducing subtle perturbations. Recently, diffusion models are applied to the image classifiers to improve adversarial robustness through adversarial training or by purifying adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yujie Li , Yanbin Wang , Haitao Xu , Bin Liu , Jianguo Sun , Zhenhao Guo , Wenrui Ma

Diffusion Models (DMs) have empowered great success in artificial-intelligence-generated content, especially in artwork creation, yet raising new concerns in intellectual properties and copyright. For example, infringers can make profits by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Chumeng Liang , Xiaoyu Wu

Vision transformers (ViTs) have recently set off a new wave in neural architecture design thanks to their record-breaking performance in various vision tasks. In parallel, to fulfill the goal of deploying ViTs into real-world vision…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Shunyao Zhang , Shang Wu , Cheng Wan , Yingyan Celine Lin

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Adversarial purification is one of the promising approaches to defend neural networks against adversarial attacks. Recently, methods utilizing diffusion probabilistic models have achieved great success for adversarial purification in image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Mingkun Zhang , Jianing Li , Wei Chen , Jiafeng Guo , Xueqi Cheng

In recent times, deep neural networks (DNNs) have been successfully adopted for various applications. Despite their notable achievements, it has become evident that DNNs are vulnerable to sophisticated adversarial attacks, restricting their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Alik Pramanick , Mayank Bansal , Utkarsh Srivastava , Suklav Ghosh , Arijit Sur

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

Advances in diffusion-based video generation models, while significantly improving human animation, poses threats of misuse through the creation of fake videos from a specific person's photo and text prompts. Recent efforts have focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Duc Vu , Anh Nguyen , Chi Tran , Anh Tran

Virtual clothes try-on has emerged as a vital feature in online shopping, offering consumers a critical tool to visualize how clothing fits. In our research, we introduce an innovative approach for virtual clothes try-on, utilizing a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lingxiao Lu , Shengyi Wu , Haoxuan Sun , Junhong Gou , Jianlou Si , Chen Qian , Jianfu Zhang , Liqing Zhang

Stable Diffusion has established itself as a foundation model in generative AI artistic applications, receiving widespread research and application. Some recent fine-tuning methods have made it feasible for individuals to implant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhengyue Zhao , Jinhao Duan , Kaidi Xu , Chenan Wang , Rui Zhang , Zidong Du , Qi Guo , Xing Hu

Data reconstruction attacks on machine learning models pose a substantial threat to privacy, potentially leaking sensitive information. Although defending against such attacks using differential privacy (DP) provides theoretical guarantees,…

Machine Learning · Computer Science 2025-03-11 Kristian Schwethelm , Johannes Kaiser , Moritz Knolle , Sarah Lockfisch , Daniel Rueckert , Alexander Ziller

Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by locating the most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Marcos V. Conde , Kerem Turgutlu

Vision Transformers (ViTs), extensively pre-trained on large-scale datasets, have become essential to foundation models, allowing excellent performance on diverse downstream tasks with minimal adaptation. Consequently, there is growing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lixu Wang , Bingqi Shang , Yi Li , Payal Mohapatra , Wei Dong , Xiao Wang , Qi Zhu

As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds. Despite the recent success of deep learning models in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yu Feng , Xing Shi , Mengli Cheng , Yun Xiong

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande