English
Related papers

Related papers: REFORGE: Multi-modal Attacks Reveal Vulnerable Con…

200 papers

Deep learning models are being integrated into a wide range of high-impact, security-critical systems, from self-driving cars to medical diagnosis. However, recent research has demonstrated that many of these deep learning architectures are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Scott Freitas , Shang-Tse Chen , Zijie J. Wang , Duen Horng Chau

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Rapid advances in Artificial Intelligence Generated Images (AIGI) have facilitated malicious use, such as forgery and misinformation. Therefore, numerous methods have been proposed to detect fake images. Although such detectors have been…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Ruixuan Zhang , He Wang , Zhengyu Zhao , Zhiqing Guo , Xun Yang , Yunfeng Diao , Meng Wang

In-context image generation and editing (ICGE) enables users to specify visual concepts through interleaved image-text prompts, demanding precise understanding and faithful execution of user intent. Although recent unified multimodal models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Runze He , Yiji Cheng , Tiankai Hang , Zhimin Li , Yu Xu , Zijin Yin , Shiyi Zhang , Wenxun Dai , Penghui Du , Ao Ma , Chunyu Wang , Qinglin Lu , Jizhong Han , Jiao Dai

Multimodal large language models (MLLMs) comprise of both visual and textual modalities to process vision language tasks. However, MLLMs are vulnerable to security-related issues, such as jailbreak attacks that alter the model's input to…

Cryptography and Security · Computer Science 2025-10-27 Xingwei Zhong , Kar Wai Fok , Vrizlynn L. L. Thing

We present a generic Reinforcement Learning (RL) framework optimized for crafting adversarial attacks on different model types spanning from ECG signal analysis (1D), image classification (2D), and video classification (3D). The framework…

Machine Learning · Computer Science 2024-04-23 Soumyendu Sarkar , Ashwin Ramesh Babu , Sajad Mousavi , Vineet Gundecha , Avisek Naug , Sahand Ghorbanpour

Deepfake or synthetic images produced using deep generative models pose serious risks to online platforms. This has triggered several research efforts to accurately detect deepfake images, achieving excellent performance on publicly…

Cryptography and Security · Computer Science 2024-04-26 Sifat Muhammad Abdullah , Aravind Cheruvu , Shravya Kanchi , Taejoong Chung , Peng Gao , Murtuza Jadliwala , Bimal Viswanath

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Deep learning has achieved enormous success in various industrial applications. Companies do not want their valuable data to be stolen by malicious employees to train pirated models. Nor do they wish the data analyzed by the competitors…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Kejiang Chen , Xianhan Zeng , Qichao Ying , Sheng Li , Zhenxing Qian , Xinpeng Zhang

Machine unlearning for text-to-image diffusion models aims to selectively remove undesirable concepts from pre-trained models without costly retraining. Current unlearning methods share a common weakness: erased concepts return when the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Aljalila Aladawi , Mohammed Talha Alam , Fakhri Karray

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

Recent advancements in Large Vision-Language Models (VLMs) have underscored their superiority in various multimodal tasks. However, the adversarial robustness of VLMs has not been fully explored. Existing methods mainly assess robustness…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ruofan Wang , Xingjun Ma , Hanxu Zhou , Chuanjun Ji , Guangnan Ye , Yu-Gang Jiang

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

Machine Learning · Computer Science 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

The need for machine unlearning is critical for data privacy, yet existing methods often cause Knowledge Contamination by unintentionally damaging related knowledge. Such a degraded model performance after unlearning has been recently…

Machine Learning · Computer Science 2026-03-03 Jinmyeong Shin , Joshua Tapia , Nicholas Ferreira , Gabriel Diaz , Moayed Daneshyari , Hyeran Jeon

The growing reliance on deep learning models in safety-critical domains such as healthcare and autonomous navigation underscores the need for defenses that are both robust to adversarial perturbations and transparent in their…

Machine Learning · Computer Science 2026-01-06 Longwei Wang , Mohammad Navid Nayyem , Abdullah Al Rakin , KC Santosh , Chaowei Zhang , Yang Zhou

Machine unlearning is a key defense mechanism for removing unauthorized concepts from text-to-image diffusion models, yet recent evidence shows that latent visual information often persists after unlearning. Existing adversarial approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ignacy Kolton , Kacper Marzol , Paweł Batorski , Marcin Mazur , Paul Swoboda , Przemysław Spurek

Retrieval-Augmented Generation (RAG) enhances Large Language Models by grounding their outputs in external documents. These systems, however, remain vulnerable to attacks on the retrieval corpus, such as prompt injection. RAG-based search…

Cryptography and Security · Computer Science 2026-02-17 Zeyu Shen , Basileal Imana , Tong Wu , Chong Xiang , Prateek Mittal , Aleksandra Korolova

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding small, human-imperceptible perturbations to the original images, but make the model output inaccurate predictions. Before deep neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Bo Yang , Kaiyong Xu , Hengjun Wang , Hengwei Zhang

This work examines the vulnerability of multimodal (image + text) models to adversarial threats similar to those discussed in previous literature on unimodal (image- or text-only) models. We introduce realistic assumptions of partial model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ivan Evtimov , Russel Howes , Brian Dolhansky , Hamed Firooz , Cristian Canton Ferrer