English
Related papers

Related papers: Panda or not Panda? Understanding Adversarial Atta…

200 papers

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

Adversarial attacks are malicious inputs that derail machine-learning models. We propose a scheme to attack autoencoders, as well as a quantitative evaluation framework that correlates well with the qualitative assessment of the attacks. We…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 George Gondim-Ribeiro , Pedro Tabacof , Eduardo Valle

Adversarial attacks pose a critical security threat to real-world AI systems by injecting human-imperceptible perturbations into benign samples to induce misclassification in deep learning models. While existing detection methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yinghe Zhang , Chi Liu , Shuai Zhou , Sheng Shen , Peng Gui

Recent studies on AI security have highlighted the vulnerability of Vision-Language Pre-training (VLP) models to subtle yet intentionally designed perturbations in images and texts. Investigating multimodal systems' robustness via…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Haonan Zheng , Wen Jiang , Xinyang Deng , Wenrui Li

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

Computation and Language · Computer Science 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

Deep neural networks are known to be extremely vulnerable to adversarial examples under white-box setting. Moreover, the malicious adversaries crafted on the surrogate (source) model often exhibit black-box transferability on other models…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Xiaosen Wang , Xuanran He , Jingdong Wang , Kun He

The widespread use of Vision Language Models (VLMs, e.g. CLIP) has raised concerns about their vulnerability to sophisticated and imperceptible adversarial attacks. These attacks could compromise model performance and system security in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiaowei Fu , Lei Zhang

Machine learning algorithms are used to construct a mathematical model for a system based on training data. Such a model is capable of making highly accurate predictions without being explicitly programmed to do so. These techniques have a…

Cryptography and Security · Computer Science 2022-02-22 Cato Pauling , Michael Gimson , Muhammed Qaid , Ahmad Kida , Basel Halak

The integration of visual and textual data in Vision-Language Pre-training (VLP) models is crucial for enhancing vision-language understanding. However, the adversarial robustness of these models, especially in the alignment of image-text…

Multimedia · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Hanwang Zhang , Hang Su , Richang Hong

The emergence of vision-language-action models (VLAs) for end-to-end control is reshaping the field of robotics by enabling the fusion of multimodal sensory inputs at the billion-parameter scale. The capabilities of VLAs stem primarily from…

Deep neural networks (DNNs) are known vulnerable to adversarial attacks. That is, adversarial examples, obtained by adding delicately crafted distortions onto original legal inputs, can mislead a DNN to classify them as any target labels.…

Machine Learning · Computer Science 2018-04-11 Pu Zhao , Sijia Liu , Yanzhi Wang , Xue Lin

Despite the growing popularity of modern machine learning techniques (e.g. Deep Neural Networks) in cyber-security applications, most of these models are perceived as a black-box for the user. Adversarial machine learning offers an approach…

Machine Learning · Computer Science 2018-11-29 Daniel L. Marino , Chathurika S. Wickramasinghe , Milos Manic

Machine learning models have made many decision support systems to be faster, more accurate, and more efficient. However, applications of machine learning in network security face a more disproportionate threat of active adversarial attacks…

Cryptography and Security · Computer Science 2023-03-22 Olakunle Ibitoye , Rana Abou-Khamis , Mohamed el Shehaby , Ashraf Matrawy , M. Omair Shafiq

Almost all adversarial attacks are formulated to add an imperceptible perturbation to an image in order to fool a model. Here, we consider the opposite which is adversarial examples that can fool a human but not a model. A large enough and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Ali Borji

In the rapidly evolving field of artificial intelligence, machine learning emerges as a key technology characterized by its vast potential and inherent risks. The stability and reliability of these models are important, as they are frequent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Haibo Zhang , Zhihua Yao , Kouichi Sakurai , Takeshi Saitoh

Large vision-language models (LVLMs) integrate visual information into large language models, showcasing remarkable multi-modal conversational capabilities. However, the visual modules introduces new challenges in terms of robustness for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yubo Wang , Chaohu Liu , Yanqiu Qu , Haoyu Cao , Deqiang Jiang , Linli Xu

Adversarial attacks are small, carefully crafted perturbations, imperceptible to the naked eye; that when added to an image cause deep learning models to misclassify the image with potentially detrimental outcomes. With the rise of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Rohan Reddy Mekala , Gudjon Einar Magnusson , Adam Porter , Mikael Lindvall , Madeline Diep

Adversarial face examples possess two critical properties: Visual Quality and Transferability. However, existing approaches rarely address these properties simultaneously, leading to subpar results. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Fengfan Zhou , Hefei Ling , Yuxuan Shi , Jiazhong Chen , Ping Li

Over the years, most research towards defenses against adversarial attacks on machine learning models has been in the image recognition domain. The ML-based malware detection domain has received less attention despite its importance.…

Machine Learning · Computer Science 2023-04-25 Aqib Rashid , Jose Such

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang