English
Related papers

Related papers: Cross-Modality Attack Boosted by Gradient-Evolutio…

200 papers

Given the great threat of adversarial attacks against Deep Neural Networks (DNNs), numerous works have been proposed to boost transferability to attack real-world applications. However, existing attacks often utilize advanced gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Zhiyuan Wang , Zeliang Zhang , Siyuan Liang , Xiaosen Wang

Despite the success of input transformation-based attacks on boosting adversarial transferability, the performance is unsatisfying due to the ignorance of the discrepancy across models. In this paper, we propose a simple but effective…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Donghua Wang , Wen Yao , Tingsong Jiang , Xiaohu Zheng , Junqi Wu , Xiaoqian Chen

Learning joint embedding space for various modalities is of vital importance for multimodal fusion. Mainstream modality fusion approaches fail to achieve this goal, leaving a modality gap which heavily affects cross-modal fusion. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Sijie Mai , Haifeng Hu , Songlong Xing

Adversarial attacks expose a fundamental vulnerability in modern deep vision models by exploiting their dependence on dense, pixel-level representations that are highly sensitive to imperceptible perturbations. Traditional defense…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingjie He , Weijie Liang , Zihan Shan , Matthew Caesar

Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While powerful, this…

Cryptography and Security · Computer Science 2026-03-31 Bhavuk Jain , Sercan Ö. Arık , Hardeo K. Thakur

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Large Vision-Language Models (LVLMs) have transformed multi-modal understanding, excelling in tasks like image captioning and visual question answering by integrating visual and textual inputs. However, their robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Wanlong Fang , Changshuo Wang

Multimodal diffusion models for image editing generate outputs conditioned on both textual instructions and visual inputs, aiming to modify target regions while preserving the rest of the image. Although diffusion models have been shown to…

Cryptography and Security · Computer Science 2025-06-02 Ji Guo , Peihong Chen , Wenbo Jiang , Xiaolei Wen , Jiaming He , Jiachen Li , Guoming Lu , Aiguo Chen , Hongwei Li

Transferability of adversarial examples on image classification has been systematically explored, which generates adversarial examples in black-box mode. However, the transferability of adversarial examples on semantic segmentation has been…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Xiaojun Jia , Jindong Gu , Yihao Huang , Simeng Qin , Qing Guo , Yang Liu , Xiaochun Cao

Deep Neural Networks are vulnerable to adversarial examples, i.e., carefully crafted input samples that can cause models to make incorrect predictions with high confidence. To mitigate these vulnerabilities, adversarial training and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Francesco Villani , Igor Maljkovic , Dario Lazzaro , Angelo Sotgiu , Antonio Emanuele Cinà , Fabio Roli

Machine learning-based malware detectors are increasingly vulnerable to adversarial examples. Traditional defenses, such as one-shot adversarial training, often fail against adaptive attackers who use reinforcement learning to bypass…

Cryptography and Security · Computer Science 2026-04-27 Olha Jurečková , Martin Jureček , Matouš Kozák , Róbert Lórencz

Physical adversarial attacks often overfit single surrogate models and optimization objectives. While ensemble attacks can mitigate this, existing methods struggle with severe gradient conflicts within restricted physical texture spaces,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ziyang Liu , Hongyuan Wang , Zijian Wang , Yinxi Lu , Yunzhao Zang , Zhiqiang Yan , Qianhao Ning

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

The emergence of multimodal large language models has redefined the agent paradigm by integrating language and vision modalities with external data sources, enabling agents to better interpret human instructions and execute increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Le Wang , Zonghao Ying , Tianyuan Zhang , Siyuan Liang , Shengshan Hu , Mingchuan Zhang , Aishan Liu , Xianglong Liu

The integration of an ensemble of deep learning models has been extensively explored to enhance defense against adversarial attacks. The diversity among sub-models increases the attack cost required to deceive the majority of the ensemble,…

Machine Learning · Computer Science 2024-03-26 Kaikang Zhao , Xi Chen , Wei Huang , Liuxin Ding , Xianglong Kong , Fan Zhang

Adversarial attacks present a significant security risk to image recognition tasks. Defending against these attacks in a real-life setting can be compared to the way antivirus software works, with a key consideration being how well the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Haibo Zhang , Zhihua Yao , Kouichi Sakurai

Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Jiafeng Wang , Shuyong Gao , Wenqiang Zhang

Transferable attacks generate adversarial examples on surrogate models to fool unknown victim models, posing real-world threats and growing research interest. Despite focusing on flat losses for transferable adversarial examples, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Zhixuan Zhang , Pingyu Wang , Xingjian Zheng , Linbo Qing , Qi Liu

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

With the rapid advancement of retrieval-augmented vision-language models, multimodal medical retrieval-augmented generation (MMed-RAG) systems are increasingly adopted in clinical decision support. These systems enhance medical applications…

Cryptography and Security · Computer Science 2025-11-25 Yingjia Shang , Yi Liu , Huimin Wang , Furong Li , Wenfang Sun , Wu Chengyu , Yefeng Zheng