English
Related papers

Related papers: Adversarial Attacks against Closed-Source MLLMs vi…

200 papers

Traditional adversarial attacks typically produce adversarial examples under norm-constrained conditions, whereas unrestricted adversarial examples are free-form with semantically meaningful perturbations. Current unrestricted adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenyun Li , Zheng Zhang , Xiangyuan Lan , Dongmei Jiang

By adding human-imperceptible perturbations to images, DNNs can be easily fooled. As one of the mainstream methods, feature space targeted attacks perturb images by modulating their intermediate feature maps, for the discrepancy between the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Lianli Gao , Yaya Cheng , Qilong Zhang , Xing Xu , Jingkuan Song

Adversarial attack is a technique for deceiving Machine Learning (ML) models, which provides a way to evaluate the adversarial robustness. In practice, attack algorithms are artificially selected and tuned by human experts to break a ML…

Cryptography and Security · Computer Science 2020-12-11 Xiaofeng Mao , Yuefeng Chen , Shuhui Wang , Hang Su , Yuan He , Hui Xue

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

Cryptography and Security · Computer Science 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learning has been widely…

Machine Learning · Computer Science 2020-08-26 Yinghua Zhang , Yangqiu Song , Jian Liang , Kun Bai , Qiang Yang

Despite the remarkable performance of video-based large language models (LLMs), their adversarial threat remains unexplored. To fill this gap, we propose the first adversarial attack tailored for video-based LLMs by crafting flow-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinmin Li , Kuofeng Gao , Yang Bai , Jingyun Zhang , Shu-tao Xia , Yisen Wang

Adversarial attacks provide a good way to study the robustness of deep learning models. One category of methods in transfer-based black-box attack utilizes several image transformation operations to improve the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Zheng Yuan , Jie Zhang , Shiguang Shan

Although deep-learning based video recognition models have achieved remarkable success, they are vulnerable to adversarial examples that are generated by adding human-imperceptible perturbations on clean video samples. As indicated in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Zhipeng Wei , Jingjing Chen , Zuxuan Wu , Yu-Gang Jiang

Despite the success of input transformation-based attacks on boosting adversarial transferability, the performance is unsatisfying due to the ignorance of the discrepancy across models. In this paper, we propose a simple but effective…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Donghua Wang , Wen Yao , Tingsong Jiang , Xiaohu Zheng , Junqi Wu , Xiaoqian Chen

This paper aims to enhance the transferability of adversarial samples in targeted attacks, where attack success rates remain comparatively low. To achieve this objective, we propose two distinct techniques for improving the targeted…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Juanjuan Weng , Zhiming Luo , Shaozi Li

With much longer optimization time than that of untargeted attacks notwithstanding, the transferability of targeted attacks is still far from satisfactory. Recent studies reveal that fine-tuning an existing adversarial example (AE) in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Hui Zeng , Sanshuai Cui , Biwei Chen , Anjie Peng

An adversarial attack paradigm explores various scenarios for the vulnerability of deep learning models: minor changes of the input can force a model failure. Most of the state of the art frameworks focus on adversarial attacks for images…

Machine Learning · Computer Science 2020-06-22 I. Fursov , A. Zaytsev , N. Kluchnikov , A. Kravchenko , E. Burnaev

Due to their multimodal capabilities, Vision-Language Models (VLMs) have found numerous impactful applications in real-world scenarios. However, recent studies have revealed that VLMs are vulnerable to image-based adversarial attacks.…

Machine Learning · Computer Science 2025-03-31 Jiaming Zhang , Junhong Ye , Xingjun Ma , Yige Li , Yunfan Yang , Yunhao Chen , Jitao Sang , Dit-Yan Yeung

Large language models (LLMs) have achieved remarkable performance in various natural language processing tasks, especially in dialogue systems. However, LLM may also pose security and moral threats, especially in multi round conversations…

Computation and Language · Computer Science 2024-05-10 Xikang Yang , Xuehai Tang , Songlin Hu , Jizhong Han

The integration of visual and textual data in Vision-Language Pre-training (VLP) models is crucial for enhancing vision-language understanding. However, the adversarial robustness of these models, especially in the alignment of image-text…

Multimedia · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Hanwang Zhang , Hang Su , Richang Hong

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

The utilization of large foundational models has a dilemma: while fine-tuning downstream tasks from them holds promise for making use of the well-generalized knowledge in practical applications, their open accessibility also poses threats…

Machine Learning · Computer Science 2025-04-22 Song Xia , Wenhan Yang , Yi Yu , Xun Lin , Henghui Ding , Ling-Yu Duan , Xudong Jiang

Large language models (LLMs) remain vulnerable to adversarial prompting despite advances in alignment and safety, often exhibiting harmful behaviors under novel attack strategies. While adversarial training can improve robustness, existing…

Machine Learning · Computer Science 2026-05-08 Yiwei Zhang , Jeremiah Birrell , Reza Ebrahimi , Rouzbeh Behnia , Jason Pacheco , Elisa Bertino

The security of models based on new architectures such as MLP-Mixer and ViTs needs to be studied urgently. However, most of the current researches are mainly aimed at the adversarial attack against ViTs, and there is still relatively little…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Haoran Lyu , Yajie Wang , Yu-an Tan , Huipeng Zhou , Yuhang Zhao , Quanxin Zhang

Large Language Models (LLMs) have demonstrated remarkable performance in real-world applications. However, adapting LLMs to novel tasks via fine-tuning often requires substantial training data and computational resources that are…

Machine Learning · Computer Science 2025-05-27 Boyan Gao , Xin Wang , Yibo Yang , David Clifton