English
Related papers

Related papers: Enhancing Adversarial Transferability in Visual-La…

200 papers

Adversarial examples have attracted widespread attention in security-critical applications because of their transferability across different models. Although many methods have been proposed to boost adversarial transferability, a gap still…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xingxing Wei , Shiji Zhao

Vision-language pre-trained (VLP) models have been the foundation of numerous vision-language tasks. Given their prevalence, it becomes imperative to assess their adversarial robustness, especially when deploying them in security-crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Peng-Fei Zhang , Zi Huang , Guangdong Bai

The emergence of vision-language-action models (VLAs) for end-to-end control is reshaping the field of robotics by enabling the fusion of multimodal sensory inputs at the billion-parameter scale. The capabilities of VLAs stem primarily from…

Deep neural networks can be vulnerable to adversarially crafted examples, presenting significant risks to practical applications. A prevalent approach for adversarial attacks relies on the transferability of adversarial examples, which are…

Information Retrieval · Computer Science 2024-11-12 Shanjun Xu , Linghui Li , Kaiguo Yuan , Bingyu Li

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

Artificial Intelligence · Computer Science 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

Regional adversarial attacks often rely on complicated methods for generating adversarial perturbations, making it hard to compare their efficacy against well-known attacks. In this study, we show that effective regional perturbations can…

Machine Learning · Computer Science 2020-07-21 Utku Ozbulak , Jonathan Peck , Wesley De Neve , Bart Goossens , Yvan Saeys , Arnout Van Messem

Person re-identification (re-id) models are vital in security surveillance systems, requiring transferable adversarial attacks to explore the vulnerabilities of them. Recently, vision-language models (VLM) based attacks have shown superior…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yuan Bian , Min Liu , Yunqi Yi , Xueping Wang , Yaonan Wang

Video-language pre-training is a typical and challenging problem that aims at learning visual and textual representations from large-scale data in a self-supervised way. Existing pre-training approaches either captured the correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shentong Mo , Haofan Wang , Huaxia Li , Xu Tang

Efficiently building an adversarial attacker for natural language processing (NLP) tasks is a real challenge. Firstly, as the sentence space is discrete, it is difficult to make small perturbations along the direction of gradients.…

Computation and Language · Computer Science 2020-07-14 Huangzhao Zhang , Hao Zhou , Ning Miao , Lei Li

Although the adoption rate of deep neural networks (DNNs) has tremendously increased in recent years, a solution for their vulnerability against adversarial examples has not yet been found. As a result, substantial research efforts are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Utku Ozbulak , Esla Timothy Anzaku , Wesley De Neve , Arnout Van Messem

With the advancement of vision transformers (ViTs) and self-supervised learning (SSL) techniques, pre-trained large ViTs have become the new foundation models for computer vision applications. However, studies have shown that, like…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weijie Zheng , Xingjun Ma , Hanxun Huang , Zuxuan Wu , Yu-Gang Jiang

Modern large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities for coding tasks including writing and reasoning about code. They improve upon previous neural network models of code, such as code2seq or…

Machine Learning · Computer Science 2023-11-23 Chi Zhang , Zifan Wang , Ravi Mangal , Matt Fredrikson , Limin Jia , Corina Pasareanu

Various methods try to enhance adversarial transferability by improving the generalization from different perspectives. In this paper, we rethink the optimization process and propose a novel sequence optimization concept, which is named…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Ying , Qianmu Li , Tao Wang , Zhichao Lian , Shunmei Meng , Xuyun Zhang

Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts have sought to identify which source samples are the most…

Computation and Language · Computer Science 2023-06-26 Vyas Raina , Mark Gales

Vision-language models (VLMs) rely on a shared visual-textual representation space to perform tasks such as zero-shot classification, image captioning, and visual question answering (VQA). While this shared space enables strong cross-task…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Chengyin Hu , Jiaju Han , Xuemeng Sun , Qike Zhang , Yiwei Wei , Ang Li , Chunlei Meng , Xiang Chen , Jiahuan Long

Recent studies on adversarial examples expose vulnerabilities of natural language processing (NLP) models. Existing techniques for generating adversarial examples are typically driven by deterministic hierarchical rules that are agnostic to…

Cryptography and Security · Computer Science 2024-03-25 Mingze Ni , Zhensu Sun , Wei Liu

With the great advancements in large language models (LLMs), adversarial attacks against LLMs have recently attracted increasing attention. We found that pre-existing adversarial attack methodologies exhibit limited transferability and are…

Computation and Language · Computer Science 2024-09-10 Zelin Li , Kehai Chen , Lemao Liu , Xuefeng Bai , Mingming Yang , Yang Xiang , Min Zhang

The widespread use of Vision Language Models (VLMs, e.g. CLIP) has raised concerns about their vulnerability to sophisticated and imperceptible adversarial attacks. These attacks could compromise model performance and system security in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiaowei Fu , Lei Zhang

Visual Language Models (VLMs) are vulnerable to adversarial attacks, especially those from adversarial images, which is however under-explored in literature. To facilitate research on this critical safety problem, we first construct a new…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Youcheng Huang , Fengbin Zhu , Jingkun Tang , Pan Zhou , Wenqiang Lei , Jiancheng Lv , Tat-Seng Chua

Recent vision-language foundation models, such as CLIP, have demonstrated superior capabilities in learning representations that can be transferable across diverse range of downstream tasks and domains. With the emergence of such powerful…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hunmin Yang , Jongoh Jeong , Kuk-Jin Yoon