English
Related papers

Related papers: Textual Manifold-based Defense Against Natural Lan…

200 papers

Existing defenses against adversarial attacks are typically tailored to a specific perturbation type. Using adversarial training to defend against multiple types of perturbation requires expensive adversarial examples from different…

Cryptography and Security · Computer Science 2020-10-16 Jay Nandy , Wynne Hsu , Mong Li Lee

Large Language Models (LLMs) are increasingly vulnerable to adversarial prompts that exploit semantic ambiguities to bypass safety mechanisms, resulting in harmful or inappropriate outputs. Such attacks, including jailbreaking and prompt…

Cryptography and Security · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang

While progress has been made in crafting visually imperceptible adversarial examples, constructing semantically meaningful ones remains a challenge. In this paper, we propose a framework to generate semantics preserving adversarial…

Machine Learning · Statistics 2019-12-24 Ousmane Amadou Dia , Elnaz Barshan , Reza Babanezhad

Visual modifications to text are often used to obfuscate offensive comments in social media (e.g., "!d10t") or as a writing style ("1337" in "leet speak"), among other scenarios. We consider this as a new type of adversarial attack in NLP,…

Large language models have become increasingly prominent, also signaling a shift towards multimodality as the next frontier in artificial intelligence, where their embeddings are harnessed as prompts to generate textual content.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiachen Sun , Changsheng Wang , Jiongxiao Wang , Yiwei Zhang , Chaowei Xiao

In the area of natural language processing, deep learning models are recently known to be vulnerable to various types of adversarial perturbations, but relatively few works are done on the defense side. Especially, there exists few…

Computation and Language · Computer Science 2021-06-16 Xiaosen Wang , Hao Jin , Yichen Yang , Kun He

The integration of visual and textual data in Vision-Language Pre-training (VLP) models is crucial for enhancing vision-language understanding. However, the adversarial robustness of these models, especially in the alignment of image-text…

Multimedia · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Hanwang Zhang , Hang Su , Richang Hong

Adversarial samples for images have been extensively studied in the literature. Among many of the attacking methods, gradient-based methods are both effective and easy to compute. In this work, we propose a framework to adapt the gradient…

Computation and Language · Computer Science 2018-01-26 Zhitao Gong , Wenlu Wang , Bo Li , Dawn Song , Wei-Shinn Ku

Unrestricted adversarial attacks typically manipulate the semantic content of an image (e.g., color or texture) to create adversarial examples that are both effective and photorealistic, demonstrating their ability to deceive human…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhaoyu Chen , Bo Li , Shuang Wu , Kaixun Jiang , Shouhong Ding , Wenqiang Zhang

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Modern image classification systems are often built on deep neural networks, which suffer from adversarial examples--images with deliberately crafted, imperceptible noise to mislead the network's classification. To defend against…

Machine Learning · Computer Science 2019-12-02 Chang Xiao , Changxi Zheng

Although deep generative models such as Defense-GAN and Defense-VAE have made significant progress in terms of adversarial defenses of image classification neural networks, several methods have been found to circumvent these defenses. Based…

Cryptography and Security · Computer Science 2020-11-04 Frederick Morlock , Dingsu Wang

This paper addresses the challenge of generating adversarial image using a diffusion model to deceive multimodal large language models (MLLMs) into generating the targeted responses, while avoiding significant distortion of the clean image.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Chengwei Xia , Fan Ma , Ruijie Quan , Kun Zhan , Yi Yang

Recently, advanced NLP models have seen a surge in the usage of various applications. This raises the security threats of the released models. In addition to the clean models' unintentional weaknesses, {\em i.e.,} adversarial attacks, the…

Computation and Language · Computer Science 2021-01-18 Lichao Sun

Deep learning based image classification models are shown vulnerable to adversarial attacks by injecting deliberately crafted noises to clean images. To defend against adversarial attacks in a training-free and attack-agnostic manner, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Li Ding , Yongwei Wang , Xin Ding , Kaiwen Yuan , Ping Wang , Hua Huang , Z. Jane Wang

Recent advancements in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks. While various defence mechanisms have been proposed, there is a lack of comprehensive benchmarks that…

Computation and Language · Computer Science 2025-01-23 Yang Wang , Chenghua Lin

Deep neural networks (DNN) have achieved unprecedented success in numerous machine learning tasks in various domains. However, the existence of adversarial examples has raised concerns about applying deep learning to safety-critical…

Machine Learning · Computer Science 2019-10-10 Han Xu , Yao Ma , Haochen Liu , Debayan Deb , Hui Liu , Jiliang Tang , Anil K. Jain

Recently, some research show that deep neural networks are vulnerable to the adversarial attacks, the well-trainned samples or patches could be used to trick the neural network detector or human visual perception. However, these adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xianyi Chen , Fazhan Liu , Dong Jiang , Kai Yan

Deep learning technology has made great achievements in the field of image. In order to defend against malware attacks, researchers have proposed many Windows malware detection models based on deep learning. However, deep learning models…

Cryptography and Security · Computer Science 2023-07-12 Kun Li , Fan Zhang , Wei Guo

The adversarial attacks against deep neural networks on computer vision tasks have spawned many new technologies that help protect models from avoiding false predictions. Recently, word-level adversarial attacks on deep models of Natural…

Computation and Language · Computer Science 2020-06-15 Zhaoyang Wang , Hongtao Wang