English
Related papers

Related papers: Textual Manifold-based Defense Against Natural Lan…

200 papers

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

Large language models are now tuned to align with the goals of their creators, namely to be "helpful and harmless." These models should respond helpfully to user questions, but refuse to answer requests that could cause harm. However,…

Differential Privacy (DP) for text has recently taken the form of text paraphrasing using language models and temperature sampling to better balance privacy and utility. However, the geometric distortion of DP regarding the structure and…

Computation and Language · Computer Science 2025-03-20 Stefan Arnold

The language models, especially the basic text classification models, have been shown to be susceptible to textual adversarial attacks such as synonym substitution and word insertion attacks. To defend against such attacks, a growing body…

Cryptography and Security · Computer Science 2024-06-12 Xinyu Zhang , Hanbin Hong , Yuan Hong , Peng Huang , Binghui Wang , Zhongjie Ba , Kui Ren

Recent approaches employing imperceptible perturbations in input images have demonstrated promising potential to counter malicious manipulations in diffusion-based image editing systems. However, existing methods suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jie Zhang , Shuai Dong , Shiguang Shan , Xilin Chen

In recent years, diffusion models (DMs) have drawn significant attention for their success in approximating data distributions, yielding state-of-the-art generative results. Nevertheless, the versatility of these models extends beyond their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Peter Lorenz , Ricard Durall , Janis Keuper

A large number of deep neural network based techniques have been developed to address the challenging problem of face presentation attack detection (PAD). Whereas such techniques' focus has been on improving PAD performance in terms of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Hengameh Mirzaalian , Mohamed E. Hussein , Leonidas Spinoulas , Jonathan May , Wael Abd-Almageed

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

The landscape of available textual adversarial attacks keeps growing, posing severe threats and raising concerns regarding the deep NLP system's integrity. However, the crucial problem of defending against malicious attacks has only drawn…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Marine Picot , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the…

Computation and Language · Computer Science 2023-01-26 Jiali Wei , Ming Fan , Wenjing Jiao , Wuxia Jin , Ting Liu

This work presents a thorough review concerning recent studies and text generation advancements using Generative Adversarial Networks. The usage of adversarial learning for text generation is promising as it provides alternatives to…

Computation and Language · Computer Science 2022-12-22 Gustavo Henrique de Rosa , João Paulo Papa

With the rapid advancement of multimodal learning, pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated remarkable capacities in bridging the gap between visual and language modalities. However, these models remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaming Zhang , Xingjun Ma , Xin Wang , Lingyu Qiu , Jiaqi Wang , Yu-Gang Jiang , Jitao Sang

In recent years, deep neural network approaches have been widely adopted for machine learning tasks, including classification. However, they were shown to be vulnerable to adversarial perturbations: carefully crafted small perturbations can…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Pouya Samangouei , Maya Kabkab , Rama Chellappa

Adversarial prompts are capable of jailbreaking frontier large language models (LLMs) and inducing undesirable behaviours, posing a significant obstacle to their safe deployment. Current mitigation strategies primarily rely on activating…

Computation and Language · Computer Science 2025-10-08 Canaan Yung , Hanxun Huang , Christopher Leckie , Sarah Erfani

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Neural networks are vulnerable to adversarial examples, which poses a threat to their application in security sensitive systems. We propose high-level representation guided denoiser (HGD) as a defense for image classification. Standard…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Fangzhou Liao , Ming Liang , Yinpeng Dong , Tianyu Pang , Xiaolin Hu , Jun Zhu

Deep Neural Networks (DNNs) have recently achieved great success in many tasks, which encourages DNNs to be widely used as a machine learning service in model sharing scenarios. However, attackers can easily generate adversarial examples…

Machine Learning · Computer Science 2019-07-17 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the…

Machine Learning · Computer Science 2019-05-31 Samuel Barham , Soheil Feizi

The research field of adversarial machine learning witnessed a significant interest in the last few years. A machine learner or model is secure if it can deliver main objectives with acceptable accuracy, efficiency, etc. while at the same…

Machine Learning · Computer Science 2021-01-22 Izzat Alsmadi

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

Artificial Intelligence · Computer Science 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik