English
Related papers

Related papers: TextShield: Beyond Successfully Detecting Adversar…

200 papers

Though deep neural network has hit a huge success in recent studies and applica- tions, it still remains vulnerable to adversarial perturbations which are imperceptible to humans. To address this problem, we propose a novel network called…

Machine Learning · Computer Science 2017-12-25 Jiefeng Chen , Zihang Meng , Changtian Sun , Wei Tang , Yinglun Zhu

Despite the wide use of machine learning in adversarial settings including computer security, recent studies have demonstrated vulnerabilities to evasion attacks---carefully crafted adversarial samples that closely resemble legitimate…

Cryptography and Security · Computer Science 2017-05-26 Yi Han , Benjamin I. P. Rubinstein

Given the increasing threat of adversarial attacks on deep neural networks (DNNs), research on efficient detection methods is more important than ever. In this work, we take a closer look at adversarial attack detection based on the class…

Machine Learning · Computer Science 2021-07-12 Tobias Uelwer , Felix Michels , Oliver De Candido

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

DNNs are known to be vulnerable to so-called adversarial attacks that manipulate inputs to cause incorrect results that can be beneficial to an attacker or damaging to the victim. Recent works have proposed approximate computation as a…

Cryptography and Security · Computer Science 2022-08-02 Mohammad Hossein Samavatian , Saikat Majumdar , Kristin Barber , Radu Teodorescu

Visual modifications to text are often used to obfuscate offensive comments in social media (e.g., "!d10t") or as a writing style ("1337" in "leet speak"), among other scenarios. We consider this as a new type of adversarial attack in NLP,…

Text generation is of particular interest in many NLP applications such as machine translation, language modeling, and text summarization. Generative adversarial networks (GANs) achieved a remarkable success in high quality image generation…

Computation and Language · Computer Science 2019-05-07 Md. Akmal Haidar , Mehdi Rezagholizadeh

There are two cases describing how a classifier processes input text, namely, misclassification and correct classification. In terms of misclassified texts, a classifier handles the texts with both incorrect predictions and adversarial…

Computation and Language · Computer Science 2021-10-14 Hoang-Quoc Nguyen-Son , Seira Hidano , Kazuhide Fukushima , Shinsaku Kiyomoto

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

Computation and Language · Computer Science 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

Large Language Models' safety remains a critical concern due to their vulnerability to adversarial attacks, which can prompt these systems to produce harmful responses. In the heart of these systems lies a safety classifier, a computational…

Computation and Language · Computer Science 2023-11-02 Jinhwa Kim , Ali Derakhshan , Ian G. Harris

Adversarial sample attacks perturb benign inputs to induce DNN misbehaviors. Recent research has demonstrated the widespread presence and the devastating consequences of such attacks. Existing defense techniques either assume prior…

Machine Learning · Computer Science 2018-10-30 Guanhong Tao , Shiqing Ma , Yingqi Liu , Xiangyu Zhang

In social media, neural network models have been applied to hate speech detection, sentiment analysis, etc., but neural network models are susceptible to adversarial attacks. For instance, in a text classification task, the attacker…

Computation and Language · Computer Science 2024-12-04 Xi Cao , Nuo Qun , Quzong Gesang , Yulei Zhu , Trashi Nyima

Adversarial examples have proven to threaten speaker identification systems, and several countermeasures against them have been proposed. In this paper, we propose a method to detect the presence of adversarial examples, i.e., a binary…

Sound · Computer Science 2024-03-01 Sonal Joshi , Thomas Thebaud , Jesús Villalba , Najim Dehak

Adversarial attacks on machine learning algorithms have been a key deterrent to the adoption of AI in many real-world use cases. They significantly undermine the ability of high-performance neural networks by forcing misclassifications.…

Machine Learning · Computer Science 2024-04-04 Nandish Chattopadhyay , Atreya Goswami , Anupam Chattopadhyay

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

Artificial Intelligence · Computer Science 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

This study aims to demonstrate the methods for detecting negations in a sentence by uniquely evaluating the lexical structure of the text via word-sense disambiguation. The proposed framework examines all the unique features in the various…

Computation and Language · Computer Science 2025-02-11 Izunna Okpala , Guillermo Romera Rodriguez , Andrea Tapia , Shane Halse , Jess Kropczynski

Despite neural networks have achieved prominent performance on many natural language processing (NLP) tasks, they are vulnerable to adversarial examples. In this paper, we propose Dirichlet Neighborhood Ensemble (DNE), a randomized…

Computation and Language · Computer Science 2020-06-23 Yi Zhou , Xiaoqing Zheng , Cho-Jui Hsieh , Kai-wei Chang , Xuanjing Huang

Over the past few years, various word-level textual attack approaches have been proposed to reveal the vulnerability of deep neural networks used in natural language processing. Typically, these approaches involve an important optimization…

Computation and Language · Computer Science 2021-11-23 Shengcai Liu , Ning Lu , Cheng Chen , Ke Tang

Deep Learning based AI systems have shown great promise in various domains such as vision, audio, autonomous systems (vehicles, drones), etc. Recent research on neural networks has shown the susceptibility of deep networks to adversarial…

Machine Learning · Computer Science 2019-11-25 Sambuddha Saha , Aashish Kumar , Pratyush Sahay , George Jose , Srinivas Kruthiventi , Harikrishna Muralidhara

The increasing prevalence of Large Language Models (LLMs) in content creation has made distinguishing human-written textual content from LLM-generated counterparts a critical task for multimedia moderation. Existing detectors often rely on…

Computation and Language · Computer Science 2026-05-08 Siyuan Li , Aodu Wulianghai , Xi Lin , Xibin Yuan , Qinghua Mao , Guangyan Li , Xiang Chen , Jun Wu , Jianhua Li