English
Related papers

Related papers: Textual Manifold-based Defense Against Natural Lan…

200 papers

Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial examples. While numerous successful adversarial attacks have been proposed, defenses against these attacks remain relatively understudied. Existing defense…

Machine Learning · Computer Science 2025-06-17 Furkan Mumcu , Yasin Yilmaz

Large language models are increasingly used for text classification tasks such as sentiment analysis, yet their reliance on natural language prompts exposes them to prompt injection attacks. In particular, class-directive injections exploit…

Computation and Language · Computer Science 2026-02-05 Yanxi Li , Ruocheng Shan

This work starts with the intention of using mathematics to understand the intriguing vulnerability observed by ~\citet{szegedy2013} within artificial neural networks. Along the way, we will develop some novel tools with applications far…

Machine Learning · Computer Science 2024-07-17 Brian Bell

In the rapidly evolving field of artificial intelligence, machine learning emerges as a key technology characterized by its vast potential and inherent risks. The stability and reliability of these models are important, as they are frequent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Haibo Zhang , Zhihua Yao , Kouichi Sakurai , Takeshi Saitoh

Machine learning models, especially deep neural networks (DNNs), have been shown to be vulnerable against adversarial examples which are carefully crafted samples with a small magnitude of the perturbation. Such adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Anand Bhattad , Min Jin Chong , Kaizhao Liang , Bo Li , D. A. Forsyth

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversarial attacks, where…

Computation and Language · Computer Science 2024-07-09 Junjie Wu , Lemao Liu , Wei Bi , Dit-Yan Yeung

Deep Neural Networks (DNNs) are vulnerable to adversarial examples generated by imposing subtle perturbations to inputs that lead a model to predict incorrect outputs. Currently, a large number of researches on defending adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Hua Wang , Jie Wang , Zhaoxia Yin

In recent years, text generation tools utilizing Artificial Intelligence (AI) have occasionally been misused across various domains, such as generating student reports or creative writings. This issue prompts plagiarism detection services…

Computation and Language · Computer Science 2025-04-14 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

Artificial Intelligence · Computer Science 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Adversarial examples present significant challenges to the security of Deep Neural Network (DNN) applications. Specifically, there are patch-based and texture-based attacks that are usually used to craft physical-world adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Wei Zhang , Xinyu Chang , Xiao Li , Yiming Zhu , Xiaolin Hu

We introduce a novel approach to counter adversarial attacks, namely, image resampling. Image resampling transforms a discrete image into a new one, simulating the process of scene recapturing or rerendering as specified by a geometrical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yue Cao , Tianlin Li , Xiaofeng Cao , Ivor Tsang , Yang Liu , Qing Guo

In recent years, Deep Neural Networks (DNNs) have had a dramatic impact on a variety of problems that were long considered very difficult, e. g., image classification and automatic language translation to name just a few. The accuracy of…

Machine Learning · Computer Science 2019-09-13 Yannik Potdevin , Dirk Nowotka , Vijay Ganesh

Deep neural networks have demonstrated cutting edge performance on various tasks including classification. However, it is well known that adversarially designed imperceptible perturbation of the input can mislead advanced classifiers. In…

Machine Learning · Computer Science 2020-01-07 Mehdi Jafarnia-Jahromi , Tasmin Chowdhury , Hsin-Tai Wu , Sayandev Mukherjee

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

We propose a new adversarial attack to Deep Neural Networks for image classification. Different from most existing attacks that directly perturb input pixels, our attack focuses on perturbing abstract features, more specifically, features…

Machine Learning · Computer Science 2020-12-17 Qiuling Xu , Guanhong Tao , Siyuan Cheng , Xiangyu Zhang

While neural machine translation (NMT) models achieve success in our daily lives, they show vulnerability to adversarial attacks. Despite being harmful, these attacks also offer benefits for interpreting and enhancing NMT models, thus…

Computation and Language · Computer Science 2024-09-10 Yanni Xue , Haojie Hao , Jiakai Wang , Qiang Sheng , Renshuai Tao , Yu Liang , Pu Feng , Xianglong Liu

Deep neural networks are vulnerable to so-called adversarial examples: inputs which are intentionally constructed to cause the model to make incorrect predictions or classifications. Adversarial examples are often visually indistinguishable…

Machine Learning · Computer Science 2024-05-28 Jonathan Peck , Bart Goossens

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

Backdoor attacks are a kind of emergent training-time threat to deep neural networks (DNNs). They can manipulate the output of DNNs and possess high insidiousness. In the field of natural language processing, some attack methods have been…

Computation and Language · Computer Science 2021-11-05 Fanchao Qi , Yangyi Chen , Mukai Li , Yuan Yao , Zhiyuan Liu , Maosong Sun

Despite ongoing research on the topic of adversarial examples in deep learning for computer vision, some fundamentals of the nature of these attacks remain unclear. As the manifold hypothesis posits, high-dimensional data tends to be part…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Jens Bayer , Stefan Becker , David Münch , Michael Arens , Jürgen Beyerer