English
Related papers

Related papers: Why You Should Not Trust Interpretations in Machin…

200 papers

Deep neural networks for classification are vulnerable to adversarial attacks, where small perturbations to input samples lead to incorrect predictions. This susceptibility, combined with the black-box nature of such networks, limits their…

Cryptography and Security · Computer Science 2024-08-28 Dipkamal Bhusal , Md Tanvirul Alam , Monish K. Veerabhadran , Michael Clifford , Sara Rampazzi , Nidhi Rastogi

Large Language Models have achieved remarkable success and are increasingly deployed in critical applications involving tabular data, such as Table Question Answering. However, their robustness to the structure of this input remains a…

Machine Learning · Computer Science 2026-05-12 Xinshuai Dong , Haifeng Chen , Xuyuan Liu , Shengyu Chen , Haoyu Wang , Shaoan Xie , Kun Zhang , Zhengzhang Chen

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

Due to their massive success in various domains, deep learning techniques are increasingly used to design network intrusion detection solutions that detect and mitigate unknown and known attacks with high accuracy detection rates and…

Cryptography and Security · Computer Science 2021-12-08 Huda Ali Alatwi , Charles Morisset

Traditional white-box methods for creating adversarial perturbations against LLMs typically rely only on gradient computation from the targeted model, ignoring the internal mechanisms responsible for attack success or failure. Conversely,…

Machine Learning · Computer Science 2025-05-07 Thomas Winninger , Boussad Addad , Katarzyna Kapusta

Popular Natural Language Inference (NLI) datasets have been shown to be tainted by hypothesis-only biases. Adversarial learning may help models ignore sensitive biases and spurious correlations in data. We evaluate whether adversarial…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shreyasi Mandal

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

Modern automated surveillance techniques are heavily reliant on deep learning methods. Despite the superior performance, these learning systems are inherently vulnerable to adversarial attacks - maliciously crafted inputs that are designed…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Kien Nguyen , Tharindu Fernando , Clinton Fookes , Sridha Sridharan

Learning from demonstrations is a popular approach to train AI models; however, their vulnerability to adversarial attacks remains underexplored. We present the first systematic study of adversarial attacks, across a range of both classic…

Machine Learning · Computer Science 2026-04-27 Akansha Kalra , Basavasagar Patil , Guanhong Tao , Daniel S. Brown

While modern day web applications aim to create impact at the civilization level, they have become vulnerable to adversarial activity, where the next cyber-attack can take any shape and can originate from anywhere. The increasing scale and…

Machine Learning · Statistics 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic

Despite many proposed algorithms to provide robustness to deep learning (DL) models, DL models remain susceptible to adversarial attacks. We hypothesize that the adversarial vulnerability of DL models stems from two factors. The first…

Artificial Intelligence · Computer Science 2022-02-21 Mahsa Paknezhad , Cuong Phuc Ngo , Amadeus Aristo Winarto , Alistair Cheong , Chuen Yang Beh , Jiayang Wu , Hwee Kuan Lee

Advances in machine learning and the increasing availability of high-dimensional data have led to the proliferation of social science research that uses the predictions of machine learning models as proxies for measures of human activity or…

Machine Learning · Computer Science 2025-02-19 Luke C Sanford , Megan Ayers , Matthew Gordon , Eliana Stone

Machine learning models are susceptible to adversarial perturbations: small changes to input that can cause large changes in output. It is also demonstrated that there exist input-agnostic perturbations, called universal adversarial…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Konda Reddy Mopuri , Aditya Ganeshan , R. Venkatesh Babu

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

Adversarial attacks pose a significant threat to machine learning models by inducing incorrect predictions through imperceptible perturbations to input data. While these attacks are well studied in unstructured domains such as images, their…

Machine Learning · Computer Science 2025-12-09 Zhipeng He , Chun Ouyang , Lijie Wen , Cong Liu , Catarina Moreira

Precision matrix estimation is a fundamental topic in multivariate statistics and modern machine learning. This paper proposes an adversarially perturbed precision matrix estimation framework, motivated by recent developments in adversarial…

Methodology · Statistics 2026-03-25 Yiling Xie

Machine learning and deep learning in particular has advanced tremendously on perceptual tasks in recent years. However, it remains vulnerable against adversarial perturbations of the input that have been crafted specifically to fool the…

Machine Learning · Statistics 2017-02-22 Jan Hendrik Metzen , Tim Genewein , Volker Fischer , Bastian Bischoff