English
Related papers

Related papers: Fooling Explanations in Text Classifiers

200 papers

The inability of DNNs to explain their black-box behavior has led to a recent surge of explainability methods. However, there are growing concerns that these explainability methods are not robust and trustworthy. In this work, we perform…

Machine Learning · Computer Science 2023-10-26 Divyansh Srivastava , Tuomas Oikarinen , Tsui-Wei Weng

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

Computation and Language · Computer Science 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

We present a new Convolutional Neural Network (CNN) model for text classification that jointly exploits labels on documents and their component sentences. Specifically, we consider scenarios in which annotators explicitly mark sentences (or…

Computation and Language · Computer Science 2016-09-27 Ye Zhang , Iain Marshall , Byron C. Wallace

Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not align with human intuition, making the explanations not…

Computation and Language · Computer Science 2024-08-20 Lucas E. Resck , Marcos M. Raimundo , Jorge Poco

Configurable systems typically consist of reusable assets that have dependencies between each other. To specify such dependencies, feature models are commonly used. As feature models in practice are often complex, automated reasoning is…

Artificial Intelligence · Computer Science 2025-05-12 Chico Sundermann , Stefan Vill , Elias Kuiter , Sebastian Krieter , Thomas Thüm , Matthias Tichy

Machine learning (ML) methods have experienced significant growth in the past decade, yet their practical application in high-impact real-world domains has been hindered by their opacity. When ML methods are responsible for making critical…

Machine Learning · Computer Science 2025-07-11 Xiangyu Sun , Raquel Aoki , Kevin H. Wilson

Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution…

Artificial Intelligence · Computer Science 2021-07-16 Yibo Hu , Latifur Khan

This study proposes a text classification algorithm based on large language models, aiming to address the limitations of traditional methods in capturing long-range dependencies, understanding contextual semantics, and handling class…

Computation and Language · Computer Science 2025-12-11 Ning Lyu , Yuxi Wang , Feng Chen , Qingyuan Zhang

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-crafted inputs that mislead classification at test time. Recent defenses have been shown to improve adversarial robustness by detecting anomalous deviations from…

Machine Learning · Computer Science 2020-10-20 Francesco Crecchi , Marco Melis , Angelo Sotgiu , Davide Bacciu , Battista Biggio

For an explanation of a deep learning model to be effective, it must provide both insight into a model and suggest a corresponding action in order to achieve some objective. Too often, the litany of proposed explainable deep learning…

Machine Learning · Computer Science 2020-10-09 Laura Rieger , Chandan Singh , W. James Murdoch , Bin Yu

One well motivated explanation method for classifiers leverages counterfactuals which are hypothetical events identical to real observations in all aspects except for one feature. Constructing such counterfactual poses specific challenges…

Machine Learning · Computer Science 2024-09-12 Pirmin Lemberger , Antoine Saillenfest

In this article, we propose using deep learning and transformer architectures combined with classical machine learning algorithms to detect and identify text anomalies in texts. Deep learning model provides a very crucial context…

Computation and Language · Computer Science 2022-11-28 Amir Jafari

Neural networks have recently achieved human-level performance on various challenging natural language processing (NLP) tasks, but it is notoriously difficult to understand why a neural network produced a particular prediction. In this…

Computation and Language · Computer Science 2020-05-01 Sharan Narang , Colin Raffel , Katherine Lee , Adam Roberts , Noah Fiedel , Karishma Malkan

Studies have shown that machine learning systems are vulnerable to adversarial examples in theory and practice. Where previous attacks have focused mainly on visual models that exploit the difference between human and machine perception,…

Cryptography and Security · Computer Science 2025-07-23 Eldor Abdukhamidov , Tamer Abuhmed , Joanna C. S. Santos , Mohammed Abuhamad

Deploying machine learning models in safety-related do-mains (e.g. autonomous driving, medical diagnosis) demands for approaches that are explainable, robust against adversarial attacks and aware of the model uncertainty. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Jan Kronenberger , Anselm Haselhoff

Recent work has shown deep neural networks (DNNs) to be highly susceptible to well-designed, small perturbations at the input layer, or so-called adversarial examples. Taking images as an example, such distortions are often imperceptible,…

Machine Learning · Computer Science 2015-04-13 Shixiang Gu , Luca Rigazio

Deep neural networks (DNN) are increasingly being used to perform algorithm-selection in combinatorial optimisation domains, particularly as they accommodate input representations which avoid designing and calculating features. Mounting…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Emma Hart , Quentin Renau , Kevin Sim , Mohamad Alissa

Deep Neural networks have gained lots of attention in recent years thanks to the breakthroughs obtained in the field of Computer Vision. However, despite their popularity, it has been shown that they provide limited robustness in their…

Machine Learning · Computer Science 2020-08-21 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Interpretability is essential for machine learning models to be trusted and deployed in critical domains. However, existing methods for interpreting text models are often complex, lack mathematical foundations, and their performance is not…

Computation and Language · Computer Science 2024-04-10 Gianluigi Lopardo , Frederic Precioso , Damien Garreau

Deep Neural Networks (DNNs) have been successful in solving real-world tasks in domains such as connected and automated vehicles, disease, and job hiring. However, their implications are far-reaching in critical application areas. Hence,…

Machine Learning · Computer Science 2024-11-05 Yueyang Liu , Yan Huang , Zhipeng Cai