English
Related papers

Related papers: Robust Counterfactual Explanations for Neural Netw…

200 papers

Post-hoc explanation methods are used with the intent of providing insights about neural networks and are sometimes said to help engender trust in their outputs. However, popular explanations methods have been found to be fragile to minor…

Machine Learning · Computer Science 2022-12-19 Matthew Wicker , Juyeon Heo , Luca Costabello , Adrian Weller

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

Machine Learning · Computer Science 2021-06-28 Sadia Chowdhury , Ruth Urner

Causal effects are usually studied in terms of the means of counterfactual distributions, which may be insufficient in many scenarios. Given a class of densities known up to normalizing constants, we propose to model counterfactual…

Methodology · Statistics 2024-02-20 Diego Martinez-Taboada , Edward H. Kennedy

Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness of text classification against word substitutions,…

Computation and Language · Computer Science 2021-05-06 Emanuele La Malfa , Min Wu , Luca Laurenti , Benjie Wang , Anthony Hartshorn , Marta Kwiatkowska

Despite their enormous predictive power, machine learning models are often unsuitable for applications in regulated industries such as finance, due to their limited capacity to provide explanations. While model-agnostic frameworks such as…

Machine Learning · Statistics 2025-11-03 Joshua S. Harvey , Guanchao Feng , Sai Anusha Meesala , Tina Zhao , Dhagash Mehta

Model reparametrization, which follows the change-of-variable rule of calculus, is a popular way to improve the training of neural nets. But it can also be problematic since it can induce inconsistencies in, e.g., Hessian-based flatness…

Machine Learning · Computer Science 2023-10-24 Agustinus Kristiadi , Felix Dangel , Philipp Hennig

We consider here together the inference questions and the change-point problem in Poisson autoregressions (see Tj{\o}stheim, 2012). The conditional mean (or intensity) of the process is involved as a non-linear function of it past values…

Statistics Theory · Mathematics 2013-05-09 Paul Doukhan , William Kengne

Robustness of decision rules to shifts in the data-generating process is crucial to the successful deployment of decision-making systems. Such shifts can be viewed as interventions on a causal graph, which capture (possibly hypothetical)…

Artificial Intelligence · Computer Science 2021-05-20 Benjie Wang , Clare Lyle , Marta Kwiatkowska

Foundation models are a current focus of attention in both industry and academia. While they have shown their capabilities in a variety of tasks, in-depth research is required to determine their robustness to distribution shift when used as…

Computation and Language · Computer Science 2023-12-12 Xiruo Ding , Zhecheng Sheng , Brian Hur , Feng Chen , Serguei V. S. Pakhomov , Trevor Cohen

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Neural network models have become the leading solution for a large variety of tasks, such as classification, language processing, protein folding, and others. However, their reliability is heavily plagued by adversarial inputs: small input…

Machine Learning · Computer Science 2022-10-04 Natan Levy , Guy Katz

The increasing use of Machine Learning (ML) models to aid decision-making in high-stakes industries demands explainability to facilitate trust. Counterfactual Explanations (CEs) are ideally suited for this, as they can offer insights into…

Machine Learning · Computer Science 2025-02-20 Junqi Jiang , Luca Marzari , Aaryan Purohit , Francesco Leofante

We present a general framework for evaluating image counterfactuals. The power and flexibility of deep generative models make them valuable tools for learning mechanisms in structural causal models. However, their flexibility makes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Miguel Monteiro , Fabio De Sousa Ribeiro , Nick Pawlowski , Daniel C. Castro , Ben Glocker

Large Language Models (LLMs) are increasingly used to generate natural-language explanations in recommender systems, acting as explanation agents that reason over user behavior histories. While prior work has focused on explanation fluency…

Information Retrieval · Computer Science 2026-02-04 Guilin Zhang , Kai Zhao , Jeffrey Friedman , Xu Chu

The robustness of neural networks to adversarial examples has received great attention due to security implications. Despite various attack approaches to crafting visually imperceptible adversarial examples, little has been developed…

Machine Learning · Statistics 2018-02-01 Tsui-Wei Weng , Huan Zhang , Pin-Yu Chen , Jinfeng Yi , Dong Su , Yupeng Gao , Cho-Jui Hsieh , Luca Daniel

Explaining the predictions of a deep neural network is a nontrivial task, yet high-quality explanations for predictions are often a prerequisite for practitioners to trust these models. Counterfactual explanations aim to explain predictions…

Machine Learning · Computer Science 2025-01-16 Andreas Abildtrup Hansen , Paraskevas Pegios , Anna Calissano , Aasa Feragen

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an…

Optimization and Control · Mathematics 2025-10-02 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

In this paper, we analyze the properties of invertible neural networks, which provide a way of solving inverse problems. Our main focus lies on investigating and controlling the Lipschitz constants of the corresponding inverse networks.…

Machine Learning · Computer Science 2021-09-01 Paul Hagemann , Sebastian Neumayer

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

Large-scale neural language models exhibit remarkable performance in in-context learning: the ability to learn and reason about the input context on the fly. This work studies in-context counterfactual reasoning in language models, that is,…

Computation and Language · Computer Science 2025-10-22 Moritz Miller , Bernhard Schölkopf , Siyuan Guo