English
Related papers

Related papers: Robust Counterfactual Explanations for Neural Netw…

200 papers

In order to make argumentation-based inference contestable, it is crucial to explain what changes can achieve a desired (instead of the contested) inference result. To this end, we introduce strength change explanations for quantitative…

Multiagent Systems · Computer Science 2026-03-03 Timotheus Kampik , Xiang Yin , Nico Potyka , Francesca Toni

This paper studies the design of mechanisms that are robust to misspecification. We introduce a novel notion of robustness that connects a variety of disparate approaches and study its implications in a wide class of mechanism design…

Theoretical Economics · Economics 2021-08-31 Giuseppe Lopomo , Luca Rigotti , Chris Shannon

Massive deployment of Graph Neural Networks (GNNs) in high-stake applications generates a strong demand for explanations that are robust to noise and align well with human intuition. Most existing methods generate explanations by…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Zi Yu Xue , Jian Pei , Lanjun Wang , Peter Cho-Ho Lam , Yong Zhang

In natural phenomena, data distributions often deviate from normality. One can think of cataclysms as a self-explanatory example: events that occur almost never, and at the same time are many standard deviations away from the common…

Machine Learning · Computer Science 2022-12-16 Nuno Costa , Nuno Moniz

Counterfactual Explanations (CEs) have emerged as a major paradigm in explainable AI research, providing recourse recommendations for users affected by the decisions of machine learning models. However, CEs found by existing methods often…

Machine Learning · Computer Science 2024-11-25 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

We examine the issue of stability of probability in reasoning about complex systems with uncertainty in structure. Normally, propositions are viewed as probability functions on an abstract random graph where it is implicitly assumed that…

Artificial Intelligence · Computer Science 2017-12-14 Subhash Kak

We design and conduct a simple experiment to study whether neural networks can perform several steps of approximate reasoning in a fixed dimensional latent space. The set of rewrites (i.e. transformations) that can be successfully performed…

Machine Learning · Computer Science 2019-09-27 Dennis Lee , Christian Szegedy , Markus N. Rabe , Sarah M. Loos , Kshitij Bansal

We examine the impact of learning Lipschitz continuous models in the context of model-based reinforcement learning. We provide a novel bound on multi-step prediction error of Lipschitz models where we quantify the error using the…

Machine Learning · Computer Science 2018-07-30 Kavosh Asadi , Dipendra Misra , Michael L. Littman

Model robustness indicates a model's capability to generalize well on unforeseen distributional shifts, including data corruptions and adversarial attacks. Data augmentation is one of the most prevalent and effective ways to enhance…

Machine Learning · Computer Science 2025-12-16 Weebum Yoo , Sung Whan Yoon

Many works show that node-level predictions of Graph Neural Networks (GNNs) are unrobust to small, often termed adversarial, changes to the graph structure. However, because manual inspection of a graph is difficult, it is unclear if the…

Machine Learning · Computer Science 2023-05-03 Lukas Gosch , Daniel Sturm , Simon Geisler , Stephan Günnemann

We introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two. Such a…

Machine Learning · Computer Science 2019-03-06 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Nicola Paoletti , Andrea Patane , Matthew Wicker

Deep neural networks have shown remarkable performance across a wide range of vision-based tasks, particularly due to the availability of large-scale datasets for training and better architectures. However, data seen in the real world are…

Machine Learning · Computer Science 2018-11-26 Muhammad Usama , Dong Eui Chang

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

The use of available disturbance predictions within a nominal model predictive control formulation is studied. The main challenge that arises is the loss of recursive feasibility and stability guarantees when a persistent disturbance is…

Systems and Control · Computer Science 2018-07-31 Pablo R Baldivieso-Monasterios , Paul A. Trodden

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

Lipschitz continuity is a crucial functional property of any predictive model, that naturally governs its robustness, generalisation, as well as adversarial vulnerability. Contrary to other works that focus on obtaining tighter bounds and…

Machine Learning · Computer Science 2024-05-16 Grigory Khromov , Sidak Pal Singh

Explanation methods have emerged as an important tool to highlight the features responsible for the predictions of neural networks. There is mounting evidence that many explanation methods are rather unreliable and susceptible to malicious…

Computation and Language · Computer Science 2022-06-27 Shriya Atmakuri , Tejas Chheda , Dinesh Kandula , Nishant Yadav , Taesung Lee , Hessel Tuinhof

As attribution-based explanation methods are increasingly used to establish model trustworthiness in high-stakes situations, it is critical to ensure that these explanations are stable, e.g., robust to infinitesimal perturbations to an…

Robustness is widely regarded as a fundamental problem in the analysis of machine learning (ML) models. Most often robustness equates with deciding the non-existence of adversarial examples, where adversarial examples denote situations…

Machine Learning · Computer Science 2023-12-19 Yacine Izza , Joao Marques-Silva