English
Related papers

Related papers: XAudit : A Theoretical Look at Auditing with Expla…

200 papers

In addition to the impressive predictive power of machine learning (ML) models, more recently, explanation methods have emerged that enable an interpretation of complex non-linear learning models such as deep neural networks. Gaining a…

Machine Learning · Computer Science 2023-01-18 Simon Letzgus , Patrick Wagner , Jonas Lederer , Wojciech Samek , Klaus-Robert Müller , Gregoire Montavon

While machine learning models are usually assumed to always output a prediction, there also exist extensions in the form of reject options which allow the model to reject inputs where only a prediction with an unacceptably low certainty…

Machine Learning · Computer Science 2022-02-16 André Artelt , Johannes Brinkrolf , Roel Visser , Barbara Hammer

In many applications, it is important to be able to explain the decisions of machine learning systems. An increasingly popular approach has been to seek to provide \emph{counterfactual instance explanations}. These specify close possible…

Artificial Intelligence · Computer Science 2021-09-22 Adam White , Artur d'Avila Garcez

Abductive explanations (AXp's) are widely used for understanding decisions of classifiers. Existing definitions are suitable when features are independent. However, we show that ignoring constraints when they exist between features may lead…

Artificial Intelligence · Computer Science 2024-09-19 Martin Cooper , Leila Amgoud

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2024-07-23 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

Explanations of model behavior are commonly evaluated via proxy properties weakly tied to the purposes explanations serve in practice. We contribute a decision theoretic framework that treats explanations as information signals valued by…

Artificial Intelligence · Computer Science 2026-02-24 Ziyang Guo , Berk Ustun , Jessica Hullman

AI-driven outcomes can be challenging for end-users to understand. Explanations can address two key questions: "Why this outcome?" (factual) and "Why not another?" (counterfactual). While substantial efforts have been made to formalize…

Artificial Intelligence · Computer Science 2025-03-21 Suryani Lim , Henri Prade , Gilles Richard

In this position paper, I provide a socio-technical perspective on machine learning-based systems. I also explain why systematic audits may be preferable to explainable AI systems. I make concrete recommendations for how institutions…

Human-Computer Interaction · Computer Science 2021-07-22 Hendrik Heuer

Explainable Artificial Intelligence (XAI) has emerged as a critical area of research to unravel the opaque inner logic of (deep) machine learning models. Among the various XAI techniques proposed in the literature, counterfactual…

Artificial Intelligence · Computer Science 2025-01-28 Flavio Giorgi , Cesare Campagnano , Fabrizio Silvestri , Gabriele Tolomei

In recent years, there has been an explosion of AI research on counterfactual explanations as a solution to the problem of eXplainable AI (XAI). These explanations seem to offer technical, psychological and legal benefits over other…

Machine Learning · Computer Science 2021-05-03 Mark T Keane , Eoin M Kenny , Eoin Delaney , Barry Smyth

Machine learning based decision making systems applied in safety critical areas require reliable high certainty predictions. For this purpose, the system can be extended by an reject option which allows the system to reject inputs where…

Machine Learning · Computer Science 2022-07-06 André Artelt , Barbara Hammer

In this paper we introduce and evaluate a distal explanation model for model-free reinforcement learning agents that can generate explanations for `why' and `why not' questions. Our starting point is the observation that causal models can…

Artificial Intelligence · Computer Science 2020-09-15 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

Explainable models in Artificial Intelligence are often employed to ensure transparency and accountability of AI systems. The fidelity of the explanations are dependent upon the algorithms used as well as on the fidelity of the data. Many…

Machine Learning · Computer Science 2019-07-31 Muhammad Aurangzeb Ahmad , Carly Eckert , Ankur Teredesai

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Much of explainable AI research treats explanations as a means for model inspection. Yet, this neglects findings from human psychology that describe the benefit of self-explanations in an agent's learning process. Motivated by this, we…

Artificial Intelligence · Computer Science 2024-09-18 Wolfgang Stammer , Felix Friedrich , David Steinmann , Manuel Brack , Hikaru Shindo , Kristian Kersting

Machine learning methods have garnered increasing interest among actuaries in recent years. However, their adoption by practitioners has been limited, partly due to the lack of transparency of these methods, as compared to generalized…

Risk Management · Quantitative Finance 2020-03-25 Kevin Kuo , Daniel Lupton

The need to explain the output from Machine Learning systems designed to predict the outcomes of legal cases has led to a renewed interest in the explanations offered by traditional AI and Law systems, especially those using factor based…

Artificial Intelligence · Computer Science 2021-06-29 Trevor Bench-Capon

Explaining how to get from A to B can be challenging. It requires mentally simulating what the listener will do based on what they are told. To capture this process, we propose a computational model that converts utterances into action…

Computation and Language · Computer Science 2026-05-12 Hanqi Zhou , Britt Besch , Charley M. Wu , Tobias Gerstenberg