English
Related papers

Related papers: Integrating Prior Knowledge in Post-hoc Explanatio…

200 papers

The ubiquity of machine learning based predictive models in modern society naturally leads people to ask how trustworthy those models are? In predictive modeling, it is quite common to induce a trade-off between accuracy and…

Machine Learning · Computer Science 2019-04-05 John Mitros , Brian Mac Namee

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

Human-Computer Interaction · Computer Science 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

Counterfactual explanations (CFE) are being widely used to explain algorithmic decisions, especially in consequential decision-making contexts (e.g., loan approval or pretrial bail). In this context, CFEs aim to provide individuals affected…

Machine Learning · Computer Science 2021-02-09 Kiarash Mohammadi , Amir-Hossein Karimi , Gilles Barthe , Isabel Valera

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

Human-Computer Interaction · Computer Science 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen

Recent advances in artificial intelligence (AI) have underscored the need for explainable AI (XAI) to support human understanding of AI systems. Consideration of human factors that impact explanation efficacy, such as mental workload and…

Artificial Intelligence · Computer Science 2023-10-13 Lindsay Sanneman , Mycal Tucker , Julie Shah

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Counterfactual explanations are usually obtained by identifying the smallest change made to an input to change a prediction made by a fixed model (hereafter called sparse methods). Recent work, however, has revitalized an old insight: there…

Machine Learning · Computer Science 2020-06-24 Martin Pawelczyk , Klaus Broelemann , Gjergji Kasneci

There has been a recent resurgence of interest in explainable artificial intelligence (XAI) that aims to reduce the opaqueness of AI-based decision-making systems, allowing humans to scrutinize and trust them. Prior work in this context has…

Artificial Intelligence · Computer Science 2021-06-24 Sainyam Galhotra , Romila Pradhan , Babak Salimi

Counterfactuals play a pivotal role in the two distinct data science fields of causal inference (CI) and explainable artificial intelligence (XAI). While the core idea behind counterfactuals remains the same in both fields--the examination…

Machine Learning · Statistics 2025-05-20 Galit Shmueli , David Martens , Jaewon Yoo , Travis Greene

Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual…

Artificial Intelligence · Computer Science 2023-08-02 Bastian Pfeifer , Mateusz Krzyzinski , Hubert Baniecki , Anna Saranti , Andreas Holzinger , Przemyslaw Biecek

Counterfactual explanations have been widely studied in explainability, with a range of application dependent methods prominent in fairness, recourse and model understanding. The major shortcoming associated with these methods, however, is…

Machine Learning · Computer Science 2023-12-19 Dan Ley , Saumitra Mishra , Daniele Magazzeni

Explanations of an AI's function can assist human decision-makers, but the most useful explanation depends on the decision's context, referred to as the downstream task. User studies are necessary to determine the best explanations for each…

Human-Computer Interaction · Computer Science 2024-09-20 Eura Nofshin , Esther Brown , Brian Lim , Weiwei Pan , Finale Doshi-Velez

This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP…

Machine Learning · Computer Science 2024-02-08 Tobias Clement , Hung Truong Thanh Nguyen , Nils Kemmerzell , Mohamed Abdelaal , Davor Stjelja

Post-hoc explanations provide transparency and are essential for guiding model optimization, such as prompt engineering and data sanitation. However, applying model-agnostic techniques to Large Language Models (LLMs) is hindered by…

Machine Learning · Computer Science 2026-04-13 Junhao Liu , Haonan Yu , Zhenyu Yan , Xin Zhang

Explainability plays a crucial role in providing a more comprehensive understanding of deep learning models' behaviour. This allows for thorough validation of the model's performance, ensuring that its decisions are based on relevant visual…

Machine Learning · Computer Science 2023-06-16 E. Zhixuan Zeng , Hayden Gunraj , Sheldon Fernandez , Alexander Wong

We predict credit applications with off-the-shelf, interchangeable black-box classifiers and we explain single predictions with counterfactual explanations. Counterfactual explanations expose the minimal changes required on the input data…

Artificial Intelligence · Computer Science 2018-11-19 Rory Mc Grath , Luca Costabello , Chan Le Van , Paul Sweeney , Farbod Kamiab , Zhao Shen , Freddy Lecue

Emotional support conversation (ESC) task can utilize various support strategies to help people relieve emotional distress and overcome the problem they face, which has attracted much attention in these years. However, most state-of-the-art…

Computation and Language · Computer Science 2023-02-16 Xiaohan Xu , Xuying Meng , Yequan Wang

Personalisation of products and services is fast becoming the driver of success in banking and commerce. Machine learning holds the promise of gaining a deeper understanding of and tailoring to customers' needs and preferences. Whereas…

Machine Learning · Computer Science 2022-06-30 Charl Maree , Christian Omlin

Counterfactual explanations (CFEs) guide users on how to adjust inputs to machine learning models to achieve desired outputs. While existing research primarily addresses static scenarios, real-world applications often involve data or model…

Machine Learning · Computer Science 2025-02-11 Ignacy Stępka , Mateusz Lango , Jerzy Stefanowski