English
Related papers

Related papers: Fixing confirmation bias in feature attribution me…

200 papers

Feature attribution methods are widely used for explaining image-based predictions, as they provide feature-level insights that can be intuitively visualized. However, such explanations often vary in their robustness and may fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Amr Alkhatib , Stephanie Lowry

Explainable Artificial Intelligence (XAI) has become critical in enhancing the transparency and trustworthiness of AI systems, especially as these systems are increasingly deployed in high-stakes domains such as healthcare and finance.…

Symbolic Computation · Computer Science 2024-08-13 Shengxin Hong , Xiuyi Fan

Artificial Intelligence (AI) is rapidly embedded in critical decision-making systems, however their foundational ``black-box'' models require eXplainable AI (XAI) solutions to enhance transparency, which are mostly oriented to experts,…

Machine Learning · Computer Science 2025-06-17 Eva Paraschou , Ioannis Arapakis , Sofia Yfantidou , Sebastian Macaluso , Athena Vakali

As machine learning (ML) models and datasets increase in complexity, the demand for methods that enhance explainability and interpretability becomes paramount. Prototypes, by encapsulating essential characteristics within data, offer…

Machine Learning · Computer Science 2024-08-20 Orfeas Menis-Mastromichalakis , Giorgos Filandrianos , Jason Liartis , Edmund Dervakos , Giorgos Stamou

The advances in Artificial Intelligence are creating new opportunities to improve lives of people around the world, from business to healthcare, from lifestyle to education. For example, some systems profile the users using their…

Machine Learning · Computer Science 2023-01-02 Arkadipta De , Satya Swaroop Gudipudi , Sourab Panchanan , Maunendra Sankar Desarkar

Confirmation bias is a cognitive bias that adversely affects management decisions, and mathematical modelling is an aid to its detailed understanding. Bias in opinion update about the value of a parameter is modelled here assuming that…

Other Statistics · Statistics 2022-02-08 Rose D Baker

Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by…

Human-Computer Interaction · Computer Science 2024-05-09 Katelyn Morrison , Philipp Spitzer , Violet Turri , Michelle Feng , Niklas Kühl , Adam Perer

This paper systematically derives design dimensions for the structured evaluation of explainable artificial intelligence (XAI) approaches. These dimensions enable a descriptive characterization, facilitating comparisons between different…

Human-Computer Interaction · Computer Science 2020-09-15 Fabian Sperrle , Mennatallah El-Assady , Grace Guo , Duen Horng Chau , Alex Endert , Daniel Keim

This work presents a conceptual framework for causal concept-based post-hoc Explainable Artificial Intelligence (XAI), based on the requirements that explanations for non-interpretable models should be understandable as well as faithful to…

Artificial Intelligence · Computer Science 2025-12-03 Anna Rodum Bjøru , Jacob Lysnæs-Larsen , Oskar Jørgensen , Inga Strümke , Helge Langseth

We investigate a formalism for the conditions of a successful explanation of AI. We consider "success" to depend not only on what information the explanation contains, but also on what information the human explainee understands from it.…

Artificial Intelligence · Computer Science 2023-11-21 Alon Jacovi , Jasmijn Bastings , Sebastian Gehrmann , Yoav Goldberg , Katja Filippova

In the field of Explainable AI, multiples evaluation metrics have been proposed in order to assess the quality of explanation methods w.r.t. a set of desired properties. In this work, we study the articulation between the stability,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Romain Xu-Darme , Jenny Benois-Pineau , Romain Giot , Georges Quénot , Zakaria Chihani , Marie-Christine Rousset , Alexey Zhukov

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

Artificial Intelligence · Computer Science 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

Our work serves as a framework for unifying the challenges of contemporary explainable AI (XAI). We demonstrate that while XAI methods provide supplementary and potentially useful output for machine learning models, researchers and…

Artificial Intelligence · Computer Science 2023-07-17 Alicja Chaszczewicz

The trustworthiness of Machine Learning (ML) models can be difficult to assess, but is critical in high-risk or ethically sensitive applications. Many models are treated as a `black-box' where the reasoning or criteria for a final decision…

Machine Learning · Computer Science 2024-07-11 Saif Anwar , Nathan Griffiths , Abhir Bhalerao , Thomas Popham

The advances in Machine Learning (ML) in recent years have been both impressive and far-reaching. However, the deployment of ML models is still impaired by a lack of trust in how the best-performing ML models make predictions. The issue of…

Artificial Intelligence · Computer Science 2023-06-06 Joao Marques-Silva

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

With the widespread use of sophisticated machine learning models in sensitive applications, understanding their decision-making has become an essential task. Models trained on tabular data have witnessed significant progress in explanations…

Machine Learning · Computer Science 2022-06-16 Aditya Lahiri , Kamran Alipour , Ehsan Adeli , Babak Salimi

Recent research in explainability has given rise to numerous post-hoc attribution methods aimed at enhancing our comprehension of the outputs of black-box machine learning models. However, evaluating the quality of explanations lacks a…

Machine Learning · Computer Science 2024-07-30 Samuel Sithakoul , Sara Meftah , Clément Feutry

We introduce PASTA (Perceptual Assessment System for explanaTion of Artificial Intelligence), a novel human-centric framework for evaluating eXplainable AI (XAI) techniques in computer vision. Our first contribution is the creation of the…