English
Related papers

Related papers: Towards Rigorous Explainability by Feature Attribu…

200 papers

Explainable AI (XAI) is critical for ensuring transparency, accountability, and trust in machine learning systems as black-box models are increasingly deployed within high-stakes domains. Among XAI methods, Shapley values are widely used…

Machine Learning · Computer Science 2025-02-19 Jiaxin Xu , Hung Chau , Angela Burden

The field of eXplainable Artificial Intelligence faces challenges due to the absence of a widely accepted taxonomy that facilitates the quantitative evaluation of explainability in Machine Learning algorithms. In this paper, we propose a…

Information Retrieval · Computer Science 2023-11-07 Riccardo Porcedda

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

Artificial Intelligence · Computer Science 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI (XAI) and its promise to render AI devices more…

Artificial Intelligence · Computer Science 2023-02-27 Giovanni Cinà , Tabea E. Röber , Rob Goedhart , Ş. İlker Birbil

The increasing use of Machine Learning (ML) in sensitive domains such as healthcare, finance, and public policy has raised concerns about the transparency of automated decisions. Explainable AI (XAI) addresses this by clarifying how models…

Artificial Intelligence · Computer Science 2026-02-13 Natalia Abarca , Andrés Carvallo , Claudia López Moncada , Felipe Bravo-Marquez

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

Artificial Intelligence · Computer Science 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

The advances in Machine Learning (ML) in recent years have been both impressive and far-reaching. However, the deployment of ML models is still impaired by a lack of trust in how the best-performing ML models make predictions. The issue of…

Artificial Intelligence · Computer Science 2023-06-06 Joao Marques-Silva

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

Explainable AI (XAI) promises to provide insight into machine learning models' decision processes, where one goal is to identify failures such as shortcut learning. This promise relies on the field's assumption that input features marked as…

Machine Learning · Computer Science 2026-02-19 Benedict Clark , Marta Oliveira , Rick Wilming , Stefan Haufe

Established approaches to assuring safety-critical systems and software are difficult to apply to systems employing ML where there is no clear, pre-defined specification against which to assess validity. This problem is exacerbated by the…

Machine Learning · Computer Science 2022-05-06 Yan Jia , John McDermid , Tom Lawton , Ibrahim Habli

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box…

Machine Learning · Computer Science 2022-03-16 Leander Weber , Sebastian Lapuschkin , Alexander Binder , Wojciech Samek

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

As machine learning models grow more complex and their applications become more high-stakes, tools for explaining model predictions have become increasingly important. This has spurred a flurry of research in model explainability and has…

Machine Learning · Computer Science 2021-11-08 Yang Liu , Sujay Khandagale , Colin White , Willie Neiswanger

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our lives. XAI systems are…

Artificial Intelligence · Computer Science 2021-02-10 Shane T. Mueller , Elizabeth S. Veinott , Robert R. Hoffman , Gary Klein , Lamia Alam , Tauseef Mamun , William J. Clancey

Explainable artificial intelligence (XAI) holds immense significance in enhancing the deep neural network's transparency and credibility, particularly in some risky and high-cost scenarios, like synthetic aperture radar (SAR). Shapley is a…

Artificial Intelligence · Computer Science 2024-01-09 Xuran Hu , Mingzhe Zhu , Yuanjing Liu , Zhenpeng Feng , LJubisa Stankovic

Shapley values are extensively used in explainable artificial intelligence (XAI) as a framework to explain predictions made by complex machine learning (ML) models. In this work, we focus on conditional Shapley values for predictive models…

Machine Learning · Statistics 2023-12-07 Lars Henry Berge Olsen

The field explainable artificial intelligence (XAI) has brought about an arsenal of methods to render Machine Learning (ML) predictions more interpretable. But how useful explanations provided by transparent ML methods are for humans…

Human-Computer Interaction · Computer Science 2021-07-06 Felix Biessmann , Dionysius Refiano