English
Related papers

Related papers: Predictability and Comprehensibility in Post-Hoc X…

200 papers

Artificial intelligence (AI) is becoming increasingly complex, making it difficult for users to understand how the AI has derived its prediction. Using explainable AI (XAI)-methods, researchers aim to explain AI decisions to users. So far,…

Human-Computer Interaction · Computer Science 2022-10-06 Lara Riefle , Patrick Hemmer , Carina Benz , Michael Vössing , Jannik Pries

Experimental user studies evaluating the effectiveness of different subtypes of post-hoc explanations for black-box models are largely nonexistent. Therefore, the aim of this study was to investigate and evaluate how different types of…

Human-Computer Interaction · Computer Science 2026-04-14 Tabea E. Röber , Paul Festor , Rob Goedhart , S. İlker Birbil , Aldo Faisal

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Explainable AI (XAI) methods generally fall into two categories. Post-hoc approaches generate explanations for pre-trained models and are compatible with various neural network architectures. These methods often use feature importance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Piotr Borycki , Magdalena Trędowicz , Szymon Janusz , Jacek Tabor , Przemysław Spurek , Arkadiusz Lewicki , Łukasz Struski

Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not align with human intuition, making the explanations not…

Computation and Language · Computer Science 2024-08-20 Lucas E. Resck , Marcos M. Raimundo , Jorge Poco

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

Machine Learning · Computer Science 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Post-hoc interpretability methods play a critical role in explainable artificial intelligence (XAI), as they pinpoint portions of data that a trained deep learning model deemed important to make a decision. However, different post-hoc…

Machine Learning · Computer Science 2024-07-30 Jiawen Wei , Hugues Turbé , Gianmarco Mengaldo

Explainable AI is an evolving area that deals with understanding the decision making of machine learning models so that these models are more transparent, accountable, and understandable for humans. In particular, post-hoc model-agnostic…

Machine Learning · Computer Science 2023-07-04 Praharsh Nanavati , Ranjitha Prasad

This study proposes an innovative explainable predictive quality analytics solution to facilitate data-driven decision-making for process planning in manufacturing by combining process mining, machine learning, and explainable artificial…

Machine Learning · Computer Science 2021-06-11 Nijat Mehdiyev , Peter Fettke

A critical problem in the field of post hoc explainability is the lack of a common foundational goal among methods. For example, some methods are motivated by function approximation, some by game theoretic notions, and some by obtaining…

Machine Learning · Computer Science 2023-01-02 Tessa Han , Suraj Srinivas , Himabindu Lakkaraju

The interpretability of model has become one of the obstacles to its wide application in the high-stake fields. The usual way to obtain interpretability is to build a black-box first and then explain it using the post-hoc methods. However,…

Machine Learning · Computer Science 2023-04-04 Zihao Chen , Xiaomeng Wang , Yuanjiang Huang , Tao Jia

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Machine learning-based systems are rapidly gaining popularity and in-line with that there has been a huge research surge in the field of explainability to ensure that machine learning models are reliable, fair, and can be held liable for…

Machine Learning · Computer Science 2021-04-12 Rohit Saluja , Avleen Malhi , Samanta Knapič , Kary Främling , Cicek Cavdar

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanation quality can be…

Machine Learning · Computer Science 2020-11-10 Gregory Plumb , Maruan Al-Shedivat , Angel Alexander Cabrera , Adam Perer , Eric Xing , Ameet Talwalkar

Explainable Recommendation has attracted a lot of attention due to a renewed interest in explainable artificial intelligence. In particular, post-hoc approaches have proved to be the most easily applicable ones to increasingly complex…

Information Retrieval · Computer Science 2021-10-11 Vito Walter Anelli , Alejandro Bellogín , Tommaso Di Noia , Francesco Maria Donini , Vincenzo Paparella , Claudio Pomo

In geophysics, hydrocarbon prospect risking involves assessing the risks associated with hydrocarbon exploration by integrating data from various sources. Machine learning-based classifiers trained on tabular data have been recently used to…

Machine Learning · Computer Science 2026-02-17 Prithwijit Chowdhury , Ahmad Mustafa , Mohit Prabhushankar , Ghassan AlRegib

The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new…

Artificial Intelligence · Computer Science 2021-11-03 Sebastian Palacio , Adriano Lucieri , Mohsin Munir , Jörn Hees , Sheraz Ahmed , Andreas Dengel

While deep neural network models offer unmatched classification performance, they are prone to learning spurious correlations in the data. Such dependencies on confounding information can be difficult to detect using performance metrics if…

Machine Learning · Computer Science 2023-08-09 Susu Sun , Lisa M. Koch , Christian F. Baumgartner