English
Related papers

Related papers: Towards Benchmarking the Utility of Explanations f…

200 papers

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

Machine Learning · Computer Science 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

A critical problem in the field of post hoc explainability is the lack of a common foundational goal among methods. For example, some methods are motivated by function approximation, some by game theoretic notions, and some by obtaining…

Machine Learning · Computer Science 2023-01-02 Tessa Han , Suraj Srinivas , Himabindu Lakkaraju

Post-hoc interpretability approaches have been proven to be powerful tools to generate explanations for the predictions made by a trained black-box model. However, they create the risk of having explanations that are a result of some…

Machine Learning · Computer Science 2021-04-14 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Xavier Renard , Marcin Detyniecki

Post hoc explanations have emerged as a way to improve user trust in machine learning models by providing insight into model decision-making. However, explanations tend to be evaluated based on their alignment with prior knowledge while the…

Human-Computer Interaction · Computer Science 2023-12-13 Tessa Han , Yasha Ektefaie , Maha Farhat , Marinka Zitnik , Himabindu Lakkaraju

In today's data-rich environment, recommender systems play a crucial role in decision support systems. They provide to users personalized recommendations and explanations about these recommendations. Embedding-based models, despite their…

Information Retrieval · Computer Science 2024-01-10 Ngoc Luyen Le , Marie-Hélène Abel , Philippe Gouspillou

Good quality explanations strengthen the understanding of language models and data. Feature attribution methods, such as Integrated Gradient, are a type of post-hoc explainer that can provide token-level insights. However, explanations on…

Computation and Language · Computer Science 2026-04-21 Jonathan Kamp , Roos Bakker , Dominique Blok

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make…

Machine Learning · Computer Science 2019-06-13 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

Counterfactual explanations is one of the post-hoc methods used to provide explainability to machine learning models that have been attracting attention in recent years. Most examples in the literature, address the problem of generating…

Machine Learning · Computer Science 2021-05-11 Guillermo Navas-Palencia

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

Computation and Language · Computer Science 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar

Modern learning algorithms excel at producing accurate but complex models of the data. However, deploying such models in the real-world requires extra care: we must ensure their reliability, robustness, and absence of undesired biases. This…

Machine Learning · Computer Science 2020-09-10 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the users ability to…

Machine Learning · Computer Science 2023-09-22 Anahid Jalali , Bernhard Haslhofer , Simone Kriglstein , Andreas Rauber

Existing and planned legislation stipulates various obligations to provide information about machine learning algorithms and their functioning, often interpreted as obligations to "explain". Many researchers suggest using post-hoc…

Machine Learning · Computer Science 2022-05-12 Sebastian Bordt , Michèle Finck , Eric Raidl , Ulrike von Luxburg

Recent work in Natural Language Processing has focused on developing approaches that extract faithful explanations, either via identifying the most important tokens in the input (i.e. post-hoc explanations) or by designing inherently…

Computation and Language · Computer Science 2022-03-02 George Chrysostomou , Nikolaos Aletras

In many scenarios, the interpretability of machine learning models is a highly required but difficult task. To explain the individual predictions of such models, local model-agnostic approaches have been proposed. However, the process…

Machine Learning · Statistics 2025-10-22 Gianluigi Lopardo , Frederic Precioso , Damien Garreau

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

As complex machine learning models continue to find applications in high-stakes decision-making scenarios, it is crucial that we can explain and understand their predictions. Post-hoc explanation methods provide useful insights by…

Machine Learning · Statistics 2024-10-16 Beepul Bharti , Paul Yi , Jeremias Sulam

Post-hoc interpretability methods are critical tools to explain neural-network results. Several post-hoc methods have emerged in recent years, but when applied to a given task, they produce different results, raising the question of which…

Machine Learning · Computer Science 2024-12-09 Hugues Turbé , Mina Bjelogrlic , Christian Lovis , Gianmarco Mengaldo

The most common methods in explainable artificial intelligence are post-hoc techniques which identify the most relevant features used by pretrained opaque models. Some of the most advanced post hoc methods can generate explanations that…

Artificial Intelligence · Computer Science 2026-03-11 Stefano Fioravanti , Francesco Giannini , Paolo Frazzetto , Fabio Zanasi , Pietro Barbiero

As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across various population…

Machine Learning · Computer Science 2022-07-05 Jessica Dai , Sohini Upadhyay , Ulrich Aivodji , Stephen H. Bach , Himabindu Lakkaraju

There have been several research works proposing new Explainable AI (XAI) methods designed to generate model explanations having specific properties, or desiderata, such as fidelity, robustness, or human-interpretability. However,…

Artificial Intelligence · Computer Science 2021-01-25 Sérgio Jesus , Catarina Belém , Vladimir Balayan , João Bento , Pedro Saleiro , Pedro Bizarro , João Gama