English
Related papers

Related papers: Which Explanation Should I Choose? A Function Appr…

200 papers

This thesis explores the generation of local explanations for already deployed machine learning models, aiming to identify optimal conditions for producing meaningful explanations considering both data and user requirements. The primary…

Artificial Intelligence · Computer Science 2024-02-19 julien Delaunay

The No Free Lunch (NFL) theorem guarantees equal average performance only under uniform sampling of a function space closed under permutation (c.u.p.). We ask when this averaging ceases to reflect what benchmarking actually reports. We…

Machine Learning · Statistics 2026-03-05 Grzegorz Sroka

Reliable probability estimates are critical in many machine learning applications, yet modern classifiers are often poorly calibrated. Post-hoc calibration provides a simple and widely used solution, but the large number of proposed…

Machine Learning · Computer Science 2026-05-29 Eugène Berta , David Holzmüller , Francis Bach , Michael I. Jordan

Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing post-hoc methods…

Computation and Language · Computer Science 2023-12-22 Chengen Lai , Shengli Song , Shiqi Meng , Jingyang Li , Sitong Yan , Guangneng Hu

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

Explaining sophisticated machine-learning based systems is an important issue at the foundations of AI. Recent efforts have shown various methods for providing explanations. These approaches can be broadly divided into two schools: those…

Artificial Intelligence · Computer Science 2021-08-24 Nicholas Asher , Soumya Paul , Chris Russell

Large language models (LLMs) have attracted huge interest in practical applications given their increasingly accurate responses and coherent reasoning abilities. Given their nature as black-boxes using complex reasoning processes on their…

Computation and Language · Computer Science 2023-12-05 James Enouen , Hootan Nakhost , Sayna Ebrahimi , Sercan O Arik , Yan Liu , Tomas Pfister

With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been…

Machine Learning · Computer Science 2024-02-19 Usha Bhalla , Suraj Srinivas , Himabindu Lakkaraju

Modern learning algorithms excel at producing accurate but complex models of the data. However, deploying such models in the real-world requires extra care: we must ensure their reliability, robustness, and absence of undesired biases. This…

Machine Learning · Computer Science 2020-09-10 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

Computation and Language · Computer Science 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar

As complex AI systems further prove to be an integral part of our lives, a persistent and critical problem is the underlying black-box nature of such products and systems. In pursuit of productivity enhancements, one must not forget the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Rech Leong Tian Poh , Sye Loong Keoh , Liying Li

Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides…

Machine Learning · Computer Science 2025-11-21 Yang Ji , Ying Sun , Yuting Zhang , Zhigaoyuan Wang , Yuanxin Zhuang , Zheng Gong , Dazhong Shen , Chuan Qin , Hengshu Zhu , Hui Xiong

Post-hoc explainability methods such as Grad-CAM are popular because they do not influence the performance of a trained model. However, they mainly reveal "where" a model looks at for a given input, fail to explain "what" the model looks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Andong Tan , Fengtao Zhou , Hao Chen

In the present paper we present the potential of Explainable Artificial Intelligence methods for decision-support in medical image analysis scenarios. With three types of explainable methods applied to the same medical image data set our…

Artificial Intelligence · Computer Science 2021-05-20 Samanta Knapič , Avleen Malhi , Rohit Saluja , Kary Främling

Interpretability is the study of explaining models in understandable terms to humans. At present, interpretability is divided into two paradigms: the intrinsic paradigm, which believes that only models designed to be explained can be…

Machine Learning · Computer Science 2024-11-14 Andreas Madsen , Himabindu Lakkaraju , Siva Reddy , Sarath Chandar

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of…

Computation and Language · Computer Science 2024-07-12 Nicholas Kroeger , Dan Ley , Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Explainable AI (XAI) has unfolded in two distinct research directions with, on the one hand, post-hoc methods that explain the predictions of a pre-trained black-box model and, on the other hand, self-explainable models (SEMs) which are…

Machine Learning · Computer Science 2024-06-06 Srishti Gautam , Ahcene Boubekki , Marina M. C. Höhne , Michael C. Kampffmeyer

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

Existing algorithms for explaining the outputs of image classifiers are based on a variety of approaches and produce explanations that frequently lack formal rigour. On the other hand, logic-based explanations are formally and rigorously…

Artificial Intelligence · Computer Science 2026-02-20 David A Kelly , Hana Chockler

Text corpus exploration (TCE) spans the range of exploratory search tasks: it goes beyond simple retrieval to include item discovery and learning about the corpus and topic. Systems support TCE with tools such as similarity-based…

Human-Computer Interaction · Computer Science 2024-06-17 Michael Gleicher , Keaton Leppenan , Yunyu Bai