English
Related papers

Related papers: Local Rule-Based Explanations of Black Box Decisio…

200 papers

Local surrogate approaches for explaining machine learning model predictions have appealing properties, such as being model-agnostic and flexible in their modelling. Several methods exist that fit this description and share this goal.…

Machine Learning · Computer Science 2021-06-11 Rafael Poyiadzi , Xavier Renard , Thibault Laugel , Raul Santos-Rodriguez , Marcin Detyniecki

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

As artificial intelligence (AI) systems become increasingly integrated into critical decision-making processes, the need for transparent and interpretable models has become paramount. In this article we present a new ruleset creation method…

Machine Learning · Computer Science 2024-07-30 Mario Parrón Verdasco , Esteban García-Cuesta

Our interest in this paper is in the construction of symbolic explanations for predictions made by a deep neural network. We will focus attention on deep relational machines (DRMs, first proposed by H. Lodhi). A DRM is a deep network in…

Machine Learning · Computer Science 2018-07-03 Ashwin Srinivasan , Lovekesh Vig , Michael Bain

Machine learning models are increasingly used in critical applications but are mostly "black boxes" due to their lack of transparency. Local explanation approaches, such as LIME, address this issue by approximating the behavior of complex…

Machine Learning · Computer Science 2025-12-01 Krishna Khadka , Sunny Shree , Pujan Budhathoki , Yu Lei , Raghu Kacker , D. Richard Kuhn

Explainable artificial intelligence (XAI) is an emerging new domain in which a set of processes and tools allow humans to better comprehend the decisions generated by black box models. However, most of the available XAI tools are often…

Machine Learning · Computer Science 2021-07-22 Zoumpolia Dikopoulou , Serafeim Moustakidis , Patrik Karlsson

Understanding the decision-making process of black-box models has become not just a legal requirement, but also an additional way to assess their performance. However, the state of the art post-hoc explanation approaches for regression…

Machine Learning · Computer Science 2025-08-13 Nedeljko Radulovic , Albert Bifet , Fabian Suchanek

We consider the problem of explaining the predictions of an arbitrary blackbox model $f$: given query access to $f$ and an instance $x$, output a small set of $x$'s features that in conjunction essentially determines $f(x)$. We design an…

Machine Learning · Computer Science 2021-11-03 Guy Blanc , Jane Lange , Li-Yang Tan

Explaining the behavior of black box machine learning models through human interpretable rules is an important research area. Recent work has focused on explaining model behavior locally i.e. for specific predictions as well as globally…

Machine Learning · Computer Science 2021-05-17 Sukriti Verma , Nikaash Puri , Piyush Gupta , Balaji Krishnamurthy

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

The interpretability of model has become one of the obstacles to its wide application in the high-stake fields. The usual way to obtain interpretability is to build a black-box first and then explain it using the post-hoc methods. However,…

Machine Learning · Computer Science 2023-04-04 Zihao Chen , Xiaomeng Wang , Yuanjiang Huang , Tao Jia

State-of-the-art recommender systems have the ability to generate high-quality recommendations, but usually cannot provide intuitive explanations to humans due to the usage of black-box prediction models. The lack of transparency has…

Information Retrieval · Computer Science 2021-02-24 Shuyuan Xu , Yunqi Li , Shuchang Liu , Zuohui Fu , Xu Chen , Yongfeng Zhang

Most deep learning recommendation models operate as black boxes, relying on latent representations that obscure their decision process. This lack of intrinsic interpretability raises concerns in applications that require transparency and…

Information Retrieval · Computer Science 2026-04-07 Jinhao Pan , Bowen Wei , Ziwei Zhu

Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black…

We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Riccardo Guidotti , Anna Monreale , Stan Matwin , Dino Pedreschi

Although a recent shift has been made in the field of predictive process monitoring to use models from the explainable artificial intelligence field, the evaluation still occurs mainly through performance-based metrics, thus not accounting…

Machine Learning · Computer Science 2023-08-01 Alexander Stevens , Johannes De Smedt

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Explainable Recommendation has attracted a lot of attention due to a renewed interest in explainable artificial intelligence. In particular, post-hoc approaches have proved to be the most easily applicable ones to increasingly complex…

Information Retrieval · Computer Science 2021-10-11 Vito Walter Anelli , Alejandro Bellogín , Tommaso Di Noia , Francesco Maria Donini , Vincenzo Paparella , Claudio Pomo

When it comes to complex machine learning models, commonly referred to as black boxes, understanding the underlying decision making process is crucial for domains such as healthcare and financial services, and also when it is used in…

Machine Learning · Computer Science 2020-12-02 Jürgen Dieber , Sabrina Kirrane

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

Machine Learning · Computer Science 2020-08-04 Aria Khademi , Vasant Honavar