English
Related papers

Related papers: Nothing Else Matters: Model-Agnostic Explanations …

200 papers

The growing reliance on deep learning models in safety-critical domains such as healthcare and autonomous navigation underscores the need for defenses that are both robust to adversarial perturbations and transparent in their…

Machine Learning · Computer Science 2026-01-06 Longwei Wang , Mohammad Navid Nayyem , Abdullah Al Rakin , KC Santosh , Chaowei Zhang , Yang Zhou

Locally interpretable model agnostic explanations (LIME) method is one of the most popular methods used to explain black-box models at a per example level. Although many variants have been proposed, few provide a simple way to produce high…

Machine Learning · Computer Science 2023-10-04 Amit Dhurandhar , Karthikeyan Ramamurthy , Kartik Ahuja , Vijay Arya

Concept explanation is a popular approach for examining how human-interpretable concepts impact the predictions of a model. However, most existing methods for concept explanations are tailored to specific models. To address this issue, this…

Machine Learning · Computer Science 2024-01-17 Zhili Feng , Michal Moshkovitz , Dotan Di Castro , J. Zico Kolter

As black-box machine learning models grow in complexity and find applications in high-stakes scenarios, it is imperative to provide explanations for their predictions. Although Local Interpretable Model-agnostic Explanations (LIME) [22] is…

Machine Learning · Computer Science 2023-11-28 Zeren Tan , Yang Tian , Jian Li

LIME is a popular approach for explaining a black-box prediction through an interpretable model that is trained on instances in the vicinity of the predicted instance. To generate these instances, LIME randomly selects a subset of the…

Machine Learning · Statistics 2019-11-01 Amir Hossein Akhavan Rahnama , Henrik Boström

As neural networks become dominant in essential systems, Explainable Artificial Intelligence (XAI) plays a crucial role in fostering trust and detecting potential misbehavior of opaque models. LIME (Local Interpretable Model-agnostic…

Machine Learning · Computer Science 2025-04-01 Patrick Knab , Sascha Marton , Udo Schlegel , Christian Bartelt

Understanding why a model made a certain prediction is crucial in many data science fields. Interpretable predictions engender appropriate trust and provide insight into how the model may be improved. However, with large modern datasets the…

Artificial Intelligence · Computer Science 2016-12-09 Scott Lundberg , Su-In Lee

Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how…

Machine Learning · Computer Science 2019-08-19 Fan Yang , Mengnan Du , Xia Hu

Understanding why a model makes certain predictions is crucial when adapting it for real world decision making. LIME is a popular model-agnostic feature attribution method for the tasks of classification and regression. However, the task of…

Information Retrieval · Computer Science 2022-12-27 Tanya Chowdhury , Razieh Rahimi , James Allan

The rapid integration of artificial intelligence (AI) into various industries has introduced new challenges in governance and regulation, particularly regarding the understanding of complex AI systems. A critical demand from decision-makers…

Machine Learning · Computer Science 2024-11-08 Cristian Munoz , Kleyton da Costa , Bernardo Modenesi , Adriano Koshiyama

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to humans but fail to…

Machine Learning · Computer Science 2026-05-28 Tomás Pereira , João Vitorino , Eva Maia , Isabel Praça

Explainable artificial intelligence (XAI) is an emerging new domain in which a set of processes and tools allow humans to better comprehend the decisions generated by black box models. However, most of the available XAI tools are often…

Machine Learning · Computer Science 2021-07-22 Zoumpolia Dikopoulou , Serafeim Moustakidis , Patrik Karlsson

Interpretability of machine learning models is critical for data-driven precision medicine efforts. However, highly predictive models are generally complex and are difficult to interpret. Here using Model-Agnostic Explanations algorithm, we…

Quantitative Methods · Quantitative Biology 2016-10-31 Gajendra Jung Katuwal , Robert Chen

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

Interpretable Machine Learning faces a recurring challenge of explaining the predictions made by opaque classifiers such as ensemble models, kernel methods, or neural networks in terms that are understandable to humans. When the model is…

Machine Learning · Computer Science 2024-11-14 Frederic Koriche , Jean-Marie Lagniez , Stefan Mengel , Chi Tran

The paper introduces a novel framework for extracting model-agnostic human interpretable rules to explain a classifier's output. The human interpretable rule is defined as an axis-aligned hyper-cuboid containing the instance for which the…

Artificial Intelligence · Computer Science 2020-11-04 Rajat Sharma , Nikhil Reddy , Vidhya Kamakshi , Narayanan C Krishnan , Shweta Jain

Local explanation methods such as LIME have become popular in MIR as tools for generating post-hoc, model-agnostic explanations of a model's classification decisions. The basic idea is to identify a small set of human-understandable…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Verena Praher , Katharina Prinz , Arthur Flexer , Gerhard Widmer

The need for reliable model explanations is prominent for many machine learning applications, particularly for tabular and time-series data as their use cases often involve high-stakes decision making. Towards this goal, we introduce a…

Machine Learning · Computer Science 2023-05-29 Aya Abdelsalam Ismail , Sercan Ö. Arik , Jinsung Yoon , Ankur Taly , Soheil Feizi , Tomas Pfister

Feature attribution methods are popular for explaining neural network predictions, and they are often evaluated on metrics such as comprehensiveness and sufficiency. In this paper, we highlight an intriguing property of these metrics: their…

Machine Learning · Computer Science 2023-02-06 Yilun Zhou , Julie Shah