English
Related papers

Related papers: Local Interpretable Model Agnostic Shap Explanatio…

200 papers

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Explainable Artificial Intelligence (XAI) addresses the growing need for transparency and interpretability in AI systems, enabling trust and accountability in decision-making processes. This book offers a comprehensive guide to XAI,…

The decision-making process of many state-of-the-art machine learning models is inherently inscrutable to the extent that it is impossible for a human to interpret the model directly: they are black box models. This has led to a call for…

Information Retrieval · Computer Science 2019-07-09 Ilse van der Linden , Hinda Haned , Evangelos Kanoulas

The need for reliable model explanations is prominent for many machine learning applications, particularly for tabular and time-series data as their use cases often involve high-stakes decision making. Towards this goal, we introduce a…

Machine Learning · Computer Science 2023-05-29 Aya Abdelsalam Ismail , Sercan Ö. Arik , Jinsung Yoon , Ankur Taly , Soheil Feizi , Tomas Pfister

Interpretability remains a key difficulty in sentiment analysis with Large Language Models (LLMs), particularly in high-stakes applications where it is crucial to comprehend the rationale behind forecasts. This research addressed this by…

Computation and Language · Computer Science 2025-03-18 Thivya Thogesan , Anupiya Nugaliyadde , Kok Wai Wong

Interpretability methods are developed to understand the working mechanisms of black-box models, which is crucial to their responsible deployment. Fulfilling this goal requires both that the explanations generated by these methods are…

Computation and Language · Computer Science 2022-05-03 Yilun Zhou , Marco Tulio Ribeiro , Julie Shah

Text data are increasingly handled in an automated fashion by machine learning algorithms. But the models handling these data are not always well-understood due to their complexity and are more and more often referred to as "black-boxes."…

Machine Learning · Statistics 2021-07-27 Dina Mardaoui , Damien Garreau

Recently, Logic Explained Networks (LENs) have been proposed as explainable-by-design neural models providing logic explanations for their predictions. However, these models have only been applied to vision and tabular data, and they mostly…

Computation and Language · Computer Science 2023-09-28 Rishabh Jain , Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Davide Buffelli , Pietro Lio

Feature attribution methods are popular for explaining neural network predictions, and they are often evaluated on metrics such as comprehensiveness and sufficiency. In this paper, we highlight an intriguing property of these metrics: their…

Machine Learning · Computer Science 2023-02-06 Yilun Zhou , Julie Shah

In response to the demand for Explainable Artificial Intelligence (XAI), we investigate the use of Large Language Models (LLMs) to transform ML explanations into natural, human-readable narratives. Rather than directly explaining ML models…

Artificial Intelligence · Computer Science 2024-05-13 Alexandra Zytek , Sara Pidò , Kalyan Veeramachaneni

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a…

Machine Learning · Computer Science 2021-12-21 Christopher Frye , Damien de Mijolla , Tom Begley , Laurence Cowton , Megan Stanley , Ilya Feige

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been…

Machine Learning · Statistics 2019-12-03 Patrick Hall , Navdeep Gill , Nicholas Schmidt

Machine learning models offer powerful predictive capabilities but often lack transparency. Local Interpretable Model-agnostic Explanations (LIME) addresses this by perturbing features and measuring their impact on a model's output. In…

Machine Learning · Computer Science 2024-12-24 Nelson Colón Vargas

Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations…

Recent works in Explainable AI mostly address the transparency issue of black-box models or create explanations for any kind of models (i.e., they are model-agnostic), while leaving explanations of interpretable models largely…

Artificial Intelligence · Computer Science 2022-05-24 Piyawat Lertvittayakumjorn , Francesca Toni

Deep neural networks (DNNs) have made significant strides in Natural Language Processing (NLP), yet their interpretability remains elusive, particularly when evaluating their intricate decision-making processes. Traditional methods often…

Computation and Language · Computer Science 2025-12-05 Zhou Yang , Shunyan Luo , Jiazhen Zhu , Fang Jin

Machine learning (ML) and Deep Learning (DL) methods are being adopted rapidly, especially in computer network security, such as fraud detection, network anomaly detection, intrusion detection, and much more. However, the lack of…

Machine Learning · Computer Science 2021-12-17 Khushnaseeb Roshan , Aasim Zafar

The potential of Machine Learning Control (MLC) in HVAC systems is hindered by its opaque nature and inference mechanisms, which is challenging for users and modelers to fully comprehend, ultimately leading to a lack of trust in MLC-based…

Artificial Intelligence · Computer Science 2024-11-18 Liang Zhang , Zhelun Chen

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

Machine Learning · Computer Science 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

As machine learning models become more accurate, they typically become more complex and uninterpretable by humans. The black-box character of these models holds back its acceptance in practice, especially in high-risk domains where the…

Artificial Intelligence · Computer Science 2019-08-19 Ajaya Adhikari , D. M. J Tax , Riccardo Satta , Matthias Fath