English
Related papers

Related papers: From Explainability to Interpretability: Interpret…

200 papers

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

Explainable Artificial Intelligence (XAI), i.e., the development of more transparent and interpretable AI models, has gained increased traction over the last few years. This is due to the fact that, in conjunction with their growth into…

Machine Learning · Computer Science 2020-05-14 Erika Puiutta , Eric MSP Veith

Reinforcement learning agents can achieve super-human performance in complex decision-making tasks, but their behaviour is often difficult to understand and explain. This lack of explanation limits deployment, especially in safety-critical…

Machine Learning · Computer Science 2025-08-01 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Recently deep reinforcement learning has achieved tremendous success in wide ranges of applications. However, it notoriously lacks data-efficiency and interpretability. Data-efficiency is important as interacting with the environment is…

Machine Learning · Computer Science 2021-06-23 Duo Xu , Faramarz Fekri

Reinforcement learning has achieved remarkable success in complex decision-making environments, yet its lack of transparency limits its deployment in practice, especially in safety-critical settings. Shapley values from cooperative game…

Machine Learning · Computer Science 2025-11-11 Daniel Beechey , Özgür Şimşek

Shapley values have become one of the most popular feature attribution explanation methods. However, most prior work has focused on post-hoc Shapley explanations, which can be computationally demanding due to its exponential time complexity…

Machine Learning · Computer Science 2021-04-07 Rui Wang , Xiaoqian Wang , David I. Inouye

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Embracing the pursuit of intrinsically explainable reinforcement learning raises crucial questions: what distinguishes explainability from interpretability? Should explainable and interpretable agents be developed outside of domains where…

Artificial Intelligence · Computer Science 2024-04-18 Hector Kohler , Quentin Delfosse , Paul Festor , Philippe Preux

Despite numerous successes in Deep Reinforcement Learning (DRL), the learned policies are not interpretable. Moreover, since DRL does not exploit symbolic relational representations, it has difficulties in coping with structural changes in…

Artificial Intelligence · Computer Science 2023-07-17 Rishi Hazra , Luc De Raedt

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

Recent developments in generative artificial intelligence (AI) rely on machine learning techniques such as deep learning and generative modeling to achieve state-of-the-art performance across wide-ranging domains. These methods' surprising…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Bryon Aragam

The field of machine learning has seen tremendous progress in recent years, with deep learning models delivering exceptional performance across a range of tasks. However, these models often come at the cost of interpretability, as they…

Machine Learning · Computer Science 2024-01-08 Shun Liu

Interpretability, explainability and transparency are key issues to introducing Artificial Intelligence methods in many critical domains: This is important due to ethical concerns and trust issues strongly connected to reliability,…

Machine Learning · Computer Science 2023-01-25 George A. Vouros

Offline reinforcement learning (RL) holds great promise for deriving optimal policies from observational data, but challenges related to interpretability and evaluation limit its practical use in safety-critical domains. Interpretability is…

Machine Learning · Computer Science 2025-07-24 Anton Matsson , Yaochen Rao , Heather J. Litman , Fredrik D. Johansson

The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional:…

Machine Learning · Computer Science 2021-12-21 Damien de Mijolla , Christopher Frye , Markus Kunesch , John Mansir , Ilya Feige

There exist applications of reinforcement learning like medicine where policies need to be ''interpretable'' by humans. User studies have shown that some policy classes might be more interpretable than others. However, it is costly to…

Machine Learning · Computer Science 2025-03-12 Hector Kohler , Quentin Delfosse , Waris Radji , Riad Akrour , Philippe Preux

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Deep reinforcement learning (DRL) algorithms have achieved great success on sequential decision-making problems, yet is criticized for the lack of data-efficiency and explainability. Especially, explainability of subtasks is critical in…

Artificial Intelligence · Computer Science 2020-05-20 Daoming Lyu

Reinforcement learning (RL) systems can be complex and non-interpretable, making it challenging for non-AI experts to understand or intervene in their decisions. This is due in part to the sequential nature of RL in which actions are chosen…

Artificial Intelligence · Computer Science 2025-04-16 Amal Alabdulkarim , Madhuri Singh , Gennie Mansi , Kaely Hall , Upol Ehsan , Mark O. Riedl

There is a growing desire in the field of reinforcement learning (and machine learning in general) to move from black-box models toward more "interpretable AI." We improve interpretability of reinforcement learning by increasing the utility…

Machine Learning · Computer Science 2019-07-03 Aaron M. Roth , Nicholay Topin , Pooyan Jamshidi , Manuela Veloso