English
Related papers

Related papers: Explainability in Deep Reinforcement Learning

200 papers

Explainable AI (XAI) refers to techniques that provide human-understandable insights into the workings of AI models. Recently, the focus of XAI is being extended toward explaining Large Language Models (LLMs). This extension calls for a…

As a field of AI, Machine Reasoning (MR) uses largely symbolic means to formalize and emulate abstract reasoning. Studies in early MR have notably started inquiries into Explainable AI (XAI) -- arguably one of the biggest concerns today for…

The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the…

Machine Learning · Computer Science 2024-08-14 Gregory Yampolsky , Dhruv Desai , Mingshu Li , Stefano Pasquali , Dhagash Mehta

The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement…

Artificial Intelligence · Computer Science 2021-07-07 Georgios Sofianidis , Jože M. Rožanec , Dunja Mladenić , Dimosthenis Kyriazis

Recent years have seen important advances in the quality of state-of-the-art models, but this has come at the expense of models becoming less interpretable. This survey presents an overview of the current state of Explainable AI (XAI),…

Computation and Language · Computer Science 2025-04-16 Marina Danilevsky , Kun Qian , Ranit Aharonov , Yannis Katsis , Ban Kawas , Prithviraj Sen

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

Although Deep Neural Networks (DNNs) have great generalization and prediction capabilities, their functioning does not allow a detailed explanation of their behavior. Opaque deep learning models are increasingly used to make important…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Adrien Bennetot , Gianni Franchi , Javier Del Ser , Raja Chatila , Natalia Diaz-Rodriguez

Deep reinforcement learning (DRL) algorithms have achieved great success on sequential decision-making problems, yet is criticized for the lack of data-efficiency and explainability. Especially, explainability of subtasks is critical in…

Artificial Intelligence · Computer Science 2020-05-20 Daoming Lyu

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been…

Machine Learning · Statistics 2019-12-03 Patrick Hall , Navdeep Gill , Nicholas Schmidt

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI)…

Artificial Intelligence · Computer Science 2024-09-30 Sergei Nirenburg , Marjorie McShane , Kenneth W. Goodman , Sanjay Oruganti

With the rapid growth of machine learning, deep neural networks (DNNs) are now being used in numerous domains. Unfortunately, DNNs are "black-boxes", and cannot be interpreted by humans, which is a substantial concern in safety-critical…

Machine Learning · Computer Science 2023-02-10 Shahaf Bassan , Guy Katz

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

Deep Learning has already been successfully applied to analyze industrial sensor data in a variety of relevant use cases. However, the opaque nature of many well-performing methods poses a major obstacle for real-world deployment.…

Machine Learning · Computer Science 2023-10-20 Thomas Decker , Michael Lebacher , Volker Tresp

As machine learning (ML) systems take a more prominent and central role in contributing to life-impacting decisions, ensuring their trustworthiness and accountability is of utmost importance. Explanations sit at the core of these desirable…

Machine Learning · Computer Science 2021-06-16 Sahil Verma , Aditya Lahiri , John P. Dickerson , Su-In Lee

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Junlin Hou , Sicen Liu , Yequan Bie , Hongmei Wang , Andong Tan , Luyang Luo , Hao Chen

Since the mid-10s, the era of Deep Learning (DL) has continued to this day, bringing forth new superlatives and innovations each year. Nevertheless, the speed with which these innovations translate into real applications lags behind this…

Machine Learning · Computer Science 2024-07-09 Saifullah Saifullah , Dominique Mercier , Adriano Lucieri , Andreas Dengel , Sheraz Ahmed

Explainable artificial intelligence (XAI) can help foster trust in and acceptance of intelligent and autonomous systems. Moreover, understanding the motivation for an agent's behavior results in better and more successful collaborations…

Robotics · Computer Science 2020-10-12 Tom Weber , Stefan Wermter

Deep learning is becoming increasingly adopted in business and industry due to its ability to transform large quantities of data into high-performing models. These models, however, are generally regarded as black boxes, which, in spite of…

Machine Learning · Computer Science 2023-02-21 Stefan Druc , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar , Aditya Balu

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed