English
Related papers

Related papers: CrystalBox: Future-Based Explanations for Input-Dr…

200 papers

Recently, there has been increasing interest in transparency and interpretability in Deep Reinforcement Learning (DRL) systems. Verbal explanations, as the most natural way of communication in our daily life, deserve more attention, since…

Artificial Intelligence · Computer Science 2020-12-25 Xinzhi Wang , Huao Li , Hui Zhang , Michael Lewis , Katia Sycara

Recent advances in reinforcement-learning research have demonstrated impressive results in building algorithms that can out-perform humans in complex tasks. Nevertheless, creating reinforcement-learning systems that can build abstractions…

Machine Learning · Computer Science 2022-11-08 Lucas Lehnert , Michael J. Frank , Michael L. Littman

Reward Machines provide an automaton-inspired structure for specifying instructions, safety constraints, and other temporally extended reward-worthy behaviour. By exposing the underlying structure of a reward function, they enable the…

Machine Learning · Computer Science 2025-01-16 Andrew C. Li , Zizhao Chen , Toryn Q. Klassen , Pashootan Vaezipoor , Rodrigo Toro Icarte , Sheila A. McIlraith

Explaining the behaviour of intelligent agents learned by reinforcement learning (RL) to humans is challenging yet crucial due to their incomprehensible proprioceptive states, variational intermediate goals, and resultant unpredictability.…

Machine Learning · Computer Science 2023-11-07 Wenhao Lu , Xufeng Zhao , Sven Magg , Martin Gromniak , Mengdi Li , Stefan Wermter

Despite of achieving great success in real-world applications, Deep Reinforcement Learning (DRL) is still suffering from three critical issues, i.e., data efficiency, lack of the interpretability and transferability. Recent research shows…

Artificial Intelligence · Computer Science 2023-07-10 Hankz Hankui Zhuo , Shuting Deng , Mu Jin , Zhihao Ma , Kebing Jin , Chen Chen , Chao Yu

Deep reinforcement learning (DRL), through learning policies or values represented by neural networks, has successfully addressed many complex control problems. However, the neural networks introduced by DRL lack interpretability and…

Machine Learning · Computer Science 2025-02-04 Zeyu Jiang , Hai Huang , Xingquan Zuo

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical…

Artificial Intelligence · Computer Science 2019-03-01 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

Many reinforcement learning (RL) tasks have specific properties that can be leveraged to modify existing RL algorithms to adapt to those tasks and further improve performance, and a general class of such properties is the multiple reward…

Machine Learning · Computer Science 2019-11-07 Zichuan Lin , Li Zhao , Derek Yang , Tao Qin , Guangwen Yang , Tie-Yan Liu

With deep reinforcement learning (RL) systems like autonomous driving being wildly deployed but remaining largely opaque, developers frequently use explainable RL (XRL) tools to better understand and work with deep RL agents. However,…

Human-Computer Interaction · Computer Science 2022-12-13 Xiaoran Wu , Zihan Yan , Chongjie Zhang , Tongshuang Wu

Demonstrations are widely used in Deep Reinforcement Learning (DRL) for facilitating solving tasks with sparse rewards. However, the tasks in real-world scenarios can often have varied initial conditions from the demonstration, which would…

Robotics · Computer Science 2023-07-11 Ruiqi Zhu , Siyuan Li , Tianhong Dai , Chongjie Zhang , Oya Celiktutan

Reinforcement Learning (RL)-based control system has received considerable attention in recent decades. However, in many real-world problems, such as Batch Process Control, the environment is uncertain, which requires expensive interaction…

Machine Learning · Computer Science 2022-11-03 Peng Zhang , Yawen Huang , Bingzhang Hu , Shizheng Wang , Haoran Duan , Noura Al Moubayed , Yefeng Zheng , Yang Long

Deep Reinforcement Learning (DRL) connects the classic Reinforcement Learning algorithms with Deep Neural Networks. A problem in DRL is that CNNs are black-boxes and it is hard to understand the decision-making process of agents. In order…

Machine Learning · Computer Science 2020-12-03 Matthias Rosynski , Frank Kirchner , Matias Valdenegro-Toro

The use of Deep Reinforcement Learning (DRL) schemes has increased dramatically since their first introduction in 2015. Though uses in many different applications are being found, they still have a problem with the lack of interpretability.…

Machine Learning · Computer Science 2023-03-09 Thomas Hickling , Abdelhafid Zenati , Nabil Aouf , Phillippa Spencer

Deep neural perception and control networks have become key components of self-driving vehicles. User acceptance is likely to benefit from easy-to-interpret textual explanations which allow end-users to understand what triggered a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Jinkyu Kim , Anna Rohrbach , Trevor Darrell , John Canny , Zeynep Akata

The black-box nature of deep neural networks (DNN) has brought to attention the issues of transparency and fairness. Deep Reinforcement Learning (Deep RL or DRL), which uses DNN to learn its policy, value functions etc, is thus also subject…

Machine Learning · Computer Science 2023-01-24 Erico Tjoa , Guan Cuntai

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Deep reinforcement learning (DRL) has achieved remarkable success in various research domains. However, its reliance on neural networks results in a lack of transparency, which limits its practical applications. To achieve explainability,…

Machine Learning · Computer Science 2026-05-25 Yongyan Wen , Siyuan Li , Rongchang Zuo , Lei Yuan , Hangyu Mao , Peng Liu

A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned…

Machine Learning · Computer Science 2023-05-25 Tiantian Zhang , Zichuan Lin , Yuxing Wang , Deheng Ye , Qiang Fu , Wei Yang , Xueqian Wang , Bin Liang , Bo Yuan , Xiu Li

Reinforcement learning with verifiable rewards (RLVR) has been a main driver of recent breakthroughs in large reasoning models. Yet it remains a mystery how rewards based solely on final outcomes can help overcome the long-horizon barrier…

Machine Learning · Computer Science 2026-05-07 Yu Huang , Zixin Wen , Yuejie Chi , Yuting Wei , Aarti Singh , Yingbin Liang , Yuxin Chen

We introduce an approach for deep reinforcement learning (RL) that improves upon the efficiency, generalization capacity, and interpretability of conventional approaches through structured perception and relational reasoning. It uses…