English
Related papers

Related papers: Mechanistic Interpretability of Reinforcement Lear…

200 papers

Many recent breakthroughs in multi-agent reinforcement learning (MARL) require the use of deep neural networks, which are challenging for human experts to interpret and understand. On the other hand, existing work on interpretable…

Inspired by recent work in attention models for image captioning and question answering, we present a soft attention model for the reinforcement learning domain. This model uses a soft, top-down attention mechanism to create a bottleneck in…

Machine Learning · Computer Science 2019-06-07 Alex Mott , Daniel Zoran , Mike Chrzanowski , Daan Wierstra , Danilo J. Rezende

Reinforcement learning (RL) is a popular approach for robotic path planning in uncertain environments. However, the control policies trained for an RL agent crucially depend on user-defined, state-based reward functions. Poorly designed…

Artificial Intelligence · Computer Science 2024-12-05 Anand Balakrishnan , Stefan Jakšić , Edgar A. Aguilar , Dejan Ničković , Jyotirmoy V. Deshmukh

Bayesian inference has many advantages in decision making of agents (e.g. robotics/simulative agent) over a regular data-driven black-box neural network: Data-efficiency, generalization, interpretability, and safety where these advantages…

Machine Learning · Computer Science 2025-05-14 Chengmin Zhou , Ville Kyrki , Pasi Fränti , Laura Ruotsalainen

In recent years, by leveraging more data, computation, and diverse tasks, learned optimizers have achieved remarkable success in supervised learning, outperforming classical hand-designed optimizers. Reinforcement learning (RL) is…

Machine Learning · Computer Science 2024-06-05 Qingfeng Lan , A. Rupam Mahmood , Shuicheng Yan , Zhongwen Xu

Artificial intelligence (AI) has been embedded into many aspects of people's daily lives and it has become normal for people to have AI make decisions for them. Reinforcement learning (RL) models increase the space of solvable problems with…

Artificial Intelligence · Computer Science 2022-03-23 Agneza Krajna , Mario Brcic , Tomislav Lipic , Juraj Doncevic

Reinforcement learning (RL) is used in many domains, including autonomous driving, robotics, stock trading, and video games. Unfortunately, the black box nature of RL agents, combined with legal and ethical considerations, makes it…

Human-Computer Interaction · Computer Science 2021-11-02 Aditi Mishra , Utkarsh Soni , Jinbin Huang , Chris Bryan

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

We introduce an autonomous multiagent framework for mechanistic interpretability that automates both explaining and finding internal features in large language models. The system runs two coupled loops: (1) explanation refinement, where an…

Computation and Language · Computer Science 2026-05-05 Arnau Marin-Llobet , Javier Ferrando

Reinforcement learning (RL) is an appealing paradigm for training intelligent agents, enabling policy acquisition from the agent's own autonomously acquired experience. However, the training process of RL is far from automatic, requiring…

Artificial Intelligence · Computer Science 2025-02-25 Zhao Yang , Thomas M. Moerland , Mike Preuss , Aske Plaat , Edward S. Hu

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

Despite the significant progress of deep reinforcement learning (RL) in solving sequential decision making problems, RL agents often overfit to training environments and struggle to adapt to new, unseen environments. This prevents robust…

Machine Learning · Computer Science 2020-08-04 Xingyu Lu , Kimin Lee , Pieter Abbeel , Stas Tiomkin

Deep reinforcement learning techniques have demonstrated superior performance in a wide variety of environments. As improvements in training algorithms continue at a brisk pace, theoretical or empirical studies on understanding what these…

Machine Learning · Computer Science 2018-11-16 Raghuram Mandyam Annasamy , Katia Sycara

The advancement of robots, particularly those functioning in complex human-centric environments, relies on control solutions that are driven by machine learning. Understanding how learning-based controllers make decisions is crucial since…

Machine Learning · Computer Science 2023-11-14 Tsun-Hsuan Wang , Wei Xiao , Tim Seyde , Ramin Hasani , Daniela Rus

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

A multiagent sequential decision problem has been seen in many critical applications including urban transportation, autonomous driving cars, military operations, etc. Its widely known solution, namely multiagent reinforcement learning, has…

Artificial Intelligence · Computer Science 2024-10-29 Yanyu Liu , Yinghui Pan , Yifeng Zeng , Biyang Ma , Doshi Prashant

Human actions are based on the mental perception of the environment. Even when all the aspects of an environment are not visible, humans have an internal mental model that can generalize the partially visible scenes to fully constructed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Usama Younus , Vinoj Jayasundara , Shivam Mishra , Suleyman Aslan

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Artificial Intelligence · Computer Science 2025-12-02 Riley Simmons-Edler , Ryan P. Badman , Felix Baastad Berg , Raymond Chua , John J. Vastola , Joshua Lunger , William Qian , Kanaka Rajan

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

Robotics · Computer Science 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens