English
Related papers

Related papers: ProtoX: Explaining a Reinforcement Learning Agent …

200 papers

As we deploy autonomous agents in safety-critical domains, it becomes important to develop an understanding of their internal mechanisms and representations. We outline an approach to imitation learning for reverse-engineering black box…

Artificial Intelligence · Computer Science 2020-06-23 Tom Bewley , Jonathan Lawry , Arthur Richards

Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certain action is taken by…

Machine Learning · Computer Science 2019-02-05 Laurens Weitkamp , Elise van der Pol , Zeynep Akata

Mixed cooperative-competitive control scenarios such as human-machine interaction with individual goals of the interacting partners are very challenging for reinforcement learning agents. In order to contribute towards intuitive…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Florian Köpf , Alexander Nitsch , Michael Flad , Sören Hohmann

Providing expert trajectories in the context of Imitation Learning is often expensive and time-consuming. The goal must therefore be to create algorithms which require as little expert data as possible. In this paper we present an algorithm…

Machine Learning · Computer Science 2022-06-14 Jonas Nüßlein , Steffen Illium , Robert Müller , Thomas Gabor , Claudia Linnhoff-Popien

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

We propose a new automated digital painting framework, based on a painting agent trained through reinforcement learning. To synthesize an image, the agent selects a sequence of continuous-valued actions representing primitive painting…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Biao Jia , Chen Fang , Jonathan Brandt , Byungmoon Kim , Dinesh Manocha

We present Learning to Explain (LTX), a model-agnostic framework designed for providing post-hoc explanations for vision models. The LTX framework introduces an "explainer" model that generates explanation maps, highlighting the crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Oren Barkan , Yuval Asher , Amit Eshel , Yehonatan Elisha , Noam Koenigstein

Action advising endeavors to leverage supplementary guidance from expert teachers to alleviate the issue of sampling inefficiency in Deep Reinforcement Learning (DRL). Previous agent-specific action advising methods are hindered by…

Artificial Intelligence · Computer Science 2023-11-29 Yaoquan Wei , Shunyu Liu , Jie Song , Tongya Zheng , Kaixuan Chen , Yong Wang , Mingli Song

As deep reinforcement learning driven by visual perception becomes more widely used there is a growing need to better understand and probe the learned agents. Understanding the decision making process and its relationship to visual inputs…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Christian Rupprecht , Cyril Ibrahim , Christopher J. Pal

Reinforcement learning (RL) has demonstrated remarkable success in solving complex decision-making problems, yet its adoption in critical domains is hindered by the lack of interpretability in its decision-making processes. Existing…

Artificial Intelligence · Computer Science 2025-09-23 Rui Zuo , Simon Khan , Zifan Wang , Garrett Ethan Katz , Qinru Qiu

Reinforcement Learning (RL) agents are increasingly used to simulate sophisticated cyberattacks, but their decision-making processes remain opaque, hindering trust, debugging, and defensive preparedness. In high-stakes cybersecurity…

Cryptography and Security · Computer Science 2026-05-18 Diksha Goel , Kristen Moore , Jeff Wang , Minjune Kim , Thanh Thi Nguyen

In explainable artificial intelligence, there is increasing interest in understanding the behaviour of autonomous agents to build trust and validate performance. Modern agent architectures, such as those trained by deep reinforcement…

Artificial Intelligence · Computer Science 2020-09-22 Tom Bewley , Jonathan Lawry

Recent research on reinforcement learning (RL) has suggested that trained agents are vulnerable to maliciously crafted adversarial samples. In this work, we show how such samples can be generalised from White-box and Grey-box attacks to a…

Machine Learning · Computer Science 2019-11-25 Yiren Zhao , Ilia Shumailov , Han Cui , Xitong Gao , Robert Mullins , Ross Anderson

Having explored an environment, intelligent agents should be able to transfer their knowledge to most downstream tasks within that environment without additional interactions. Referred to as "zero-shot learning", this ability remains…

Machine Learning · Computer Science 2025-03-12 Siddhant Agarwal , Harshit Sikchi , Peter Stone , Amy Zhang

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Deep reinforcement learning has enabled robots to learn motor skills from environmental interactions with minimal to no prior knowledge. However, existing reinforcement learning algorithms assume an episodic setting, in which the agent…

Machine Learning · Computer Science 2022-05-27 Jigang Kim , J. hyeon Park , Daesol Cho , H. Jin Kim

Behavior cloning of expert demonstrations can speed up learning optimal policies in a more sample-efficient way over reinforcement learning. However, the policy cannot extrapolate well to unseen states outside of the demonstration data,…

Machine Learning · Computer Science 2022-10-19 Jung Yeon Park , Lawson L. S. Wong

Interactive reinforcement learning has become an important apprenticeship approach to speed up convergence in classic reinforcement learning problems. In this regard, a variant of interactive reinforcement learning is policy shaping which…

Artificial Intelligence · Computer Science 2019-04-16 Francisco Cruz , Sven Magg , Yukie Nagai , Stefan Wermter

In safety-critical applications, autonomous agents may need to learn in an environment where mistakes can be very costly. In such settings, the agent needs to behave safely not only after but also while learning. To achieve this, existing…

Machine Learning · Computer Science 2021-01-22 Matteo Turchetta , Andrey Kolobov , Shital Shah , Andreas Krause , Alekh Agarwal

Deep reinforcement learning has proven to be a great success in allowing agents to learn complex tasks. However, its application to actual robots can be prohibitively expensive. Furthermore, the unpredictability of human behavior in…

Robotics · Computer Science 2019-08-16 Mohammad Thabet , Massimiliano Patacchiola , Angelo Cangelosi