English
Related papers

Related papers: ProtoX: Explaining a Reinforcement Learning Agent …

200 papers

Post-hoc explanations for black box models have been studied extensively in classification and regression settings. However, explanations for models that output similarity between two inputs have received comparatively lesser attention. In…

Machine Learning · Computer Science 2022-02-03 Karthikeyan Natesan Ramamurthy , Amit Dhurandhar , Dennis Wei , Zaid Bin Tariq

Deep imitation learning requires many expert demonstrations, which can be hard to obtain, especially when many tasks are involved. However, different tasks often share similarities, so learning them jointly can greatly benefit them and…

Machine Learning · Computer Science 2022-05-16 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

This paper develops a new approach for estimating an interpretable, relational model of a black-box autonomous agent that can plan and act. Our main contributions are a new paradigm for estimating such models using a minimal query interface…

Artificial Intelligence · Computer Science 2021-04-12 Pulkit Verma , Shashank Rao Marpally , Siddharth Srivastava

Modern machine learning models are complicated. Most of them rely on convoluted latent representations of their input to issue a prediction. To achieve greater transparency than a black-box that connects inputs to predictions, it is…

Machine Learning · Computer Science 2021-10-29 Jonathan Crabbé , Zhaozhi Qian , Fergus Imrie , Mihaela van der Schaar

A fundamental challenge in reinforcement learning is to learn policies that generalize beyond the operating domains experienced during training. In this paper, we approach this challenge through the following invariance principle: an agent…

Machine Learning · Computer Science 2020-11-10 Anoopkumar Sonar , Vincent Pacelli , Anirudha Majumdar

With the increasing presence of robotic systems and human-robot environments in today's society, understanding the reasoning behind actions taken by a robot is becoming more important. To increase this understanding, users are provided with…

Robotics · Computer Science 2022-11-24 Niclas Schroeter , Francisco Cruz , Stefan Wermter

Agentic multimodal models should not only comprehend text and images, but also actively invoke external tools, such as code execution environments and web search, and integrate these operations into reasoning. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jack Hong , Chenxiao Zhao , ChengLin Zhu , Weiheng Lu , Guohai Xu , Xing Yu

As reinforcement learning agents become increasingly deployed in real-world scenarios, predicting future agent actions and events during deployment is important for facilitating better human-agent interaction and preventing catastrophic…

Artificial Intelligence · Computer Science 2024-10-31 Stephen Chung , Scott Niekum , David Krueger

Existing action detection algorithms usually generate action proposals through an extensive search over the video at multiple temporal scales, which brings about huge computational overhead and deviates from the human perception procedure.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Jingjia Huang , Nannan Li , Tao Zhang , Ge Li

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

One of the fundamental challenges in reinforcement learning (RL) is the one of data efficiency: modern algorithms require a very large number of training samples, especially compared to humans, for solving environments with high-dimensional…

Machine Learning · Computer Science 2021-05-10 Hlynur Davíð Hlynsson , Laurenz Wiskott

Robotic systems are ever more capable of automation and fulfilment of complex tasks, particularly with reliance on recent advances in intelligent systems, deep learning and artificial intelligence. However, as robots and humans come closer…

Machine Learning · Computer Science 2020-02-13 Benjamin Beyret , Ali Shafti , A. Aldo Faisal

Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow…

Machine Learning · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes A. Stork

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Reinforcement learning (RL) systems can be complex and non-interpretable, making it challenging for non-AI experts to understand or intervene in their decisions. This is due in part to the sequential nature of RL in which actions are chosen…

Artificial Intelligence · Computer Science 2025-04-16 Amal Alabdulkarim , Madhuri Singh , Gennie Mansi , Kaely Hall , Upol Ehsan , Mark O. Riedl

Explainable reinforcement learning (XRL) methods aim to help elucidate agent policies and decision-making processes. The majority of XRL approaches focus on local explanations, seeking to shed light on the reasons an agent acts the way it…

Artificial Intelligence · Computer Science 2023-12-19 Yotam Amitai , Yael Septon , Ofra Amir

Autonomous intelligent agents must bridge computational challenges at disparate levels of abstraction, from the low-level spaces of sensory input and motor commands to the high-level domain of abstract reasoning and planning. A key question…

Artificial Intelligence · Computer Science 2025-12-12 Ruben van Bergen , Justus Hübotter , Alma Lago , Pablo Lanillos

The ability to act in multiple environments and transfer previous knowledge to new situations can be considered a critical aspect of any intelligent agent. Towards this goal, we define a novel method of multitask and transfer learning that…

Machine Learning · Computer Science 2016-02-23 Emilio Parisotto , Jimmy Lei Ba , Ruslan Salakhutdinov

Recent years have witnessed the widespread adoption of reinforcement learning (RL), from solving real-time games to fine-tuning large language models using human preference data significantly improving alignment with user expectations.…

Machine Learning · Computer Science 2026-04-01 Bodla Krishna Vamshi , Haizhao Yang