English
Related papers

Related papers: Explain Your Move: Understanding Agent Actions Usi…

200 papers

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

Transformers are state-of-the-art models for a variety of sequence modeling tasks. At their core is an attention function which models pairwise interactions between the inputs at every timestep. While attention is powerful, it does not…

Computation and Language · Computer Science 2021-03-23 Hao Peng , Nikolaos Pappas , Dani Yogatama , Roy Schwartz , Noah A. Smith , Lingpeng Kong

Deep Reinforcement Learning (DRL) is a frequently employed technique to solve scheduling problems. Although DRL agents ace at delivering viable results in short computing times, their reasoning remains opaque. We conduct a case study where…

Artificial Intelligence · Computer Science 2024-09-02 Daniel Fischer , Hannah M. Hüsener , Felix Grumbach , Lukas Vollenkemper , Arthur Müller , Pascal Reusch

Counterfactual explanations are a common tool to explain artificial intelligence models. For Reinforcement Learning (RL) agents, they answer "Why not?" or "What if?" questions by illustrating what minimal change to a state is needed such…

Machine Learning · Computer Science 2023-02-27 Tobias Huber , Maximilian Demmler , Silvan Mertes , Matthew L. Olson , Elisabeth André

Recent advances in Reinforcement Learning (RL) largely benefit from the inclusion of Deep Neural Networks, boosting the number of novel approaches proposed in the field of Deep Reinforcement Learning (DRL). These techniques demonstrate the…

Machine Learning · Computer Science 2025-07-30 Giovanni Dispoto , Paolo Bonetti , Marcello Restelli

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how…

Robotics · Computer Science 2018-01-01 Shane Barratt

In order for humans to confidently decide where to employ RL agents for real-world tasks, a human developer must validate that the agent will perform well at test-time. Some policy interpretability methods facilitate this by capturing the…

Machine Learning · Computer Science 2022-03-22 Julius Frost , Olivia Watkins , Eric Weiner , Pieter Abbeel , Trevor Darrell , Bryan Plummer , Kate Saenko

This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency branch to an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Carola Figueroa Flores , Abel Gonzalez-García , Joost van de Weijer , Bogdan Raducanu

In recent years, advances in deep learning have resulted in a plethora of successes in the use of reinforcement learning (RL) to solve complex sequential decision tasks with high-dimensional inputs. However, existing systems lack the…

Artificial Intelligence · Computer Science 2023-07-19 Pedro Sequeira , Melinda Gervasio

In graph-structured multi-agent reinforcement learning (MARL) adversarial tasks such as pursuit and confrontation, agents must coordinate under highly dynamic interactions, where sparse rewards hinder efficient policy learning. We propose…

Machine Learning · Computer Science 2025-11-12 Ruochuan Shi , Runyu Lu , Yuanheng Zhu , Dongbin Zhao

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller

Data augmentation is a commonly applied technique with two seemingly related advantages. With this method one can increase the size of the training set generating new samples and also increase the invariance of the network against the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jalal Al-afandi , Bálint Magyar , András Horváth

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered great success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g.,…

Machine Learning · Computer Science 2021-04-30 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

When assisting human users in reinforcement learning (RL), we can represent users as RL agents and study key parameters, called \emph{user traits}, to inform intervention design. We study the relationship between user behaviors (policy…

Machine Learning · Computer Science 2023-07-18 L. L. Ankile , B. S. Ham , K. Mao , E. Shin , S. Swaroop , F. Doshi-Velez , W. Pan

There is a recent surge of interest in using attention as explanation of model predictions, with mixed evidence on whether attention can be used as such. While attention conveniently gives us one weight per input token and is easily…

Computation and Language · Computer Science 2020-10-13 Jasmijn Bastings , Katja Filippova

Current role-playing agents (RPAs) are typically constructed by imitating surface-level behaviors, but this approach lacks internal cognitive consistency, often causing out-of-character errors in complex situations. To address this, we…

Computation and Language · Computer Science 2026-01-09 Yihong Tang , Kehai Chen , Xuefeng Bai , Benyou Wang , Zeming Liu , Haifeng Wang , Min Zhang

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

Machine Learning · Computer Science 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi

Prevalent theories in cognitive science propose that humans understand and represent the knowledge of the world through causal relationships. In making sense of the world, we build causal models in our mind to encode cause-effect relations…

Machine Learning · Computer Science 2019-11-21 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

Reinforcement Learning (RL) in environments with complex, history-dependent reward structures poses significant challenges for traditional methods. In this work, we introduce a novel approach that leverages automaton-based feedback to guide…

Machine Learning · Computer Science 2025-10-20 Mahyar Alinejad , Alvaro Velasquez , Yue Wang , George Atia

In computational reinforcement learning, a growing body of work seeks to construct an agent's perception of the world through predictions of future sensations; predictions about environment observations are used as additional input features…

Machine Learning · Computer Science 2022-06-15 Alexandra Kearney , Anna Koop , Johannes Günther , Patrick M. Pilarski