English
Related papers

Related papers: Explain Your Move: Understanding Agent Actions Usi…

200 papers

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Carola Figueroa-Flores , David Berga , Joost van der Weijer , Bogdan Raducanu

Multi-Agent Deep Reinforcement Learning (MADRL) was proven efficient in solving complex problems in robotics or games, yet most of the trained models are hard to interpret. While learning intrinsically interpretable models remains a…

Artificial Intelligence · Computer Science 2025-02-04 Yoann Poupart , Aurélie Beynier , Nicolas Maudet

Explainable AI (XAI) for Speech Emotion Recognition (SER) is critical for building transparent, trustworthy models. Current saliency-based methods, adapted from vision, highlight spectrogram regions but fail to show whether these regions…

Machine Learning · Computer Science 2025-11-18 Seham Nasr , Zhao Ren , David Johnson

Group activities usually involve spatiotemporal dynamics among many interactive individuals, while only a few participants at several key frames essentially define the activity. Therefore, effectively modeling the group-relevant and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Guyue Hu , Bo Cui , Yuan He , Shan Yu

Selective attention is an essential mechanism to filter sensory input and to select only its most important components, allowing the capacity-limited cognitive structures of the brain to process them in detail. The saliency map model,…

Image and Video Processing · Electrical Eng. & Systems 2024-01-11 Camille Simon Chane , Ernst Niebur , Ryad Benosman , Sio-Hoi Ieng

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

Machine Learning · Computer Science 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

As deep reinforcement learning driven by visual perception becomes more widely used there is a growing need to better understand and probe the learned agents. Understanding the decision making process and its relationship to visual inputs…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Christian Rupprecht , Cyril Ibrahim , Christopher J. Pal

When using reinforcement learning (RL) algorithms it is common, given a large state space, to introduce some form of approximation architecture for the value function (VF). The exact form of this architecture can have a significant effect…

Machine Learning · Computer Science 2019-02-19 Edward Barker , Charl Ras

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

High sample complexity has long been a challenge for RL. On the other hand, humans learn to perform tasks not only from interaction or demonstrations, but also by reading unstructured text documents, e.g., instruction manuals. Instruction…

Machine Learning · Computer Science 2024-07-23 Yue Wu , Yewen Fan , Paul Pu Liang , Amos Azaria , Yuanzhi Li , Tom M. Mitchell

Traditionally, Reinforcement Learning (RL) aims at deciding how to act optimally for an artificial agent. We argue that deciding when to act is equally important. As humans, we drift from default, instinctive or memorized behaviors to…

Machine Learning · Computer Science 2022-03-17 Alexis Jacq , Johan Ferret , Olivier Pietquin , Matthieu Geist

Machine Learning models become increasingly proficient in complex tasks. However, even for experts in the field, it can be difficult to understand what the model learned. This hampers trust and acceptance, and it obstructs the possibility…

Machine Learning · Computer Science 2018-07-24 Jasper van der Waa , Jurriaan van Diggelen , Karel van den Bosch , Mark Neerincx

Reinforcement learning involves agents interacting with an environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they take, thereby…

Multiagent Systems · Computer Science 2022-02-22 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble

Building trust in reinforcement learning (RL) agents requires understanding why they make certain decisions, especially in high-stakes applications like robotics, healthcare, and finance. Existing explainability methods often focus on…

Artificial Intelligence · Computer Science 2025-06-18 Rishav Rishav , Somjit Nath , Vincent Michalski , Samira Ebrahimi Kahou

We study reinforcement learning (RL) in a setting with a network of agents whose states and actions interact in a local manner where the objective is to find localized policies such that the (discounted) global reward is maximized. A…

Optimization and Control · Mathematics 2021-11-02 Guannan Qu , Adam Wierman , Na Li

Hanabi has become a popular game for research when it comes to reinforcement learning (RL) as it is one of the few cooperative card games where you have incomplete knowledge of the entire environment, thus presenting a challenge for a RL…

Machine Learning · Computer Science 2025-06-03 Nina Cohen , Kordel K. France

Recently, various auxiliary tasks have been proposed to accelerate representation learning and improve sample efficiency in deep reinforcement learning (RL). However, existing auxiliary tasks do not take the characteristics of RL problems…

Machine Learning · Computer Science 2021-02-23 Guoqing Liu , Chuheng Zhang , Li Zhao , Tao Qin , Jinhua Zhu , Jian Li , Nenghai Yu , Tie-Yan Liu

Deep Reinforcement Learning (DRL) connects the classic Reinforcement Learning algorithms with Deep Neural Networks. A problem in DRL is that CNNs are black-boxes and it is hard to understand the decision-making process of agents. In order…

Machine Learning · Computer Science 2020-12-03 Matthias Rosynski , Frank Kirchner , Matias Valdenegro-Toro

It is well established that neural networks are vulnerable to adversarial examples, which are almost imperceptible on human vision and can cause the deep models misbehave. Such phenomenon may lead to severely inestimable consequences in the…

Machine Learning · Computer Science 2020-09-09 Dengpan Ye , Chuanxi Chen , Changrui Liu , Hao Wang , Shunzhi Jiang