English
Related papers

Related papers: Why the Agent Made that Decision: Contrastive Expl…

200 papers

Reinforcement learning (RL) algorithms aim to learn optimal decisions in unknown environments through experience of taking actions and observing the rewards gained. In some cases, the environment is not influenced by the actions of the RL…

This paper introduces a novel approach Counterfactual Shapley Values (CSV), which enhances explainability in reinforcement learning (RL) by integrating counterfactual analysis with Shapley Values. The approach aims to quantify and compare…

Artificial Intelligence · Computer Science 2024-08-07 Yiwei Shi , Qi Zhang , Kevin McAreavey , Weiru Liu

We present a visual symptom checker that combines a pre-trained Convolutional Neural Network (CNN) with a Reinforcement Learning (RL) agent as a Question Answering (QA) model. This method increases the classification confidence and accuracy…

Artificial Intelligence · Computer Science 2019-08-09 Mohamed Akrout , Amir-massoud Farahmand , Tory Jarmain , Latif Abid

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

In many vision-based reinforcement learning (RL) problems, the agent controls a movable object in its visual field, e.g., the player's avatar in video games and the robotic arm in visual grasping and manipulation. Leveraging…

Machine Learning · Computer Science 2020-02-24 Yuanyi Zhong , Alexander Schwing , Jian Peng

As AI systems become increasingly integrated into high-stakes domains, enabling users to accurately interpret model behavior is critical. While AI explanations can be provided, users often struggle to reason effectively with these…

Human-Computer Interaction · Computer Science 2025-08-27 Aniket Nuthalapati , Nicholas Hinds , Brian Y. Lim , Qianwen Wang

Growing concerns regarding the operational usage of AI models in the real-world has caused a surge of interest in explaining AI models' decisions to humans. Reinforcement Learning is not an exception in this regard. In this work, we propose…

Machine Learning · Computer Science 2023-10-06 Omid Davoodi , Majid Komeili

Our work aims at efficiently leveraging ambiguous demonstrations for the training of a reinforcement learning (RL) agent. An ambiguous demonstration can usually be interpreted in multiple ways, which severely hinders the RL-Agent from…

Machine Learning · Computer Science 2024-02-09 Yantian Zha , Lin Guan , Subbarao Kambhampati

Vision-based reinforcement learning (RL) is successful, but how to generalize it to unknown test environments remains challenging. Existing methods focus on training an RL policy that is universal to changing visual domains, whereas we…

Robotics · Computer Science 2021-04-20 Xudong Wang , Long Lian , Stella X. Yu

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Humans integrate multiple sensory modalities (e.g. visual and audio) to build a causal understanding of the physical world. In this work, we propose a novel type of intrinsic motivation for Reinforcement Learning (RL) that encourages the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chuang Gan , Xiaoyu Chen , Phillip Isola , Antonio Torralba , Joshua B. Tenenbaum

Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinforcement learning (RL) has been widely explored for adapting MCAs to various human-AI interaction…

Computation and Language · Computer Science 2026-04-14 Yongqi Li , Hao Lang , Tieyun Qian , Yongbin Li

Despite tremendous progress, machine learning and deep learning still suffer from incomprehensible predictions. Incomprehensibility, however, is not an option for the use of (deep) reinforcement learning in the real world, as unpredictable…

Artificial Intelligence · Computer Science 2024-07-23 Manuel Eberhardinger , Florian Rupp , Johannes Maucher , Setareh Maghsudi

Reinforcement Learning (RL) agents have been widely used to improve networking tasks. However, understanding the decisions made by these agents is essential for their broader adoption in networking and network management. To address this,…

Networking and Internet Architecture · Computer Science 2025-09-29 Yeison Stiven Murcia , Oscar Mauricio Caicedo , Daniela Maria Casas , Nelson Luis Saldanha da Fonseca

Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learned representations:…

Machine Learning · Statistics 2023-01-18 Kyungmin Lee , Jinwoo Shin

Deep reinforcement learning (DeepRL) agents surpass human-level performance in many tasks. However, the direct mapping from states to actions makes it hard to interpret the rationale behind the decision-making of the agents. In contrast to…

Machine Learning · Computer Science 2023-04-07 Zhao Yang , Song Bai , Li Zhang , Philip H. S. Torr

Artificial Intelligence (AI) models increasingly drive high-stakes consumer interactions, yet their decision logic often remains opaque. Prevailing explainable AI techniques rely on post hoc numerical feature attributions, which fail to…

Computation and Language · Computer Science 2026-01-09 Xiang Cheng , Wen Wang , Anindya Ghose

Reinforcement Learning (RL) is emerging as tool for tackling complex control and decision-making problems. However, in high-risk environments such as healthcare, manufacturing, automotive or aerospace, it is often challenging to bridge the…

Artificial Intelligence · Computer Science 2022-04-28 Paul Festor , Giulia Luise , Matthieu Komorowski , A. Aldo Faisal

We consider the problem of providing users of deep Reinforcement Learning (RL) based systems with a better understanding of when their output can be trusted. We offer an explainable artificial intelligence (XAI) framework that provides a…

Artificial Intelligence · Computer Science 2021-06-08 Jeff Druce , Michael Harradon , James Tittle

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…