中文
相关论文

相关论文: Counterfactual Explanation Policies in RL

200 篇论文

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Despite the impressive feats demonstrated by Reinforcement Learning (RL), these algorithms have seen little adoption in high-risk, real-world applications due to current difficulties in explaining RL agent actions and building user trust.…

机器学习 · 计算机科学 2023-12-08 Timothy K. Mathes , Jessica Inman , Andrés Colón , Simon Khan

Broad Explainable Artificial Intelligence moves away from interpreting individual decisions based on a single datum and aims to provide integrated explanations from multiple machine learning algorithms into a coherent explanation of an…

人工智能 · 计算机科学 2021-08-23 Richard Dazeley , Peter Vamplew , Francisco Cruz

Understanding a \textit{reinforcement learning} policy, which guides state-to-action mappings to maximize rewards, necessitates an accompanying explanation for human comprehension. In this paper, we introduce a set of \textit{linear…

人工智能 · 计算机科学 2025-05-01 Mikihisa Yuasa , Huy T. Tran , Ramavarapu S. Sreenivas

Reinforcement Learning (RL) agents can solve diverse tasks but often exhibit unsafe behavior. Constrained Markov Decision Processes (CMDPs) address this by enforcing safety constraints, yet existing methods either sacrifice reward…

机器学习 · 计算机科学 2025-08-18 Nikola Milosevic , Johannes Müller , Nico Scherf

Counterfactual reasoning has emerged as a crucial technique for generalizing the reasoning capabilities of large language models (LLMs). By generating and analyzing counterfactual scenarios, researchers can assess the adaptability and…

人工智能 · 计算机科学 2026-02-17 Shuai Yang , Qi Yang , Luoxi Tang , Yuqiao Meng , Nancy Guo , Jeremy Blackburn , Zhaohan Xi

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

机器学习 · 计算机科学 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Counterfactual explanations, which deal with "why not?" scenarios, can provide insightful explanations to an AI agent's behavior. In this work, we focus on generating counterfactual explanations for deep reinforcement learning (RL) agents…

人工智能 · 计算机科学 2021-02-01 Matthew L. Olson , Roli Khanna , Lawrence Neal , Fuxin Li , Weng-Keen Wong

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

机器学习 · 计算机科学 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Explanation is a key component for the adoption of reinforcement learning (RL) in many real-world decision-making problems. In the literature, the explanation is often provided by saliency attribution to the features of the RL agent's…

Transfer reinforcement learning (RL) aims at improving the learning efficiency of an agent by exploiting knowledge from other source agents trained on relevant tasks. However, it remains challenging to transfer knowledge between different…

机器学习 · 计算机科学 2020-12-11 Mohammadamin Barekatain , Ryo Yonetani , Masashi Hamaya

Despite recent progress in reinforcement learning (RL), RL algorithms for exploration still remain an active area of research. Existing methods often focus on state-based metrics, which do not consider the underlying causal structures of…

Multi-task reinforcement learning (RL) aims to simultaneously learn policies for solving many tasks. Several prior works have found that relabeling past experience with different reward functions can improve sample efficiency. Relabeling…

机器学习 · 计算机科学 2020-02-26 Benjamin Eysenbach , Xinyang Geng , Sergey Levine , Ruslan Salakhutdinov

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

机器学习 · 计算机科学 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer

Work in Counterfactual Explanations tends to focus on the principle of "the closest possible world" that identifies small changes leading to the desired outcome. In this paper we argue that while this approach might initially seem…

机器学习 · 计算机科学 2020-02-25 Rafael Poyiadzi , Kacper Sokol , Raul Santos-Rodriguez , Tijl De Bie , Peter Flach

We study offline reinforcement learning (RL) which seeks to learn a good policy based on a fixed, pre-collected dataset. A fundamental challenge behind this task is the distributional shift due to the dataset lacking sufficient exploration,…

机器学习 · 计算机科学 2023-10-11 Wenzhuo Zhou

Reinforcement Learning (RL) methods have emerged as a popular choice for training an efficient and effective dialogue policy. However, these methods suffer from sparse and unstable reward signals returned by a user simulator only when a…

人工智能 · 计算机科学 2020-09-18 Ziming Li , Sungjin Lee , Baolin Peng , Jinchao Li , Julia Kiseleva , Maarten de Rijke , Shahin Shayandeh , Jianfeng Gao

Reinforcement learning algorithms have had tremendous successes in online learning settings. However, these successes have relied on low-stakes interactions between the algorithmic agent and its environment. In many settings where RL could…

机器学习 · 计算机科学 2020-06-05 James Bannon , Brad Windsor , Wenbo Song , Tao Li