English
Related papers

Related papers: (When) Are Contrastive Explanations of Reinforceme…

200 papers

The widespread deployment of machine learning systems in critical real-world decision-making applications has highlighted the urgent need for counterfactual explainability methods that operate effectively. Global counterfactual…

Deep Reinforcement Learning (DRL) has demonstrated promising capability in solving complex control problems. However, DRL applications in safety-critical systems are hindered by the inherent lack of robust verification techniques to assure…

Machine Learning · Computer Science 2023-10-10 Amir Samadi , Konstantinos Koufos , Kurt Debattista , Mehrdad Dianati

As safety violations can lead to severe consequences in real-world robotic applications, the increasing deployment of Reinforcement Learning (RL) in robotic domains has propelled the study of safe exploration for reinforcement learning…

Artificial Intelligence · Computer Science 2022-09-21 Hanping Zhang , Yuhong Guo

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

Human-Computer Interaction · Computer Science 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu

In meta reinforcement learning (meta RL), an agent seeks a Bayes-optimal policy -- the optimal policy when facing an unknown task that is sampled from some known task distribution. Previous approaches tackled this problem by inferring a…

Machine Learning · Computer Science 2023-06-06 Era Choshen , Aviv Tamar

Safe reinforcement learning (RL) trains a policy to maximize the task reward while satisfying safety constraints. While prior works focus on the performance optimality, we find that the optimal solutions of many safe RL problems are not…

Machine Learning · Computer Science 2023-03-03 Zuxin Liu , Zijian Guo , Zhepeng Cen , Huan Zhang , Jie Tan , Bo Li , Ding Zhao

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

Computation and Language · Computer Science 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Reinforcement learning~(RL) is a versatile framework for learning to solve complex real-world tasks. However, influences on the learning performance of RL algorithms are often poorly understood in practice. We discuss different analysis…

Machine Learning · Computer Science 2023-09-14 Jan Schneider , Pierre Schumacher , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

Batch reinforcement learning (RL) is important to apply RL algorithms to many high stakes tasks. Doing batch RL in a way that yields a reliable new policy in large domains is challenging: a new decision policy may visit states and actions…

Machine Learning · Computer Science 2020-07-23 Yao Liu , Adith Swaminathan , Alekh Agarwal , Emma Brunskill

After four decades of research there still exists a Classification accuracy gap of about 20% between our best Unsupervisedly Learned Representations methods and the accuracy rates achieved by intelligent animals. It thus may well be that we…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

In reinforcement learning (RL) theory, the concept of most confusing instances is central to establishing regret lower bounds, that is, the minimal exploration needed to solve a problem. Given a reference model and its optimal policy, a…

Machine Learning · Computer Science 2025-10-27 Waris Radji , Odalric-Ambrym Maillard

Reinforcement learning (RL) is a powerful technique for training intelligent agents, but understanding why these agents make specific decisions can be quite challenging. This lack of transparency in RL models has been a long-standing…

Machine Learning · Computer Science 2024-04-02 Wenhao Lu , Xufeng Zhao , Thilo Fryen , Jae Hee Lee , Mengdi Li , Sven Magg , Stefan Wermter

Counterfactual explanations are gaining prominence within technical, legal, and business circles as a way to explain the decisions of a machine learning model. These explanations share a trait with the long-established "principal reason"…

Computers and Society · Computer Science 2019-12-12 Solon Barocas , Andrew D. Selbst , Manish Raghavan

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Understanding emerging behaviors of reinforcement learning (RL) agents may be difficult since such agents are often trained in complex environments using highly complex decision making procedures. This has given rise to a variety of…

Artificial Intelligence · Computer Science 2022-12-02 Mira Finkelstein , Lucy Liu , Nitsan Levy Schlot , Yoav Kolumbus , David C. Parkes , Jeffrey S. Rosenshein , Sarah Keren

A major drawback of reasoning models is their excessive token usage, inflating computational cost, resource demand, and latency. We show this verbosity stems not from deeper reasoning but from reinforcement learning loss minimization when…

Computation and Language · Computer Science 2025-11-24 Mehdi Fatemi , Banafsheh Rafiee , Mingjie Tang , Kartik Talamadupula

Reinforcement learning (RL) involves sequential decision making in uncertain environments. The aim of the decision-making agent is to maximize the benefit of acting in its environment over an extended period of time. Finding an optimal…

Artificial Intelligence · Computer Science 2007-05-23 Istvan Szita , Balint Takacs , Andras Lorincz

Counterfactual explanations (CEs) are a powerful means for understanding how decisions made by algorithms can be changed. Researchers have proposed a number of desiderata that CEs should meet to be practically useful, such as requiring…

Machine Learning · Computer Science 2022-09-26 Marco Virgolin , Saverio Fracaros