English
Related papers

Related papers: Offline Policy Comparison with Confidence: Benchma…

200 papers

The world currently offers an abundance of data in multiple domains, from which we can learn reinforcement learning (RL) policies without further interaction with the environment. RL agents learning offline from such data is possible but…

Machine Learning · Computer Science 2022-12-19 Hager Radi , Josiah P. Hanna , Peter Stone , Matthew E. Taylor

Previous work has shown the unreliability of existing algorithms in the batch Reinforcement Learning setting, and proposed the theoretically-grounded Safe Policy Improvement with Baseline Bootstrapping (SPIBB) fix: reproduce the baseline…

Machine Learning · Computer Science 2021-01-01 Thiago D. Simão , Romain Laroche , Rémi Tachet des Combes

When observed decisions depend only on observed features, off-policy policy evaluation (OPE) methods for sequential decision making problems can estimate the performance of evaluation policies before deploying them. This assumption is…

Machine Learning · Statistics 2020-03-13 Hongseok Namkoong , Ramtin Keramati , Steve Yadlowsky , Emma Brunskill

Off-Policy reinforcement learning has been a driving force for the state-of-the-art conversational AIs leading to more natural humanagent interactions and improving the user satisfaction for goal-oriented agents. However, in large-scale…

Artificial Intelligence · Computer Science 2023-05-19 Sarthak Ahuja , Mohammad Kachuee , Fateme Sheikholeslami , Weiqing Liu , Jaeyoung Do

We propose a new model-based offline RL framework, called Adversarial Models for Offline Reinforcement Learning (ARMOR), which can robustly learn policies to improve upon an arbitrary baseline policy regardless of data coverage. Based on…

Machine Learning · Computer Science 2022-11-10 Tengyang Xie , Mohak Bhardwaj , Nan Jiang , Ching-An Cheng

The challenge in the widely applicable online matching problem lies in making irrevocable assignments while there is uncertainty about future inputs. Most theoretically-grounded policies are myopic or greedy in nature. In real-world…

Machine Learning · Computer Science 2022-11-01 Mohammad Ali Alomrani , Reza Moravej , Elias B. Khalil

We consider offline Reinforcement Learning (RL), where the agent does not interact with the environment and must rely on offline data collected using a behavior policy. Previous works provide policy evaluation guarantees when the target…

Machine Learning · Computer Science 2023-05-26 Xumei Xi , Christina Lee Yu , Yudong Chen

Online interactions with the environment to collect data samples for training a Reinforcement Learning (RL) agent is not always feasible due to economic and safety concerns. The goal of Offline Reinforcement Learning is to address this…

Machine Learning · Computer Science 2021-10-05 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

We study offline reinforcement learning (RL) which seeks to learn a good policy based on a fixed, pre-collected dataset. A fundamental challenge behind this task is the distributional shift due to the dataset lacking sufficient exploration,…

Machine Learning · Computer Science 2023-10-11 Wenzhuo Zhou

We consider off-policy evaluation (OPE), which evaluates the performance of a new policy from observed data collected from previous experiments, without requiring the execution of the new policy. This finds important applications in areas…

Machine Learning · Computer Science 2020-08-18 Yihao Feng , Tongzheng Ren , Ziyang Tang , Qiang Liu

Off-policy learning is a framework for evaluating and optimizing policies without deploying them, from data collected by another policy. Real-world environments are typically non-stationary and the offline learned policies should adapt to…

Machine Learning · Computer Science 2021-04-06 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed

Learning robust driving policies from large-scale, real-world datasets is a central challenge in autonomous driving, as online data collection is often unsafe and impractical. While Behavioral Cloning (BC) offers a straightforward approach…

Machine Learning · Computer Science 2025-08-28 Antonio Guillen-Perez

We study high-confidence behavior-agnostic off-policy evaluation in reinforcement learning, where the goal is to estimate a confidence interval on a target policy's value, given only access to a static experience dataset collected by…

Machine Learning · Computer Science 2020-10-23 Bo Dai , Ofir Nachum , Yinlam Chow , Lihong Li , Csaba Szepesvári , Dale Schuurmans

The rising popularity of driver-less cars has led to the research and development in the field of autonomous racing, and overtaking in autonomous racing is a challenging task. Vehicles have to detect and operate at the limits of dynamic…

Robotics · Computer Science 2021-07-22 Jayanth Bhargav , Johannes Betz , Hongrui Zheng , Rahul Mangharam

Offline reinforcement learning agents seek optimal policies from fixed data sets. With environmental interaction prohibited, agents face significant challenges in preventing errors in value estimates from compounding and subsequently…

Machine Learning · Computer Science 2023-03-28 Alex Beeson , Giovanni Montana

We consider the problem of evaluating the performance of a decision policy using past observational data. The outcome of a policy is measured in terms of a loss (aka. disutility or negative reward) and the main problem is making valid…

Machine Learning · Statistics 2023-07-03 Sofia Ek , Dave Zachariah , Fredrik D. Johansson , Petre Stoica

Reinforcement learning algorithms have had tremendous successes in online learning settings. However, these successes have relied on low-stakes interactions between the algorithmic agent and its environment. In many settings where RL could…

Machine Learning · Computer Science 2020-06-05 James Bannon , Brad Windsor , Wenbo Song , Tao Li

We study off-policy evaluation and learning from sequential data in a structured class of Markov decision processes that arise from repeated interactions with an exogenous sequence of arrivals with contexts, which generate unknown…

Machine Learning · Computer Science 2021-10-20 Nathan Kallus , Angela Zhou

Off-policy evaluation is critical in a number of applications where new policies need to be evaluated offline before online deployment. Most existing methods focus on the expected return, define the target parameter through averaging and…

Machine Learning · Statistics 2023-02-10 Yingying Zhang , Chengchun Shi , Shikai Luo

Models for bankruptcy prediction are useful in several real-world scenarios, and multiple research contributions have been devoted to the task, based on structured (numerical) as well as unstructured (textual) data. However, the lack of a…

Computation and Language · Computer Science 2022-08-25 Henri Arno , Klaas Mulier , Joke Baeck , Thomas Demeester