English
Related papers

Related papers: Reliable Off-Policy Learning for Dosage Combinatio…

200 papers

We present a novel off-policy loss function for learning a transition model in model-based reinforcement learning. Notably, our loss is derived from the off-policy policy evaluation objective with an emphasis on correcting distribution…

Machine Learning · Computer Science 2021-03-04 Cameron Voloshin , Nan Jiang , Yisong Yue

We study off-policy evaluation and learning from sequential data in a structured class of Markov decision processes that arise from repeated interactions with an exogenous sequence of arrivals with contexts, which generate unknown…

Machine Learning · Computer Science 2021-10-20 Nathan Kallus , Angela Zhou

The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads to effective evaluation metrics, as well as learning…

Machine Learning · Computer Science 2024-09-17 Olivier Jeunen , Aleksei Ustimenko

The development of self-propelled particles at the micro- and the nanoscale has sparked a huge potential for future applications in active matter physics, microsurgery, and targeted drug delivery. However, while the latter applications…

Soft Condensed Matter · Physics 2022-08-24 Mahdi Nasiri , Benno Liebchen

An off policy reinforcement learning based control strategy is developed for the optimal tracking control problem to achieve the prescribed performance of full states during the learning process. The optimal tracking control problem is…

Systems and Control · Electrical Eng. & Systems 2020-09-02 C. Li , Y. Wang , F. Liu , M. Buss

Most deep reinforcement learning (RL) systems are not able to learn effectively from off-policy data, especially if they cannot explore online in the environment. These are critical shortcomings for applying RL to real-world problems where…

Personalised interactive systems such as recommender systems require selecting relevant items from massive catalogs dependent on context. Reward-driven offline optimisation of these systems can be achieved by a relaxation of the discrete…

Information Retrieval · Computer Science 2023-05-30 Otmane Sakhi , David Rohde , Alexandre Gilotte

The use of drug combinations in clinical trials is increasingly common during the last years since a more favorable therapeutic response may be obtained by combining drugs. In phase I clinical trials, most of the existing methodology…

Methodology · Statistics 2020-02-17 José L. Jiménez , Sungjin Kim , Mourad Tighiouart

Offline reinforcement learning (RL) faces a critical challenge of overestimating the value of out-of-distribution (OOD) actions. Existing methods mitigate this issue by penalizing unseen samples, yet they fail to accurately identify OOD…

Machine Learning · Computer Science 2026-05-12 Qingjun Wang , Hongtu Zhou , Hang Yu , Junqiao Zhao , Yanping Zhao , Chen Ye , Ziqiao Wang , Guang Chen

This work develops a fully decentralized multi-agent algorithm for policy evaluation. The proposed scheme can be applied to two distinct scenarios. In the first scenario, a collection of agents have distinct datasets gathered following…

Machine Learning · Computer Science 2019-08-13 Lucas Cassano , Kun Yuan , Ali H. Sayed

The effectiveness of personalized oncology treatments ultimately depends on whether outcomes can be causally attributed to the treatment. Advances in precision oncology have improved molecular profiling of individuals, and tailored…

Applications · Statistics 2025-09-29 Lydia Jang , Stefan Konigorski

We consider the problem of sequentially making decisions that are rewarded by "successes" and "failures" which can be predicted through an unknown relationship that depends on a partially controllable vector of attributes for each instance.…

Machine Learning · Statistics 2017-09-18 Yingfei Wang , Chu Wang , Warren Powell

Purpose: This study aimed to use deep learning-based dose prediction to assess head and neck (HN) plan quality and identify suboptimal plans. Methods: A total of 245 VMAT HN plans were created using RapidPlan knowledge-based planning (KBP).…

Reinforcement learning algorithms are typically limited to learning a single solution for a specified task, even though diverse solutions often exist. Recent studies showed that learning a set of diverse solutions is beneficial because…

Machine Learning · Statistics 2022-04-14 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

Many real-world applications of reinforcement learning (RL) require making decisions in continuous action environments. In particular, determining the optimal dose level plays a vital role in developing medical treatment regimes. One…

Machine Learning · Statistics 2023-10-03 Yuhan Li , Wenzhuo Zhou , Ruoqing Zhu

When performing imitation learning from expert demonstrations, distribution matching is a popular approach, in which one alternates between estimating distribution ratios and then using these ratios as rewards in a standard reinforcement…

Machine Learning · Computer Science 2019-12-12 Ilya Kostrikov , Ofir Nachum , Jonathan Tompson

We study the efficient off-policy evaluation of natural stochastic policies, which are defined in terms of deviations from the behavior policy. This is a departure from the literature on off-policy evaluation where most work consider the…

Machine Learning · Computer Science 2020-11-05 Nathan Kallus , Masatoshi Uehara

Recommendation strategies are typically evaluated by using previously logged data, employing off-policy evaluation methods to estimate their expected performance. However, for strategies that present users with slates of multiple items, the…

Information Retrieval · Computer Science 2023-12-29 Shreyas Chaudhari , David Arbour , Georgios Theocharous , Nikos Vlassis

The standard problem setting in Dec-POMDPs is self-play, where the goal is to find a set of policies that play optimally together. Policies learned through self-play may adopt arbitrary conventions and implicitly rely on multi-step…

Artificial Intelligence · Computer Science 2021-08-19 Hengyuan Hu , Adam Lerer , Brandon Cui , David Wu , Luis Pineda , Noam Brown , Jakob Foerster

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

Machine Learning · Statistics 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu