English
Related papers

Related papers: Breaking Determinism: Stochastic Modeling for Reli…

200 papers

Off-policy evaluation (OPE) estimates the performance of a target policy using offline data collected from a behavior policy, and is crucial in domains such as robotics or healthcare where direct interaction with the environment is costly…

The purpose of Inventory Pricing is to bid the right prices to online ad opportunities, which is crucial for a Demand-Side Platform (DSP) to win advertising auctions in Real-Time Bidding (RTB). In the planning stage, advertisers need the…

Machine Learning · Computer Science 2021-10-27 Xu Li , Michelle Ma Zhang , Youjun Tong , Zhenya Wang

Off-policy evaluation (OPE) is to evaluate a target policy with data generated by other policies. Most previous OPE methods focus on precisely estimating the true performance of a policy. We observe that in many applications, (1) the end…

Machine Learning · Computer Science 2022-06-22 Yue Jin , Yue Zhang , Tao Qin , Xudong Zhang , Jian Yuan , Houqiang Li , Tie-Yan Liu

A/B testing is critical for modern technological companies to evaluate the effectiveness of newly developed products against standard baselines. This paper studies optimal designs that aim to maximize the amount of information obtained from…

Methodology · Statistics 2023-11-07 Ting Li , Chengchun Shi , Jianing Wang , Fan Zhou , Hongtu Zhu

The $b$-matching problem is an allocation problem where the vertices on the left-hand side of a bipartite graph, referred to as servers, may be matched multiple times. In the setting with stochastic rewards, an assignment between an…

Data Structures and Algorithms · Computer Science 2024-11-27 Susanne Albers , Sebastian Schubert

Off-Policy Evaluation (OPE) aims to assess the effectiveness of counterfactual policies using only offline logged data and is often used to identify the top-k promising policies for deployment in online A/B tests. Existing evaluation…

Machine Learning · Computer Science 2024-03-12 Haruka Kiyohara , Ren Kishimoto , Kosuke Kawakami , Ken Kobayashi , Kazuhide Nakata , Yuta Saito

Off-policy evaluation (OPE) aims to estimate the performance of hypothetical policies using data generated by a different policy. Because of its huge potential impact in practice, there has been growing research interest in this field.…

Machine Learning · Computer Science 2021-10-27 Yuta Saito , Shunsuke Aihara , Megumi Matsutani , Yusuke Narita

Off-policy evaluation (OPE) in reinforcement learning is an important problem in settings where experimentation is limited, such as education and healthcare. But, in these very same settings, observed actions are often confounded by…

Machine Learning · Computer Science 2020-07-29 Andrew Bennett , Nathan Kallus , Lihong Li , Ali Mousavi

Off-policy evaluation (OPE) and off-policy learning (OPL) are foundational for decision-making in offline contextual bandits. Recent advances in OPL primarily optimize OPE estimators with improved statistical properties, assuming that…

Machine Learning · Statistics 2025-09-04 Imad Aouali , Otmane Sakhi

This paper addresses the problem of policy selection in domains with abundant logged data, but with a restricted interaction budget. Solving this problem would enable safe evaluation and deployment of offline reinforcement learning policies…

In this work, we consider the problem of model selection for deep reinforcement learning (RL) in real-world environments. Typically, the performance of deep RL algorithms is evaluated via on-policy interactions with the target environment.…

Machine Learning · Computer Science 2019-11-26 Alex Irpan , Kanishka Rao , Konstantinos Bousmalis , Chris Harris , Julian Ibarz , Sergey Levine

We consider the online stochastic matching problem proposed by Feldman et al. [FMMM09] as a model of display ad allocation. We are given a bipartite graph; one side of the graph corresponds to a fixed set of bins and the other side…

Data Structures and Algorithms · Computer Science 2011-08-03 Vahideh H. Manshadi , Shayan Oveis Gharan , Amin Saberi

We consider off-policy evaluation (OPE) in Partially Observable Markov Decision Processes (POMDPs), where the evaluation policy depends only on observable variables and the behavior policy depends on unobservable latent variables. Existing…

Machine Learning · Computer Science 2022-06-17 Chengchun Shi , Masatoshi Uehara , Jiawei Huang , Nan Jiang

We study the novel problem of future off-policy evaluation (F-OPE) and learning (F-OPL) for estimating and optimizing the future value of policies in non-stationary environments, where distributions vary over time. In e-commerce…

Machine Learning · Computer Science 2025-06-26 Tatsuhiro Shimizu , Kazuki Kawamura , Takanori Muroi , Yusuke Narita , Kei Tateno , Takuma Udagawa , Yuta Saito

In this paper, we deal with the uncertainty of bidding for display advertising. Similar to the financial market trading, real-time bidding (RTB) based display advertising employs an auction mechanism to automate the impression level media…

Computer Science and Game Theory · Computer Science 2017-01-23 Haifeng Zhang , Weinan Zhang , Yifei Rong , Kan Ren , Wenxin Li , Jun Wang

When observed decisions depend only on observed features, off-policy policy evaluation (OPE) methods for sequential decision making problems can estimate the performance of evaluation policies before deploying them. This assumption is…

Machine Learning · Statistics 2020-03-13 Hongseok Namkoong , Ramtin Keramati , Steve Yadlowsky , Emma Brunskill

Off-policy evaluation (OPE) methods aim to estimate the value of a new reinforcement learning (RL) policy prior to deployment. Recent advances have shown that leveraging auxiliary datasets, such as those synthesized by generative models,…

Machine Learning · Computer Science 2025-07-29 Aishwarya Mandyam , Jason Meng , Ge Gao , Jiankai Sun , Mac Schwager , Barbara E. Engelhardt , Emma Brunskill

We consider the off-policy evaluation (OPE) problem in contextual bandits, where the goal is to estimate the value of a target policy using the data collected by a logging policy. Most popular approaches to the OPE are variants of the…

Machine Learning · Statistics 2024-08-20 Sutanoy Dasgupta , Yabo Niu , Kishan Panaganti , Dileep Kalathil , Debdeep Pati , Bani Mallick

The goal of off-policy evaluation (OPE) is to evaluate a new policy using historical data obtained via a behavior policy. However, because the contextual bandit algorithm updates the policy based on past observations, the samples are not…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Yusuke Kaneko

Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes…

Machine Learning · Statistics 2024-07-26 Runpeng Dai , Jianing Wang , Fan Zhou , Shikai Luo , Zhiwei Qin , Chengchun Shi , Hongtu Zhu