English
Related papers

Related papers: Logarithmic Smoothing for Pessimistic Off-Policy E…

200 papers

Learning paradigms based purely on offline data as well as those based solely on sequential online learning have been well-studied in the literature. In this paper, we consider combining offline data with online learning, an area less…

Machine Learning · Computer Science 2023-06-16 Shubhada Agrawal , Sandeep Juneja , Karthikeyan Shanmugam , Arun Sai Suggala

Contextual bandit algorithms are essential for solving many real-world interactive machine learning problems. Despite multiple recent successes on statistically and computationally efficient methods, the practical behavior of these…

Machine Learning · Statistics 2021-06-08 Alberto Bietti , Alekh Agarwal , John Langford

We study off-policy learning (OPL) in contextual bandits, which plays a key role in a wide range of real-world applications such as recommendation systems and online advertising. Typical OPL in contextual bandits assumes an unconstrained…

Machine Learning · Computer Science 2026-05-19 Koichi Tanaka , Ren Kishimoto , Bushun Kawagishi , Yusuke Narita , Yasuo Yamamoto , Nobuyuki Shimizu , Yuta Saito

This paper studies the evaluation of policies that recommend an ordered set of items (e.g., a ranking) based on some context---a common scenario in web search, ads, and recommendation. We build on techniques from combinatorial bandits to…

Machine Learning · Computer Science 2017-11-08 Adith Swaminathan , Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudík , John Langford , Damien Jose , Imed Zitouni

This paper studies bandit problems where an agent has access to offline data that might be utilized to potentially improve the estimation of each arm's reward distribution. A major obstacle in this setting is the existence of compound…

Machine Learning · Computer Science 2023-12-21 Wen Huang , Xintao Wu

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

Machine Learning · Statistics 2021-03-26 Min-hwan Oh , Garud Iyengar

Optimizing noisy functions online, when evaluating the objective requires experiments on a deployed system, is a crucial task arising in manufacturing, robotics and many others. Often, constraints on safe inputs are unknown ahead of time,…

Optimization and Control · Mathematics 2023-06-06 Ilnura Usmanova , Yarden As , Maryam Kamgarpour , Andreas Krause

We study contextual bandits in the stochastic i.i.d.\ setting, where a learner observes contexts drawn from an unknown distribution, selects actions from a finite set $A$, and aims to identify an approximately optimal policy from a given…

Machine Learning · Computer Science 2026-05-29 Liad Erez , Fan Chen , Alon Cohen , Tomer Koren , Yishay Mansour , Shay Moran , Alexander Rakhlin

We study a class of adversarial bandit optimization problems in which the loss functions may be non-convex and non-smooth. In each round, the learner observes a loss that consists of an underlying linear component together with an…

Machine Learning · Computer Science 2026-03-30 Zhuoyu Cheng , Kohei Hatano , Eiji Takimoto

Recent advances in Reinforcement Learning from Human Feedback (RLHF) have shown that KL-regularization plays a pivotal role in improving the efficiency of RL fine-tuning for large language models (LLMs). Despite its empirical advantage, the…

Machine Learning · Computer Science 2026-03-12 Heyang Zhao , Chenlu Ye , Wei Xiong , Quanquan Gu , Tong Zhang

A key goal in stochastic contextual linear bandits is to efficiently learn a near-optimal policy. Prior algorithms for this problem learn a policy by strategically sampling actions but naively (passively) sampling contexts from the…

Machine Learning · Computer Science 2026-05-26 Emma Brunskill , Ishani Karmarkar , Zhaoqi Li

We present the first high-probability optimal regret bound for a policy optimization technique applied to the problem of stochastic contextual multi-armed bandit (CMAB) with general offline function approximation. Our algorithm is both…

Machine Learning · Computer Science 2026-02-17 Orin Levy , Yishay Mansour

We study the problem of off-policy evaluation from batched contextual bandit data with multidimensional actions, often termed slates. The problem is common to recommender systems and user-interface optimization, and it is particularly…

Machine Learning · Computer Science 2021-11-04 Nikos Vlassis , Ashok Chandrashekar , Fernando Amat Gil , Nathan Kallus

When learning from a batch of logged bandit feedback, the discrepancy between the policy to be learned and the off-policy training data imposes statistical and computational challenges. Unlike classical supervised learning and online…

Machine Learning · Computer Science 2018-08-02 Yuan Xie , Boyi Liu , Qiang Liu , Zhaoran Wang , Yuan Zhou , Jian Peng

This paper studies offline policy learning, which aims at utilizing observations collected a priori (from either fixed or adaptively evolving behavior policies) to learn an optimal individualized decision rule that achieves the best overall…

Machine Learning · Computer Science 2025-06-06 Ying Jin , Zhimei Ren , Zhuoran Yang , Zhaoran Wang

Off-policy evaluation methods are important in recommendation systems and search engines, where data collected under an existing logging policy is used to estimate the performance of a new proposed policy. A common approach to this problem…

Machine Learning · Computer Science 2023-01-04 Jaron J. R. Lee , David Arbour , Georgios Theocharous

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…

Information Retrieval · Computer Science 2020-08-24 Mawulolo K. Ameko , Miranda L. Beltzer , Lihua Cai , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes

This thesis aims to study some of the mathematical challenges that arise in the analysis of statistical sequential decision-making algorithms for postoperative patients follow-up. Stochastic bandits (multiarmed, contextual) model the…

Machine Learning · Statistics 2024-05-06 Patrick Saux

In this paper we consider the problem of online stochastic optimization of a locally smooth function under bandit feedback. We introduce the high-confidence tree (HCT) algorithm, a novel any-time $\mathcal{X}$-armed bandit algorithm, and…

Machine Learning · Statistics 2014-05-20 Mohammad Gheshlaghi Azar , Alessandro Lazaric , Emma Brunskill

Reinforcement learning addresses the dilemma between exploration to find profitable actions and exploitation to act according to the best observations already made. Bandit problems are one such class of problems in stateless environments…

Machine Learning · Computer Science 2012-02-20 Ananda Narayanan B , Balaraman Ravindran