English
Related papers

Related papers: Leveraging Offline Data in Linear Latent Contextua…

200 papers

Solving a linear system $Ax=b$ is a fundamental scientific computing primitive for which numerous solvers and preconditioners have been developed. These come with parameters whose optimal values depend on the system being solved and are…

Machine Learning · Computer Science 2024-05-03 Mikhail Khodak , Edmond Chow , Maria-Florina Balcan , Ameet Talwalkar

Sequential learning in a multi-agent resource constrained matching market has received significant interest in the past few years. We study decentralized learning in two-sided matching markets where the demand side (aka players or agents)…

Machine Learning · Computer Science 2025-06-23 Satush Parikh , Soumya Basu , Avishek Ghosh , Abishek Sankararaman

We study the task of online learning in the presence of Massart noise. Instead of assuming that the online adversary chooses an arbitrary sequence of labels, we assume that the context $\mathbf{x}$ is selected adversarially but the label…

Machine Learning · Computer Science 2024-05-22 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

Machine Learning · Computer Science 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low

We consider off-policy selection and learning in contextual bandits, where the learner aims to select or train a reward-maximizing policy using data collected by a fixed behavior policy. Our contribution is two-fold. First, we propose a…

Machine Learning · Computer Science 2025-07-15 J. Jon Ryu , Jeongyeol Kwon , Benjamin Koppe , Kwang-Sung Jun

We initiate the study of learning in contextual bandits with the help of loss predictors. The main question we address is whether one can improve over the minimax regret $\mathcal{O}(\sqrt{T})$ for learning over $T$ rounds, when the total…

Machine Learning · Computer Science 2020-10-16 Chen-Yu Wei , Haipeng Luo , Alekh Agarwal

In this paper, we consider online learning in generalized linear contextual bandits where rewards are not immediately observed. Instead, rewards are available to the decision-maker only after some delay, which is unknown and stochastic. We…

Machine Learning · Computer Science 2020-03-12 Jose Blanchet , Renyuan Xu , Zhengyuan Zhou

The analysis of online least squares estimation is at the heart of many stochastic sequential decision making problems. We employ tools from the self-normalized processes to provide a simple and self-contained proof of a tail bound of a…

Artificial Intelligence · Computer Science 2011-02-15 Yasin Abbasi-Yadkori , David Pal , Csaba Szepesvari

While contextual bandit has a mature theory, effectively leveraging different feedback patterns to enhance the pace of learning remains unclear. Bandits with feedback graphs, which interpolates between the full information and bandit…

Machine Learning · Computer Science 2023-10-30 Mengxiao Zhang , Yuheng Zhang , Olga Vrousgou , Haipeng Luo , Paul Mineiro

We investigate contextual bandits in the presence of side-observations across arms in order to design recommendation algorithms for users connected via social networks. Users in social networks respond to their friends' activity, and hence…

Machine Learning · Computer Science 2020-10-27 Rahul Singh , Fang Liu , Xin Liu , Ness Shroff

Contextual bandits (CB) are online sequential decision-making problems under partial feedback that underpin many adaptive services. There is a growing demand to deploy CB agents directly on-device, under strict constraints on memory,…

Machine Learning · Computer Science 2026-05-14 Marco Angioli , Kevin Johansson , Antonello Rosato , Amy Loutfi , Denis Kleyko

We study the statistical complexity of offline decision-making with function approximation, establishing (near) minimax-optimal rates for stochastic contextual bandits and Markov decision processes. The performance limits are captured by…

Machine Learning · Computer Science 2025-01-14 Thanh Nguyen-Tang , Raman Arora

Contextual bandit algorithms are ubiquitous tools for active sequential experimentation in healthcare and the tech industry. They involve online learning algorithms that adaptively learn policies over time to map observed contexts $X_t$ to…

Methodology · Statistics 2024-08-19 Ian Waudby-Smith , Lili Wu , Aaditya Ramdas , Nikos Karampatziakis , Paul Mineiro

Large language models (LLMs) exhibit diverse response behaviors, costs, and strengths, making it challenging to select the most suitable LLM for a given user query. We study the problem of adaptive multi-LLM selection in an online setting,…

Machine Learning · Computer Science 2025-06-24 Manhin Poon , XiangXiang Dai , Xutong Liu , Fang Kong , John C. S. Lui , Jinhang Zuo

In this paper, we consider the multi-armed bandit problem with high-dimensional features. First, we prove a minimax lower bound, $\mathcal{O}\big((\log d)^{\frac{\alpha+1}{2}}T^{\frac{1-\alpha}{2}}+\log T\big)$, for the cumulative regret,…

Machine Learning · Computer Science 2021-09-27 Ke Li , Yun Yang , Naveen N. Narisetty

We study online learning problems in which a decision maker has to take a sequence of decisions subject to $m$ long-term constraints. The goal of the decision maker is to maximize their total reward, while at the same time achieving small…

Machine Learning · Computer Science 2022-09-16 Matteo Castiglioni , Andrea Celli , Alberto Marchesi , Giulia Romano , Nicola Gatti

A major research direction in contextual bandits is to develop algorithms that are computationally efficient, yet support flexible, general-purpose function approximation. Algorithms based on modeling rewards have shown strong empirical…

Machine Learning · Computer Science 2021-07-14 Dylan J. Foster , Claudio Gentile , Mehryar Mohri , Julian Zimmert

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

Machine Learning · Computer Science 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

In the contextual linear bandit setting, algorithms built on the optimism principle fail to exploit the structure of the problem and have been shown to be asymptotically suboptimal. In this paper, we follow recent approaches of deriving…

Machine Learning · Computer Science 2020-11-23 Andrea Tirinzoni , Matteo Pirotta , Marcello Restelli , Alessandro Lazaric

We study the linear contextual bandit problem in the presence of adversarial corruption, where the interaction between the player and a possibly infinite decision set is contaminated by an adversary that can corrupt the reward up to a…

Machine Learning · Computer Science 2021-10-26 Heyang Zhao , Dongruo Zhou , Quanquan Gu