English
Related papers

Related papers: Self-Concordant Analysis of Generalized Linear Ban…

200 papers

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

Machine Learning · Computer Science 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

We study the ranking problem in generalized linear bandits. At each time, the learning agent selects an ordered list of items and observes stochastic outcomes. In recommendation systems, displaying an ordered list of the most attractive…

Machine Learning · Statistics 2024-01-03 Amitis Shidani , George Deligiannidis , Arnaud Doucet

Contextual bandit algorithms suffer from high regret during cold-start, when the learner has insufficient data to distinguish good arms from bad. We propose augmenting Disjoint LinUCB with LLM pseudo-observations: after each round, a large…

Machine Learning · Computer Science 2026-04-17 Maksim Pershin , Ivan Golovanov , Pavel Baltabaev , Natalia Trankova

Many physical systems have underlying safety considerations that require that the strategy deployed ensures the satisfaction of a set of constraints. Further, often we have only partial information on the state of the system. We study the…

Machine Learning · Computer Science 2022-03-30 Jiabin Lin , Xian Yeow Lee , Talukder Jubery , Shana Moothedath , Soumik Sarkar , Baskar Ganapathysubramanian

This study presents two new algorithms for solving linear stochastic bandit problems. The proposed methods use an approach from non-parametric statistics called bootstrapping to create confidence bounds. This is achieved without making any…

Machine Learning · Statistics 2016-05-05 Nandan Sudarsanam , Balaraman Ravindran

In this paper, we consider the problem of stochastic optimization under a bandit feedback model. We generalize the GP-UCB algorithm [Srinivas and al., 2012] to arbitrary kernels and search spaces. To do so, we use a notion of localized…

Machine Learning · Statistics 2015-10-20 Emile Contal , Cédric Malherbe , Nicolas Vayatis

We study the problem of representation learning in stochastic contextual linear bandits. While the primary concern in this domain is usually to find realizable representations (i.e., those that allow predicting the reward function at any…

Machine Learning · Computer Science 2022-10-25 Andrea Tirinzoni , Matteo Papini , Ahmed Touati , Alessandro Lazaric , Matteo Pirotta

Contextual linear bandits is a rich and theoretically important model that has many practical applications. Recently, this setup gained a lot of interest in applications over wireless where communication constraints can be a performance…

Machine Learning · Computer Science 2022-06-10 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Stochastic linear contextual bandit algorithms have substantial applications in practice, such as recommender systems, online advertising, clinical trials, etc. Recent works show that optimal bandit algorithms are vulnerable to adversarial…

Machine Learning · Statistics 2023-01-31 Qin Ding , Cho-Jui Hsieh , James Sharpnack

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

Machine Learning · Computer Science 2024-05-28 Yogev Bar-On , Yishay Mansour

This paper proposes a linear bandit algorithm that is adaptive to environments at two different levels of hierarchy. At the higher level, the proposed algorithm adapts to a variety of types of environments. More precisely, it achieves…

Machine Learning · Computer Science 2023-02-27 Shinji Ito , Kei Takemura

We study continual learning on multiple linear classification tasks by sequentially running gradient descent (GD) for a fixed budget of iterations per task. When all tasks are jointly linearly separable and are presented in a cyclic/random…

Machine Learning · Computer Science 2025-04-29 Hyunji Jung , Hanseul Cho , Chulhee Yun

We introduce data-driven decision-making algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary bandit settings. These settings capture applications such as advertisement allocation, dynamic pricing, and…

Machine Learning · Computer Science 2021-03-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

We study the problem of stochastic contextual bandits in the agnostic setting, where the goal is to compete with the best policy in a given class without assuming realizability or imposing model restrictions on losses or rewards. In this…

Machine Learning · Statistics 2026-04-06 Samuel Girard , Aurelien Bibaut , Arthur Gretton , Nathan Kallus , Houssam Zenati

Contextual bandits are a rich model for sequential decision making given side information, with important applications, e.g., in recommender systems. We propose novel algorithms for contextual bandits harnessing neural networks to…

Machine Learning · Statistics 2022-03-01 Parnian Kassraie , Andreas Krause

We consider the contextual bandit problem where at each time, the agent only has access to a noisy version of the context and the error variance (or an estimator of this variance). This setting is motivated by a wide range of applications…

Machine Learning · Statistics 2024-03-19 Yongyi Guo , Ziping Xu , Susan Murphy

Web-based applications such as chatbots, search engines and news recommendations continue to grow in scale and complexity with the recent surge in the adoption of LLMs. Online model selection has thus garnered increasing attention due to…

Machine Learning · Computer Science 2024-03-13 Yu Xia , Fang Kong , Tong Yu , Liya Guo , Ryan A. Rossi , Sungchul Kim , Shuai Li

Due to the ease of modern data collection, applied statisticians often have access to a large set of covariates that they wish to relate to some observed outcome. Generalized linear models (GLMs) offer a particularly interpretable framework…

Computation · Statistics 2019-05-21 Brian L. Trippe , Jonathan H. Huggins , Raj Agrawal , Tamara Broderick

We study the sequential batch learning problem in linear contextual bandits with finite action sets, where the decision maker is constrained to split incoming individuals into (at most) a fixed number of batches and can only observe…

Machine Learning · Computer Science 2020-04-15 Yanjun Han , Zhengqing Zhou , Zhengyuan Zhou , Jose Blanchet , Peter W. Glynn , Yinyu Ye

We investigate two perturbation approaches to overcome conservatism that optimism based algorithms chronically suffer from in practice. The first approach replaces optimism with a simple randomization when using confidence sets. The second…

Machine Learning · Statistics 2021-10-13 Baekjin Kim , Ambuj Tewari