English
Related papers

Related papers: Learning When to Trust in Contextual Bandits

200 papers

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

Machine Learning · Computer Science 2021-10-05 Chuanhao Li , Hongning Wang

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

Machine Learning · Computer Science 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

Recent work introduced the model of learning from discriminative feature feedback, in which a human annotator not only provides labels of instances, but also identifies discriminative features that highlight important differences between…

Machine Learning · Computer Science 2021-05-25 Sanjoy Dasgupta , Sivan Sabato

Contextual bandit algorithms have transformed modern experimentation by enabling real-time adaptation for personalized treatment and efficient use of data. Yet these advantages create challenges for statistical inference due to adaptivity.…

Statistics Theory · Mathematics 2025-09-23 Yongyi Guo , Ziping Xu

We investigate the feasibility of learning from a mix of both fully-labeled supervised data and contextual bandit data. We specifically consider settings in which the underlying learning signal may be different between these two data…

Machine Learning · Computer Science 2019-06-25 Chicheng Zhang , Alekh Agarwal , Hal Daumé , John Langford , Sahand N Negahban

We study budget-constrained contextual bandits with adversarial contexts, where each action yields a random reward and incurs a random cost. We adopt the standard realizability assumption: conditioned on the observed context, rewards and…

Machine Learning · Computer Science 2026-05-08 Dhruv Sarkar , Abhishek Sinha

We consider the problem of contextual bandits with stochastic experts, which is a variation of the traditional stochastic contextual bandit with experts problem. In our problem setting, we assume access to a class of stochastic experts,…

Machine Learning · Statistics 2021-03-04 Rajat Sen , Karthikeyan Shanmugam , Nihal Sharma , Sanjay Shakkottai

We consider the contextual bandit problem on general action and context spaces, where the learner's rewards depend on their selected actions and an observable context. This generalizes the standard multi-armed bandit to the case where side…

Machine Learning · Statistics 2023-01-03 Moise Blanchard , Steve Hanneke , Patrick Jaillet

We consider a novel variant of the contextual bandit problem (i.e., the multi-armed bandit with side-information, or context, available to a decision-maker) where the context used at each decision may be corrupted ("useless context"). This…

Machine Learning · Computer Science 2020-06-30 Djallel Bouneffouf

Contextual bandit algorithms provide principled online learning solutions to balance the exploitation-exploration trade-off in various applications such as recommender systems. However, the learning speed of the traditional contextual…

Machine Learning · Computer Science 2020-01-28 Xiaoying Zhang , Hong Xie , Hang Li , John C. S. Lui

Stochastic linear contextual bandit algorithms have substantial applications in practice, such as recommender systems, online advertising, clinical trials, etc. Recent works show that optimal bandit algorithms are vulnerable to adversarial…

Machine Learning · Statistics 2023-01-31 Qin Ding , Cho-Jui Hsieh , James Sharpnack

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

Large language models are able to learn new tasks in context, where they are provided with instructions and a few annotated examples. However, the effectiveness of in-context learning is dependent on the provided context, and the…

Computation and Language · Computer Science 2023-12-25 Afra Amini , Massimiliano Ciaramita

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

This position paper argues that effective tutoring requires corrective friction: surfacing misconceptions and challenging them supportively to drive conceptual change. Yet preference-aligned LLMs can trade epistemic rigor for agreeableness.…

Artificial Intelligence · Computer Science 2026-05-15 Enkelejda Kasneci , Gjergji Kasneci

Contextual bandits serve as a fundamental model for many sequential decision making tasks. The most popular theoretically justified approaches are based on the optimism principle. While these algorithms can be practical, they are known to…

Machine Learning · Computer Science 2020-03-17 Botao Hao , Tor Lattimore , Csaba Szepesvari

Preference-based feedback is important for many applications where direct evaluation of a reward function is not feasible. A notable recent example arises in reinforcement learning from human feedback on large language models. For many of…

Machine Learning · Computer Science 2023-07-24 Viraj Mehta , Ojash Neopane , Vikramjeet Das , Sen Lin , Jeff Schneider , Willie Neiswanger

Standard contextual bandit problem assumes that all the relevant contexts are observed before the algorithm chooses an arm. This modeling paradigm, while useful, often falls short when dealing with problems in which valuable additional…

Machine Learning · Computer Science 2023-09-26 Chaoqi Wang , Ziyu Ye , Zhe Feng , Ashwinkumar Badanidiyuru , Haifeng Xu

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

Machine Learning · Computer Science 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

In recent years, preference-based human feedback mechanisms have become essential for enhancing model performance across diverse applications, including conversational AI systems such as ChatGPT. However, existing approaches often neglect…

Artificial Intelligence · Computer Science 2025-02-14 Raihan Seraj , Lili Meng , Tristan Sylvain