English
Related papers

Related papers: Online Multi-LLM Selection via Contextual Bandits …

200 papers

Prompting has emerged as the dominant paradigm for adapting large, pre-trained transformer-based models to downstream tasks. The Prompting Decision Transformer (PDT) enables large-scale, multi-task offline Reinforcement Learning (RL)…

Machine Learning · Computer Science 2025-07-21 Finn Rietz , Oleg Smirnov , Sara Karimi , Lele Cao

Prompt engineering has become central to eliciting the capabilities of large language models (LLMs). At its core lies prompt selection -- efficiently identifying the most effective prompts. However, most prior investigations overlook a key…

Machine Learning · Computer Science 2026-05-15 Donghao Li , Chengshuai Shi , Weijuan Ou , Cong Shen , Jing Yang

Motivated by the phenomenon of strategic agents gaming a recommender system to maximize the number of times they are recommended to users, we study a strategic variant of the linear contextual bandit problem, where the arms can…

Machine Learning · Computer Science 2024-09-27 Thomas Kleine Buening , Aadirupa Saha , Christos Dimitrakakis , Haifeng Xu

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for parallel…

Machine Learning · Statistics 2023-02-07 Jeffrey Chan , Aldo Pacchiano , Nilesh Tripuraneni , Yun S. Song , Peter Bartlett , Michael I. Jordan

We study identifying user clusters in contextual multi-armed bandits (MAB). Contextual MAB is an effective tool for many real applications, such as content recommendation and online advertisement. In practice, user dependency plays an…

Machine Learning · Computer Science 2023-03-27 Yikun Ban , Jingrui He

Bandit learning is characterized by the tension between long-term exploration and short-term exploitation. However, as has recently been noted, in settings in which the choices of the learning algorithm correspond to important decisions…

Machine Learning · Computer Science 2018-01-11 Sampath Kannan , Jamie Morgenstern , Aaron Roth , Bo Waggoner , Zhiwei Steven Wu

Reward-biased maximum likelihood estimation (RBMLE) is a classic principle in the adaptive control literature for tackling explore-exploit trade-offs. This paper studies the stochastic contextual bandit problem with general bounded reward…

Machine Learning · Computer Science 2022-05-31 Yu-Heng Hung , Ping-Chun Hsieh

We introduce a Multi-User Contextual Cascading Bandit model, a new combinatorial bandit framework that captures realistic online advertising scenarios where multiple users interact with sequentially displayed items simultaneously. Unlike…

Machine Learning · Computer Science 2025-08-26 Jiho Park , Huiwen Jia

The contextual bandit problem, where agents arrive sequentially with personal contexts and the system adapts its arm allocation decisions accordingly, has recently garnered increasing attention for enabling more personalized outcomes.…

Machine Learning · Computer Science 2025-05-06 Yiting Hu , Lingjie Duan

A major research direction in contextual bandits is to develop algorithms that are computationally efficient, yet support flexible, general-purpose function approximation. Algorithms based on modeling rewards have shown strong empirical…

Machine Learning · Computer Science 2021-07-14 Dylan J. Foster , Claudio Gentile , Mehryar Mohri , Julian Zimmert

Machine Learning (ML) models are increasingly used to support or substitute decision making. In applications where skilled experts are a limited resource, it is crucial to reduce their burden and automate decisions when the performance of…

Machine Learning · Computer Science 2024-10-01 Mirabel Reid , Tom Sühr , Claire Vernade , Samira Samadi

We study the contextual multi-armed bandit problem with a finite context space (a.k.a. subpopulations), where the learner recommends a best action for each context and is evaluated by context-weighted simple regret. Our guarantees are…

Machine Learning · Computer Science 2026-05-20 Mohammad Shahverdikondori , Jalal Etesami , Negar Kiyavash

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

Machine Learning · Computer Science 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

Large language models (LLMs) are prone to generating factually incorrect outputs. Recent work has applied conformal prediction to provide uncertainty estimates and statistical guarantees for the factuality of LLM generations. However,…

Computation and Language · Computer Science 2026-04-16 Aleksandr Rubashevskii , Dzianis Piatrashyn , Preslav Nakov , Maxim Panov

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

Machine Learning · Computer Science 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

Bandit algorithms and Large Language Models (LLMs) have emerged as powerful tools in artificial intelligence, each addressing distinct yet complementary challenges in decision-making and natural language processing. This survey explores the…

Artificial Intelligence · Computer Science 2025-10-01 Djallel Bouneffouf , Raphael Feraud

We study contextual bandits in the presence of a stage-wise constraint when the constraint must be satisfied both with high probability and in expectation. We start with the linear case where both the reward function and the stage-wise…

Machine Learning · Computer Science 2025-08-22 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett

We propose a contextual bandit based model to capture the learning and social welfare goals of a web platform in the presence of myopic users. By using payments to incentivize these agents to explore different items/recommendations, we show…

Machine Learning · Computer Science 2020-01-23 Priyank Agrawal , Theja Tulabandhula

Developing prompt-based methods with Large Language Models (LLMs) requires making numerous decisions, which give rise to a combinatorial search problem over hyper-parameters. This exhaustive evaluation can be time-consuming and costly. In…

Artificial Intelligence · Computer Science 2025-02-28 Jin Peng Zhou , Christian K. Belardi , Ruihan Wu , Travis Zhang , Carla P. Gomes , Wen Sun , Kilian Q. Weinberger

Leveraging offline data is an attractive way to accelerate online sequential decision-making. However, it is crucial to account for latent states in users or environments in the offline data, and latent bandits form a compelling model for…

Machine Learning · Computer Science 2025-09-03 Chinmaya Kausik , Kevin Tan , Ambuj Tewari