English
Related papers

Related papers: Rectified Pessimistic-Optimistic Learning for Stoc…

200 papers

We consider combinatorial semi-bandits over a set of arms ${\cal X} \subset \{0,1\}^d$ where rewards are uncorrelated across items. For this problem, the algorithm ESCB yields the smallest known regret bound $R(T) = {\cal O}\Big( {d (\ln…

Machine Learning · Statistics 2021-01-14 Thibaut Cuvelier , Richard Combes , Eric Gourdin

Bandit Convex Optimization is a fundamental class of sequential decision-making problems, where the learner selects actions from a continuous domain and observes a loss (but not its gradient) at only one point per round. We study this…

Machine Learning · Statistics 2025-12-02 Xiaoqi Liu , Dorian Baudry , Julian Zimmert , Patrick Rebeschini , Arya Akhavan

We study contextual bandits with budget and time constraints, referred to as constrained contextual bandits.The time and budget constraints significantly complicate the exploration and exploitation tradeoff because they introduce complex…

Machine Learning · Computer Science 2015-10-20 Huasen Wu , R. Srikant , Xin Liu , Chong Jiang

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Safe Reinforcement Learning (Safe RL) aims to train an RL agent to maximize its performance in real-world environments while adhering to safety constraints, as exceeding safety violation limits can result in severe consequences. In this…

Machine Learning · Computer Science 2025-04-07 Hanping Zhang , Yuhong Guo

Canonical algorithms for multi-armed bandits typically assume a stationary reward environment where the size of the action space (number of arms) is small. More recently developed methods typically relax only one of these assumptions:…

Machine Learning · Computer Science 2025-06-02 Derek Everett , Fred Lu , Edward Raff , Fernando Camacho , James Holt

In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose $p$-th moment is bounded by a constant $\nu_{p}$ for $1<p\leq2$. First, we propose a novel robust estimator which does not require $\nu_{p}$…

Machine Learning · Computer Science 2021-10-28 Kyungjae Lee , Hongjun Yang , Sungbin Lim , Songhwai Oh

In the stochastic knapsack problem, we are given a knapsack of size B, and a set of jobs whose sizes and rewards are drawn from a known probability distribution. However, we know the actual size and reward only when the job completes. How…

Data Structures and Algorithms · Computer Science 2011-02-21 Anupam Gupta , Ravishankar Krishnaswamy , Marco Molinaro , R. Ravi

We introduce a sequential learning algorithm to address a robust controller tuning problem, which in effect, finds (with high probability) a candidate solution satisfying the internal performance constraint to a chance-constrained program…

Optimization and Control · Mathematics 2021-10-19 Robert Chin , Chris Manzie , Iman Shames , Dragan Nešić , Jonathan E. Rowe

Constrained optimization with multiple functional inequality constraints has significant applications in machine learning. This paper examines a crucial subset of such problems where both the objective and constraint functions are weakly…

Machine Learning · Computer Science 2026-02-09 Ming Yang , Gang Li , Quanqi Hu , Qihang Lin , Tianbao Yang

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

Several optimism-based stochastic bandit algorithms -- including UCB, UCB-V, linear UCB, and finite-arm GP-UCB -- achieve logarithmic regret using proofs that, despite superficial differences, follow essentially the same structure. This…

Machine Learning · Computer Science 2025-12-23 Vikram Krishnamurthy

Reinforcement Learning (RL) is a widely researched area in artificial intelligence that focuses on teaching agents decision-making through interactions with their environment. A key subset includes stochastic multi-armed bandit (MAB) and…

Machine Learning · Statistics 2025-02-20 Pengjie Zhou , Haoyu Wei , Huiming Zhang

We consider the contextual bandit problem on general action and context spaces, where the learner's rewards depend on their selected actions and an observable context. This generalizes the standard multi-armed bandit to the case where side…

Machine Learning · Statistics 2023-01-03 Moise Blanchard , Steve Hanneke , Patrick Jaillet

Reinforcement Learning (RL) has achieved tremendous success in recent years. However, the classical foundations of RL do not account for the risk sensitivity of the objective function, which is critical in various fields, including…

Machine Learning · Computer Science 2025-11-14 Mohammad Alipour-Vaezi , Huaiyang Zhong , Kwok-Leung Tsui , Sajad Khodadadian

Combinatorial online learning is a fundamental task for selecting the optimal action (or super arm) as a combination of base arms in sequential interactions with systems providing stochastic rewards. It is applicable to diverse domains such…

Machine Learning · Computer Science 2026-03-04 Seockbean Song , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

Many sequential decision-making problems in communication networks can be modeled as contextual bandit problems, which are natural extensions of the well-known multi-armed bandit problem. In contextual bandit problems, at each time, an…

Machine Learning · Computer Science 2016-05-10 Pranav Sakulkar , Bhaskar Krishnamachari

Designing efficient general-purpose contextual bandit algorithms that work with large -- or even continuous -- action spaces would facilitate application to important scenarios such as information retrieval, recommendation systems, and…

Machine Learning · Computer Science 2022-07-14 Yinglun Zhu , Paul Mineiro

Policy regret is a well established notion of measuring the performance of an online learning algorithm against an adaptive adversary. We study restrictions on the adversary that enable efficient minimization of the \emph{complete policy…

Machine Learning · Statistics 2022-04-26 Dhruv Malik , Yuanzhi Li , Aarti Singh

Contextual batched bandit (CBB) is a setting where a batch of rewards is observed from the environment at the end of each episode, but the rewards of the non-executed actions are unobserved, resulting in partial-information feedback.…

Machine Learning · Computer Science 2023-10-10 Xiao Zhang , Ninglu Shao , Zihua Si , Jun Xu , Wenhan Wang , Hanjing Su , Ji-Rong Wen