English
Related papers

Related papers: Gaussian Process Bandit Optimization with Few Batc…

200 papers

We study the linear bandit problem under limited adaptivity, known as the batched linear bandit. While existing approaches can achieve near-optimal regret in theory, they are often computationally prohibitive or underperform in practice. We…

Machine Learning · Statistics 2025-08-12 Sanghoon Yu , Min-hwan Oh

Recent studies have shown that reinforcement learning with KL-regularized objectives can enjoy faster rates of convergence or logarithmic regret, in contrast to the classical $\sqrt{T}$-type regret in the unregularized setting. However, the…

Machine Learning · Computer Science 2026-03-03 Kaixuan Ji , Qingyue Zhao , Heyang Zhao , Qiwei Di , Quanquan Gu

Efficient global optimization is a widely used method for optimizing expensive black-box functions such as tuning hyperparameter, and designing new material, etc. Despite its popularity, less attention has been paid to analyzing the…

Optimization and Control · Mathematics 2022-09-21 Wenjie Xu , Yuning Jiang , Emilio T. Maddalena , Colin N. Jones

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

Machine Learning · Statistics 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

Bandits with knapsacks (BwK) constitute a fundamental model that combines aspects of stochastic integer programming with online learning. Classical algorithms for BwK with a time horizon $T$ achieve a problem-independent regret bound of…

Quantum Physics · Physics 2025-07-08 Yuexin Su , Ziyi Yang , Peiyuan Huang , Tongyang Li , Yinyu Ye

The Greedy algorithm is the simplest heuristic in sequential decision problem that carelessly takes the locally optimal choice at each round, disregarding any advantages of exploring and/or information gathering. Theoretically, it is known…

Machine Learning · Computer Science 2021-01-05 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

We study collaborative learning among distributed clients facilitated by a central server. Each client is interested in maximizing a personalized objective function that is a weighted sum of its local objective and a global objective. Each…

Machine Learning · Statistics 2023-04-18 Sudeep Salgia , Sattar Vakili , Qing Zhao

We propose a novel combinatorial stochastic-greedy bandit (SGB) algorithm for combinatorial multi-armed bandit problems when no extra information other than the joint reward of the selected set of $n$ arms at each time step $t\in [T]$ is…

Machine Learning · Computer Science 2023-12-14 Fares Fourati , Christopher John Quinn , Mohamed-Slim Alouini , Vaneet Aggarwal

Algorithms for hyperparameter optimization abound, all of which work well under different and often unverifiable assumptions. Motivated by the general challenge of sequentially choosing which algorithm to use, we study the more specific…

Machine Learning · Statistics 2016-04-12 Robert Nishihara , David Lopez-Paz , Léon Bottou

We study stochastic multi-armed bandits under simultaneous constraints on space and adaptivity: the learner interacts with the environment in $B$ batches and has only $W$ bits of persistent memory. Prior work shows that each constraint…

Machine Learning · Computer Science 2026-03-31 Ruiyuan Huang , Zicheng Lyu , Xiaoyi Zhu , Zengfeng Huang

We design new differentially private algorithms for the problems of adversarial bandits and bandits with expert advice. For adversarial bandits, we give a simple and efficient conversion of any non-private bandit algorithm to a private…

Machine Learning · Computer Science 2025-05-29 Hilal Asi , Vinod Raman , Kunal Talwar

We revisit combinatorial Thompson sampling (CTS) for semi-bandits with sleeping arms, where arm availability varies over time and actions must satisfy combinatorial constraints, as in wireless mesh routing with fluctuating link…

Machine Learning · Computer Science 2026-05-13 Zhiming Huang , Bingshan Hu , Jianping Pan

Bayesian optimization with Gaussian processes (GP) is commonly used to optimize black-box functions. The Mat\'ern and the Radial Basis Function (RBF) covariance functions are used frequently, but they do not make any assumptions about the…

Machine Learning · Computer Science 2025-06-23 Huy Hoang Nguyen , Han Zhou , Matthew B. Blaschko , Aleksei Tiulpin

We study Gaussian Process Thompson Sampling (GP-TS) for sequential decision-making over compact, continuous action spaces and provide a frequentist regret analysis based on fractional Gaussian process posteriors, without relying on domain…

Statistics Theory · Mathematics 2026-02-17 Somjit Roy , Prateek Jaiswal , Anirban Bhattacharya , Debdeep Pati , Bani K. Mallick

Thompson sampling is one of the most widely used algorithms for many online decision problems, due to its simplicity in implementation and superior empirical performance over other state-of-the-art methods. Despite its popularity and…

Machine Learning · Computer Science 2020-10-02 Tianyuan Jin , Pan Xu , Jieming Shi , Xiaokui Xiao , Quanquan Gu

We propose a simple model selection approach for algorithms in stochastic bandit and reinforcement learning problems. As opposed to prior work that (implicitly) assumes knowledge of the optimal regret, we only require that each base…

Machine Learning · Computer Science 2020-12-25 Aldo Pacchiano , Christoph Dann , Claudio Gentile , Peter Bartlett

In this paper, we propose a constant word (RAM model) algorithm for regret minimisation for both finite and infinite Stochastic Multi-Armed Bandit (MAB) instances. Most of the existing regret minimisation algorithms need to remember the…

Machine Learning · Computer Science 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learning of model…

Machine Learning · Statistics 2021-02-17 Artem Artemev , David R. Burt , Mark van der Wilk

We study the multi-armed bandit problem with adversarially chosen delays in the Best-of-Both-Worlds (BoBW) framework, which aims to achieve near-optimal performance in both stochastic and adversarial environments. While prior work has made…

Machine Learning · Computer Science 2025-10-21 Ofir Schlisselberg , Tal Lancewicki , Peter Auer , Yishay Mansour

Online reinforcement learning in infinite-horizon Markov decision processes (MDPs) remains less theoretically and algorithmically developed than its episodic counterpart, with many algorithms suffering from high ``burn-in'' costs and…

Machine Learning · Computer Science 2026-03-26 Guy Zamir , Matthew Zurek , Yudong Chen