English
Related papers

Related papers: No-Regret Gaussian Process Optimization of Time-Va…

200 papers

We study linear bandits when the underlying reward function is not linear. Existing work relies on a uniform misspecification parameter $\epsilon$ that measures the sup-norm error of the best linear approximation. This results in an…

Machine Learning · Computer Science 2023-07-21 Chong Liu , Ming Yin , Yu-Xiang Wang

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

We present an approach for satisfying state constraints in systems with nonparametric uncertainty by estimating this uncertainty with a real-time-update Gaussian process (GP) model. Notably, new data is incorporated into the model in real…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Ricardo Gutierrez , Jesse B. Hoagg

Bandit algorithms have been predominantly analyzed in the convex setting with function-value based stationary regret as the performance measure. In this paper, motivated by online reinforcement learning problems, we propose and analyze…

Machine Learning · Statistics 2019-09-12 Abhishek Roy , Krishnakumar Balasubramanian , Saeed Ghadimi , Prasant Mohapatra

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

Machine Learning · Computer Science 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

Learning good interventions in a causal graph can be modelled as a stochastic multi-armed bandit problem with side-information. First, we study this problem when interventions are more expensive than observations and a budget is specified.…

Machine Learning · Computer Science 2020-12-15 Vineet Nair , Vishakha Patil , Gaurav Sinha

Existing online learning algorithms for adversarial Markov Decision Processes achieve ${O}(\sqrt{T})$ regret after $T$ rounds of interactions even if the loss functions are chosen arbitrarily by an adversary, with the caveat that the…

Machine Learning · Computer Science 2023-10-27 Tiancheng Jin , Junyan Liu , Chloé Rouyer , William Chang , Chen-Yu Wei , Haipeng Luo

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

Machine Learning · Statistics 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Andrea Martin , Luca Furieri , Florian Dörfler , John Lygeros , Giancarlo Ferrari-Trecate

This paper develops an online algorithm to solve a time-varying optimization problem with an objective that comprises a known time-varying cost and an unknown function. This problem structure arises in a number of engineering systems and…

Optimization and Control · Mathematics 2021-11-29 Andrea Simonetto , Emiliano Dall'Anese , Julien Monteil , Andrey Bernstein

In this paper, we study a variant of the framework of online learning using expert advice with limited/bandit feedback. We consider each expert as a learning entity, seeking to more accurately reflecting certain real-world applications. In…

Machine Learning · Computer Science 2017-02-21 Adish Singla , Hamed Hassani , Andreas Krause

We study the non-stationary stochastic multiarmed bandit (MAB) problem and propose two generic algorithms, namely, the limited memory deterministic sequencing of exploration and exploitation (LM-DSEE) and the Sliding-Window Upper Confidence…

Machine Learning · Statistics 2018-04-25 Lai Wei , Vaibhav Srivastava

We study sequential decision-making in batched nonparametric contextual bandits, where actions are selected over a finite horizon divided into a small number of batches. Motivated by constraints in domains such as medicine and marketing --…

Machine Learning · Statistics 2025-08-04 Sakshi Arya

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

This work theoretically studies a ubiquitous reinforcement learning policy for controlling the canonical model of continuous-time stochastic linear-quadratic systems. We show that randomized certainty equivalent policy addresses the…

Machine Learning · Computer Science 2022-08-23 Mohamad Kazem Shirani Faradonbeh

Black box optimisation of an unknown function from expensive and noisy evaluations is a ubiquitous problem in machine learning, academic research and industrial production. An abstraction of the problem can be formulated as a kernel based…

Machine Learning · Statistics 2023-02-02 Sattar Vakili , Danyal Ahmed , Alberto Bernacchia , Ciara Pike-Burke

We study the problem of worst case regret in piecewise stationary multi armed bandits. While the minimax theory for stationary bandits is well established, understanding analogous limits in time-varying settings is challenging. Existing…

Machine Learning · Computer Science 2025-11-11 Gal Mendelson , Eyal Tadmor

Bayesian optimization (BO) is a powerful paradigm for optimizing expensive black-box functions. Traditional BO methods typically rely on separate hand-crafted acquisition functions and surrogate models for the underlying function, and often…

Machine Learning · Computer Science 2025-07-10 Fengxue Zhang , Yuxin Chen

We study Gaussian Process Thompson Sampling (GP-TS) for sequential decision-making over compact, continuous action spaces and provide a frequentist regret analysis based on fractional Gaussian process posteriors, without relying on domain…

Statistics Theory · Mathematics 2026-02-17 Somjit Roy , Prateek Jaiswal , Anirban Bhattacharya , Debdeep Pati , Bani K. Mallick

Kernel-based bandit is an extensively studied black-box optimization problem, in which the objective function is assumed to live in a known reproducing kernel Hilbert space. While nearly optimal regret bounds (up to logarithmic factors) are…

Machine Learning · Statistics 2022-06-27 Sattar Vakili