English
Related papers

Related papers: Event-Triggered Time-Varying Bayesian Optimization

200 papers

Gaussian processes (GP) are one of the most successful frameworks to model uncertainty. However, GP optimization (e.g., GP-UCB) suffers from major scalability issues. Experimental time grows linearly with the number of evaluations, unless…

Machine Learning · Statistics 2020-02-27 Daniele Calandriello , Luigi Carratino , Alessandro Lazaric , Michal Valko , Lorenzo Rosasco

This paper develops an online algorithm to solve a time-varying optimization problem with an objective that comprises a known time-varying cost and an unknown function. This problem structure arises in a number of engineering systems and…

Optimization and Control · Mathematics 2021-11-29 Andrea Simonetto , Emiliano Dall'Anese , Julien Monteil , Andrey Bernstein

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

Machine Learning · Computer Science 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

We propose constrained causal Bayesian optimization (cCBO), an approach for finding interventions in a known causal graph that optimize a target variable under some constraints. cCBO first reduces the search space by exploiting the graph…

Machine Learning · Statistics 2023-06-14 Virginia Aglietti , Alan Malek , Ira Ktena , Silvia Chiappa

The Gaussian process bandit is a problem in which we want to find a maximizer of a black-box function with the minimum number of function evaluations. If the black-box function varies with time, then time-varying Bayesian optimization is a…

Gaussian process upper confidence bound (GP-UCB) is a theoretically established algorithm for Bayesian optimization (BO), where we assume the objective function $f$ follows a GP. One notable drawback of GP-UCB is that the theoretical…

Machine Learning · Computer Science 2025-11-10 Shion Takeno , Yu Inatsu , Masayuki Karasuyama

In order to improve the performance of Bayesian optimisation, we develop a modified Gaussian process upper confidence bound (GP-UCB) acquisition function. This is done by sampling the exploration-exploitation trade-off parameter from a…

Machine Learning · Computer Science 2020-06-09 Julian Berk , Sunil Gupta , Santu Rana , Svetha Venkatesh

In this paper, we consider the Gaussian process (GP) bandit optimization problem in a non-stationary environment. To capture external changes, the black-box function is allowed to be time-varying within a reproducing kernel Hilbert space…

Machine Learning · Computer Science 2022-03-29 Yuntian Deng , Xingyu Zhou , Baekjin Kim , Ambuj Tewari , Abhishek Gupta , Ness Shroff

In this paper, we present an event-triggered distributed optimization approach including a distributed controller to solve a class of distributed time-varying optimization problems (DTOP). The proposed approach is developed within a…

Optimization and Control · Mathematics 2024-10-28 Haojin Li , Xiaodong Cheng , Peter van Heijster , Sitian Qin

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

Machine Learning · Computer Science 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

Classical optimization theory deals with fixed, time-invariant objective functions. However, time-varying optimization has emerged as an important subject for decision-making in dynamic environments. In this work, we study the problem of…

Machine Learning · Computer Science 2025-10-16 Muhammad Faraz Ul Abrar , Nicolò Michelusi , Erik G. Larsson

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

Optimization and Control · Mathematics 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

This paper is devoted to the distributed continuous-time optimization problem with time-varying objective functions and time-varying nonlinear inequality constraints. Different from most studied distributed optimization problems with…

Optimization and Control · Mathematics 2020-09-08 Shan Sun , Wei Ren

Event-triggered control strategy is capable of significantly reducing the number of control task executions without sacrificing control performance. In this paper, we propose a novel learning-based approach towards an event-triggered model…

Optimization and Control · Mathematics 2024-01-02 Yuga Onoue , Kazumune Hashimoto , Akifumi Wachi

This paper considers the distributed bandit convex optimization problem with time-varying inequality constraints over a network of agents, where the goal is to minimize network regret and cumulative constraint violation. Existing…

Optimization and Control · Mathematics 2024-06-21 Kunpeng Zhang , Xinlei Yi , Guanghui Wen , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

Recent work on hyperparameters optimization (HPO) has shown the possibility of training certain hyperparameters together with regular parameters. However, these online HPO algorithms still require running evaluation on a set of validation…

Machine Learning · Computer Science 2021-01-19 Jingkang Wang , Mengye Ren , Ilija Bogunovic , Yuwen Xiong , Raquel Urtasun

Bayesian optimization based on the Gaussian process upper confidence bound (GP-UCB) offers a theoretical guarantee for optimizing black-box functions. In practice, however, black-box functions often involve input uncertainty. To handle such…

Machine Learning · Statistics 2025-07-24 Yu Inatsu

This paper addresses distributed constrained multiobjective resource allocation problems (DCMRAPs) in multi-agent networks, where agents face multiple conflicting local objectives under local and global constraints. By reformulating DCMRAPs…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Tengyang Gong , Zhongguo Li , Yiqiao Xu , Zhengtao Ding

Causal Bayesian Optimization (CBO) is a methodology designed to optimize an outcome variable by leveraging known causal relationships through targeted interventions. Traditional CBO methods require a fully and accurately specified causal…

Machine Learning · Statistics 2025-03-26 Jean Durand , Yashas Annadani , Stefan Bauer , Sonali Parbhoo

Experiments in engineering are typically conducted in controlled environments where parameters can be set to any desired value. This assumes that the same applies in a real-world setting -- an assumption that is often incorrect as many…

Machine Learning · Computer Science 2025-11-18 Mike Diessner , Kevin J. Wilson , Richard D. Whalley