English
Related papers

Related papers: Improving Computational Cost of Bayesian Optimizat…

200 papers

Integrating unmanned aerial vehicles into daily use requires controllers that ensure stable flight, efficient energy use, and reduced noise. Proportional integral derivative controllers remain standard but are highly sensitive to gain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Andrea Vaiuso , Gabriele Immordino , Ludovica Onofri , Giuliano Coppotelli , Marcello Righi

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

Model predictive control (MPC) has been successful in applications involving the control of complex physical systems. This class of controllers leverages the information provided by an approximate model of the system's dynamics to simulate…

Machine Learning · Computer Science 2020-10-09 Rel Guzman , Rafael Oliveira , Fabio Ramos

Fine-tuning pre-trained models for downstream tasks is a widely adopted technique known for its adaptability and reliability across various domains. Despite its conceptual simplicity, fine-tuning entails several troublesome engineering…

Artificial Intelligence · Computer Science 2024-12-30 Chaeyun Jang , Hyungi Lee , Jungtaek Kim , Juho Lee

PID controllers are widely used in control systems because of their simplicity and effectiveness. Although advanced optimization techniques such as Bayesian Optimization and Differential Evolution have been applied to address the challenges…

Robotics · Computer Science 2026-01-07 Zaid Ghazal , Ali Al-Bustami , Khouloud Gaaloul , Jaerock Kwon

Bayesian optimization is a powerful method for automating tuning of compilers. The complex landscape of autotuning provides a myriad of rarely considered structural challenges for black-box optimizers, and the lack of standardized…

Machine Learning · Computer Science 2025-04-09 Jacob O. Tørring , Carl Hvarfner , Luigi Nardi , Magnus Själander

This paper presents a sample-efficient data-driven method to design model predictive control (MPC) for cable-actuated soft robotics using Bayesian optimization. Instead of modeling the complex dynamics of the soft robots, the proposed…

Robotics · Computer Science 2022-10-18 Anuj Pal , Tianyi He , Wenpeng Wei

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

We present a Bayesian optimization (BO) framework for tuning model predictive controllers (MPC) of central heating, ventilation, and air conditioning (HVAC) plants. This approach treats the functional relationship between the closed-loop…

Systems and Control · Electrical Eng. & Systems 2021-04-13 Qiugang Lu , Ranjeet Kumar , Victor M. Zavala

In this paper, we employ Bayesian optimization to concurrently explore the optimal values for both the shape parameter and the radius in the partition of unity interpolation using radial basis functions. Bayesian optimization is a…

Numerical Analysis · Mathematics 2023-11-09 Roberto Cavoretto , Alessandra De Rossi , Sandro Lancellotti , Federico Romaniello

This paper presents an auto-tuning framework for torque-based Nonlinear Model Predictive Control (nMPC), where the MPC serves as a real-time controller for optimal joint torque commands. The MPC parameters, including cost function weights…

Robotics · Computer Science 2025-12-04 Gabriele Fadini , Deepak Ingole , Tong Duy Son , Alisa Rupenyan

Controllers in robotics often consist of expert-designed heuristics, which can be hard to tune in higher dimensions. It is typical to use simulation to learn these parameters, but controllers learned in simulation often don't transfer to…

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

This paper presents a data-driven strategy to streamline the deployment of model-based controllers in legged robotic hardware platforms. Our approach leverages a model-free safe learning algorithm to automate the tuning of control gains,…

Robotics · Computer Science 2023-10-27 Daniel Widmer , Dongho Kang , Bhavya Sukhija , Jonas Hübotter , Andreas Krause , Stelian Coros

In this paper we develop a Bayesian optimization based hyperparameter tuning framework inspired by statistical learning theory for classifiers. We utilize two key facts from PAC learning theory; the generalization bound will be higher for a…

Machine Learning · Computer Science 2019-02-08 Tinu Theckel Joy , Santu Rana , Sunil Gupta , Svetha Venkatesh

Testing controllers in safety-critical systems is vital for ensuring their safety and preventing failures. In this paper, we address the falsification problem within learning-based closed-loop control systems through simulation. This…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

We introduce the Bayesian Compiler Optimization framework (BaCO), a general purpose autotuner for modern compilers targeting CPUs, GPUs, and FPGAs. BaCO provides the flexibility needed to handle the requirements of modern autotuning tasks.…

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

Machine Learning · Computer Science 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

We address the problem of automatically finding the parameters of a statistical machine translation system that maximize BLEU scores while ensuring that decoding speed exceeds a minimum value. We propose the use of Bayesian Optimization to…

Computation and Language · Computer Science 2016-04-19 Daniel Beck , Adrià de Gispert , Gonzalo Iglesias , Aurelien Waite , Bill Byrne

We provide a method to solve optimization problem when objective function is a complex stochastic simulator of an urban transportation system. To reach this goal, a Bayesian optimization framework is introduced. We show how the choice of…

Computation · Statistics 2019-01-15 Laura Schultz , Vadim Sokolov