English
Related papers

Related papers: Data-efficient Auto-tuning with Bayesian Optimizat…

200 papers

Recent work has shown constrained Bayesian optimization to be a powerful technique for the optimization of industrial processes. In complex manufacturing processes, the possibility to run extensive sequences of experiments with the goal of…

Systems and Control · Electrical Eng. & Systems 2022-05-12 Xavier Guidetti , Alisa Rupenyan , Lutz Fassl , Majid Nabavi , John Lygeros

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

We introduce a means of automating machine learning (ML) for big data tasks, by performing scalable stochastic Bayesian optimisation of ML algorithm parameters and hyper-parameters. More often than not, the critical tuning of ML algorithm…

Machine Learning · Statistics 2014-07-31 Thomas Nickson , Michael A Osborne , Steven Reece , Stephen J Roberts

Real-world robots are becoming increasingly complex and commonly act in poorly understood environments where it is extremely challenging to model or learn their true dynamics. Therefore, it might be desirable to take a task-specific…

Systems and Control · Computer Science 2017-09-25 Somil Bansal , Roberto Calandra , Ted Xiao , Sergey Levine , Claire J. Tomlin

Bayesian optimization has become widely popular across various experimental sciences due to its favorable attributes: it can handle noisy data, perform well with relatively small datasets, and provide adaptive suggestions for sequential…

Other Quantitative Biology · Quantitative Biology 2025-08-15 Maximilian Siska , Emma Pajak , Katrin Rosenthal , Antonio del Rio Chanona , Eric von Lieres , Laura Marie Helleckes

Control system optimization has long been a fundamental challenge in robotics. While recent advancements have led to the development of control algorithms that leverage learning-based approaches, such as SafeOpt, to optimize single feedback…

Robotics · Computer Science 2024-11-13 Lihao Zheng , Hongxuan Wang , Xiaocong Li , Jun Ma , Prahlad Vadakkepat

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

Machine Learning · Computer Science 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

Parameter tuning in real-world experiments is constrained by the limited evaluation budget available on hardware. The path-following controller studied in this paper reflects a typical situation in nonlinear geometric controller, where…

Robotics · Computer Science 2026-05-28 Zhewen Zheng , Wenjing Cao , Hongkang Yu , Mo Chen , Takashi Suzuki

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

Machine Learning · Computer Science 2018-12-10 Xueqiang Zeng , Gang Luo

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning…

Systems and Control · Electrical Eng. & Systems 2023-06-26 Christopher Koenig , Miks Ozols , Anastasia Makarova , Efe C. Balta , Andreas Krause , Alisa Rupenyan

Decarbonization of the transport sector sets increasingly strict demands to maximize thermal efficiency and minimize greenhouse gas emissions of Internal Combustion Engines. This has led to complex engines with a surge in the number of…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Maarten Vlaswinkel , Duarte Antunes , Frank Willems

This paper tackles the multi-objective optimization of the cost functional of a path-following model predictive control for vehicle longitudinal and lateral control. While the inherent optimal character of the model predictive control and…

Robotics · Computer Science 2021-04-09 Ali Gharib , David Stenger , Robert Ritschel , Rick Voßwinkel

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

This paper derives an optimal control strategy for a simple stochastic dynamical system with constant drift and an additive control input. Motivated by the example of a physical system with an unexpected change in its dynamics, we take the…

Optimization and Control · Mathematics 2022-02-09 Daniel Gurevich , Debdipta Goswami , Charles L. Fefferman , Clarence W. Rowley

Identifying and calibrating quantitative dynamical models for physical quantum systems is important for a variety of applications. Here we present a closed-loop Bayesian learning algorithm for estimating multiple unknown parameters in a…

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combining it with evidence…

Machine Learning · Computer Science 2010-12-14 Eric Brochu , Vlad M. Cora , Nando de Freitas

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee