English
Related papers

Related papers: Improving Computational Cost of Bayesian Optimizat…

200 papers

Closed-loop performance of sequential decision making algorithms, such as model predictive control, depends strongly on the choice of controller parameters. Bayesian optimization allows learning of parameters from closed-loop experiments,…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Sebastian Hirt , Lukas Theiner , Rolf Findeisen

AutoMPC is a Python package that automates and optimizes data-driven model predictive control. However, it can be computationally expensive and unstable when exploring large search spaces using pure Bayesian Optimization (BO). To address…

Robotics · Computer Science 2024-04-02 Baoyu Li , William Edwards , Kris Hauser

In robotics, methods and softwares usually require optimizations of hyperparameters in order to be efficient for specific tasks, for instance industrial bin-picking from homogeneous heaps of different objects. We present a developmental…

Robotics · Computer Science 2020-07-31 Maxime Petit , Emmanuel Dellandrea , Liming Chen

A method is devised for numerically solving a class of finite-horizon optimal control problems subject to cascade linear discrete-time dynamics. It is assumed that the linear state and input inequality constraints, and the quadratic measure…

Optimization and Control · Mathematics 2017-10-13 Michael Cantoni , Farhad Farokhi , Eric C. Kerrigan , Iman Shames

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to efficiently search for the global minimum of a black-box computational model. Gaussian processes have limited applicability in…

Applications · Statistics 2025-12-04 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Open-loop control of laser powder bed fusion (LPBF) additive manufacturing (AM) has enabled the production of complex, high-criticality parts for various industries. This method relies on static parameter sets from extensive experimentation…

Systems and Control · Electrical Eng. & Systems 2024-06-28 Baris Kavas , Efe C. Balta , Michael R. Tucker , Raamadaas Krishnadas , Alisa Rupenyan , John Lygeros , Markus Bambach

The design (shape) of a robot is usually decided before the control is implemented. This might limit how well the design is adapted to a task, as the suitability of the design is given by how well the robot performs in the task, which…

Robotics · Computer Science 2025-09-30 Etor Arza , Frank Veenstra , Tønnes F. Nygaard , Kyrre Glette

In this paper, we present the application of a recently developed algorithm for Bayesian multi-objective optimization to the design of a commercial aircraft environment control system (ECS). In our model, the ECS is composed of two…

Optimization and Control · Mathematics 2016-10-10 Paul Feliot , Yves Le Guennec , Julien Bect , Emmanuel Vazquez

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

Controller tuning is a vital step to ensure the controller delivers its designed performance. DiffTune has been proposed as an automatic tuning method that unrolls the dynamical system and controller into a computational graph and uses…

Robotics · Computer Science 2023-05-16 Sheng Cheng , Lin Song , Minkyung Kim , Shenlong Wang , Naira Hovakimyan

This research delves into optimizing mechanism design, with an emphasis on the energy efficiency and the expansive design possibilities of reciprocating mechanisms. It investigates how to efficiently integrate Computer-Aided Design (CAD)…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Abdelmajid Ben Yahya , Santiago Ramos Garces , Nick Van Oosterwyck , Annie Cuyt , Stijn Derammelaere

Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a…

Machine Learning · Computer Science 2017-03-08 Aaron Klein , Stefan Falkner , Simon Bartels , Philipp Hennig , Frank Hutter

The high simulation cost has been a bottleneck of practical analog/mixed-signal design automation. Many learning-based algorithms require thousands of simulated data points, which is impractical for expensive to simulate circuits. We…

Machine Learning · Computer Science 2023-11-30 Ahmet F. Budak , Keren Zhu , David Z. Pan

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

We present the first general purpose framework for marginal maximum a posteriori estimation of probabilistic program variables. By using a series of code transformations, the evidence of any probabilistic program, and therefore of any…

Machine Learning · Statistics 2017-07-17 Tom Rainforth , Tuan Anh Le , Jan-Willem van de Meent , Michael A. Osborne , Frank Wood

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

Machine Learning · Statistics 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Data-efficiency is crucial for autonomous robots to adapt to new tasks and environments. In this work we focus on robotics problems with a budget of only 10-20 trials. This is a very challenging setting even for data-efficient approaches…

Robotics · Computer Science 2019-07-11 Rika Antonova , Akshara Rai , Tianyu Li , Danica Kragic

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

We propose a framework for the configuration and operation of expensive-to-evaluate advanced manufacturing methods, based on Bayesian optimization. The framework unifies a tailored acquisition function, a parallel acquisition procedure, and…

Machine Learning · Computer Science 2023-01-18 Xavier Guidetti , Alisa Rupenyan , Lutz Fassl , Majid Nabavi , John Lygeros