English
Related papers

Related papers: Safe Bayesian Optimization using Interior-Point Me…

200 papers

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with decoupled constraints, in which…

We provide a method to solve optimization problem when objective function is a complex stochastic simulator of an urban transportation system. To reach this goal, a Bayesian optimization framework is introduced. We show how the choice of…

Computation · Statistics 2019-01-15 Laura Schultz , Vadim Sokolov

Bayesian optimization has attracted huge attention from diverse research areas in science and engineering, since it is capable of efficiently finding a global optimum of an expensive-to-evaluate black-box function. In general, a…

Machine Learning · Computer Science 2025-07-29 Jungtaek Kim

Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the…

Machine Learning · Computer Science 2020-06-22 Phuc Luong , Dang Nguyen , Sunil Gupta , Santu Rana , Svetha Venkatesh

An understanding of how input parameter uncertainty in the numerical simulation of physical models leads to simulation output uncertainty is a challenging task. Common methods for quantifying output uncertainty, such as performing a grid or…

Materials Science · Physics 2023-09-25 Samuel G. McCallum , James E. Lerpiniére , Kjeld O. Jensen , Alison B. Walker

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Safe Bayesian optimization (BO) with Gaussian processes is an effective tool for tuning control policies in safety-critical real-world systems, specifically due to its sample efficiency and safety guarantees. However, most safe BO…

Optimization and Control · Mathematics 2025-12-15 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

In this paper we theoretically show that interior-point methods based on self-concordant barriers possess favorable global complexity beyond their standard application area of convex optimization. To do that we propose first- and…

Optimization and Control · Mathematics 2024-04-30 Pavel Dvurechensky , Mathias Staudigl

Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning…

Systems and Control · Electrical Eng. & Systems 2023-06-26 Christopher Koenig , Miks Ozols , Anastasia Makarova , Efe C. Balta , Andreas Krause , Alisa Rupenyan

Bayesian optimisation presents a sample-efficient methodology for global optimisation. Within this framework, a crucial performance-determining subroutine is the maximisation of the acquisition function, a task complicated by the fact that…

Machine Learning · Computer Science 2020-12-18 Antoine Grosnit , Alexander I. Cowen-Rivers , Rasul Tutunov , Ryan-Rhys Griffiths , Jun Wang , Haitham Bou-Ammar

A recurring and important task in control engineering is parameter tuning under constraints, which conceptually amounts to optimization of a blackbox function accessible only through noisy evaluations. For example, in control practice…

Systems and Control · Electrical Eng. & Systems 2025-01-24 Christian Fiedler , Johanna Menn , Sebastian Trimpe

We present a multi-objective Bayesian optimisation algorithm that allows the user to express preference-order constraints on the objectives of the type "objective A is more important than objective B". These preferences are defined based on…

Machine Learning · Computer Science 2019-11-14 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Change point detection becomes more and more important as datasets increase in size, where unsupervised detection algorithms can help users process data. To detect change points, a number of unsupervised algorithms have been developed which…

Numerical Analysis · Mathematics 2021-06-18 Rebecca Gedda , Larisa Beilina , Ruomu Tan

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

Sequential Model-based Bayesian Optimization has been successful-ly applied to several application domains, characterized by complex search spaces, such as Automated Machine Learning and Neural Architecture Search. This paper focuses on…

Systems and Control · Electrical Eng. & Systems 2020-03-10 Antonio Candelieri , Bruno Galuzzi , Ilaria Giordani , Francesco Archetti

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

Machine Learning · Computer Science 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Ensuring safety in industrial control systems usually involves imposing constraints at the design stage of the control algorithm. Enforcing constraints is challenging if the underlying functional form is unknown. The challenge can be…

Optimization and Control · Mathematics 2023-06-09 Marta Zagorowska , Efe C. Balta , Varsha Behrunani , Alisa Rupenyan , John Lygeros

We develop a short-step interior point method to optimize a linear function over a convex body assuming that one only knows a membership oracle for this body. The approach is based on Abernethy and Hazan's sketch of a universal interior…

Optimization and Control · Mathematics 2018-11-20 Riley Badenbroek , Etienne de Klerk