English
Related papers

Related papers: CMA-ES for Safe Optimization

200 papers

Safe Bayesian optimization (BO) algorithms promise to find optimal control policies without knowing the system dynamics while at the same time guaranteeing safety with high probability. In exchange for those guarantees, popular algorithms…

Machine Learning · Computer Science 2025-10-22 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

This paper addresses the integration of additional information sources into a Bayesian optimization framework while ensuring that safety constraints are satisfied. The interdependencies between these information sources are modeled using an…

Machine Learning · Computer Science 2025-05-06 Jannis O. Luebsen , Annika Eichler

This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

We address the robot grasp optimization problem of unknown objects considering uncertainty in the input space. Grasping unknown objects can be achieved by using a trial and error exploration strategy. Bayesian optimization is a sample…

Robotics · Computer Science 2016-03-08 José Nogueira , Ruben Martinez-Cantin , Alexandre Bernardino , Lorenzo Jamone

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

In this paper, the problem of safe global maximization (it should not be confused with robust optimization) of expensive noisy black-box functions satisfying the Lipschitz condition is considered. The notion "safe" means that the objective…

Optimization and Control · Mathematics 2020-08-18 Yaroslav D. Sergeyev , Antonio Candelieri , Dmitri E. Kvasov , Riccardo Perego

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

Machine Learning · Statistics 2018-07-10 Peter I. Frazier

Optimization problems in real-world applications across the medical and engineering domains often involve potential risks when evaluating candidate solutions. Safe optimization aims to perform optimization while suppressing unsafe solution…

Neural and Evolutionary Computing · Computer Science 2026-05-19 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shinichi Shirakawa

This paper considers the problem of Bayesian optimization for systems with safety-critical constraints, where both the objective function and the constraints are unknown, but can be observed by querying the system. In safety-critical…

Optimization and Control · Mathematics 2022-05-06 Dinesh Krishnamoorthy , Francis J. Doyle

We propose a novel holistic approach for safe autonomous exploration and map building based on constrained Bayesian optimisation. This method finds optimal continuous paths instead of discrete sensing locations that inherently satisfy…

Robotics · Computer Science 2017-03-02 Gilad Francis , Lionel Ott , Roman Marchant , Fabio Ramos

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Masahiro Nomura , Youhei Akimoto , Isao Ono

One of the most challenging types of ill-posedness in global optimization is the presence of insensitivity regions in design parameter space, so the identification of their shape will be crucial, if ill-posedness is irrecoverable. Such…

Neural and Evolutionary Computing · Computer Science 2019-05-20 Jakub Sawicki , Maciej Smołka , Marcin Łoś , Robert Schaefer

Optimum implementation of non-conventional wells allows us to increase considerably hydrocarbon recovery. By considering the high drilling cost and the potential improvement in well productivity, well placement decision is an important…

Computational Engineering, Finance, and Science · Computer Science 2010-11-25 Zyed Bouzarkouna , Didier Yu Ding , Anne Auger

Black-box optimization problems often require simultaneously optimizing different types of variables, such as continuous, integer, and categorical variables. Unlike integer variables, categorical variables do not necessarily have a…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Ryoki Hamano , Shota Saito , Masahiro Nomura , Kento Uchida , Shinichi Shirakawa

Exploration-exploitation of functions, that is learning and optimizing a mapping between inputs and expected outputs, is ubiquitous to many real world situations. These situations sometimes require us to avoid certain outcomes at all cost,…

Applications · Statistics 2016-05-17 Eric Schulz , Quentin J. M. Huys , Dominik R. Bach , Maarten Speekenbrink , Andreas Krause

Rather than obtaining a single good solution for a given optimization problem, users often seek alternative design choices, because the best-found solution may perform poorly with respect to additional objectives or constraints that are…

Neural and Evolutionary Computing · Computer Science 2025-08-06 Maria Laura Santoni , Christoph Dürr , Carola Doerr , Mike Preuss , Elena Raponi

Simulation-based falsification is a practical testing method to increase confidence that the system will meet safety requirements. Because full-fidelity simulations can be computationally demanding, we investigate the use of simulators with…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

This paper addresses the problem of safe optimization under a single smooth constraint, a scenario that arises in diverse real-world applications such as robotics and autonomous navigation. The objective of safe optimization is to solve a…

Optimization and Control · Mathematics 2025-05-15 Ilnura Usmanova , Kfir Yehuda Levy

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

Neural and Evolutionary Computing · Computer Science 2016-04-26 Ilya Loshchilov , Frank Hutter