English
Related papers

Related papers: Bayesian optimization for mixed variables using an…

200 papers

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

This research delves into optimizing mechanism design, with an emphasis on the energy efficiency and the expansive design possibilities of reciprocating mechanisms. It investigates how to efficiently integrate Computer-Aided Design (CAD)…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Abdelmajid Ben Yahya , Santiago Ramos Garces , Nick Van Oosterwyck , Annie Cuyt , Stijn Derammelaere

In computer-aided engineering design, the goal of a designer is to find an optimal design on a given requirement using the numerical simulator in loop with an optimization method. In this design optimization process, a good design…

Machine Learning · Computer Science 2023-03-01 Harsh Vardhan , Peter Volgyesi , Janos Sztipanovits

Inferring viscoelasticity parameters is a key challenge that often leads to non-unique solutions when fitting rheological data. In this context, we propose a machine learning approach that utilizes Bayesian optimization for parameter…

Soft Condensed Matter · Physics 2025-02-27 Isaac Y. Miranda-Valdez , Tero Mäkinen , Juha Koivisto , Mikko J. Alava

Theoretical results show that Bayesian methods can achieve lower bounds on regret for online logistic regression. In practice, however, such techniques may not be feasible especially for very large feature sets. Various approximations that,…

Machine Learning · Computer Science 2021-01-29 Gil I. Shamir , Wojciech Szpankowski

Surrogate-based optimization, nature-inspired metaheuristics, and hybrid combinations have become state of the art in algorithm design for solving real-world optimization problems. Still, it is difficult for practitioners to get an overview…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Jörg Stork , A. E. Eiben , Thomas Bartz-Beielstein

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

Thanks to computing power increase, the certification and the conception of complex systems relies more and more on simulation. To this end, predictive codes are needed, which have generally to be evaluated in a huge number of input points.…

Methodology · Statistics 2017-12-06 Sophie Marque-Pucheu , Guillaume Perrin , Josselin Garnier

Simulation-based problems involving mixed-variable inputs frequently feature domains that are hierarchical, conditional, heterogeneous, or tree-structured. These characteristics pose challenges for data representation, modeling, and…

Machine Learning · Computer Science 2026-01-21 Paul Saves , Edward Hallé-Hannan , Jasper Bussemaker , Youssef Diouane , Nathalie Bartoli

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a…

Optimization and Control · Mathematics 2025-12-08 Ruanui Nicholson , Radoslav Vuchkov , Umberto Villa , Noemi Petra

The increasing availability of structured but high dimensional data has opened new opportunities for optimization. One emerging and promising avenue is the exploration of unsupervised methods for projecting structured high dimensional data…

Machine Learning · Computer Science 2021-01-07 Eero Siivola , Javier Gonzalez , Andrei Paleyes , Aki Vehtari

This paper considers multiple binary hypothesis tests with adaptive allocation of sensing resources from a shared budget over a small number of stages. A Bayesian formulation is provided for the multistage allocation problem of minimizing…

Methodology · Statistics 2014-11-05 Dennis Wei

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges…

Machine Learning · Statistics 2026-05-28 Qin Lu , Konstantinos D. Polyzos , Bingcong Li , Georgios B. Giannakis

In a task where many similar inverse problems must be solved, evaluating costly simulations is impractical. Therefore, replacing the model $y$ with a surrogate model $y_s$ that can be evaluated quickly leads to a significant speedup. The…

Numerical Analysis · Mathematics 2024-05-15 Phillip Semler , Martin Weiser