English
Related papers

Related papers: Multi-objective robust optimization using adaptive…

200 papers

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Variational quantum algorithms are a leading candidate for early applications on noisy intermediate-scale quantum computers. These algorithms depend on a classical optimization outer-loop that minimizes some function of a parameterized…

Decision-making in manufacturing often involves optimizing key process parameters using data collected from simulation experiments. Gaussian processes are widely used to surrogate the underlying system and guide optimization. Uncertainty…

Applications · Statistics 2025-07-30 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

In reliability engineering, conventional surrogate models encounter the "curse of dimensionality" as the number of random variables increases. While the active learning Kriging surrogate approaches with high-dimensional model representation…

Machine Learning · Computer Science 2025-09-10 Wenxiong Li , Hanyu Liao , Suiyin Chen

Creating diverse sets of high quality solutions has become an important problem in recent years. Previous works on diverse solutions problems consider solutions' objective quality and diversity where one is regarded as the optimization goal…

Neural and Evolutionary Computing · Computer Science 2024-01-17 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian…

Robotics · Computer Science 2018-02-13 Ruben Martinez-Cantin

The exploration of novel architectures requires physics-based simulation due to a lack of prior experience to start from, which introduces two specific challenges for optimization algorithms: evaluations become more expensive (in time) and…

Machine Learning · Computer Science 2025-04-14 Jasper Bussemaker , Paul Saves , Nathalie Bartoli , Thierry Lefebvre , Björn Nagel

In early-stage architectural design, optimization algorithms are essential for efficiently exploring large and complex design spaces under tight computational constraints. While prior research has benchmarked various optimization methods,…

Neural and Evolutionary Computing · Computer Science 2025-04-14 Farnaz Nazari , Wei Yan

Offline optimization is an emerging problem in many experimental engineering domains including protein, drug or aircraft design, where online experimentation to collect evaluation data is too expensive or dangerous. To avoid that, one has…

Machine Learning · Computer Science 2024-05-10 Yassine Chemingui , Aryan Deshwal , Trong Nghia Hoang , Janardhan Rao Doppa

The growing uncertainty from renewable power and electricity demand brings significant challenges to unit commitment (UC). While various advanced forecasting and optimization methods have been developed to predict better and address this…

Optimization and Control · Mathematics 2025-09-30 Rui Xie , Yue Chen , Pierre Pinson

Two-stage stochastic programming is a popular framework for optimization under uncertainty, where decision variables are split between first-stage decisions, and second-stage (or recourse) decisions, with the latter being adjusted after…

Optimization and Control · Mathematics 2024-03-19 Antonio Alcántara , Carlos Ruiz , Calvin Tsay

Multi-objective portfolio optimisation is a critical problem researched across various fields of study as it achieves the objective of maximising the expected return while minimising the risk of a given portfolio at the same time. However,…

Machine Learning · Computer Science 2023-04-14 Sonia Bullah , Terence L. van Zyl

Bayesian optimisation (BO) has been widely used to solve problems with expensive function evaluations. In multi-objective optimisation problems, BO aims to find a set of approximated Pareto optimal solutions. There are typically two ways to…

Machine Learning · Computer Science 2022-08-16 Tinkle Chugh

Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the budget of evaluations. In many applications, historical data from related optimization tasks is…

Machine Learning · Computer Science 2026-05-12 Leonard Papenmeier , Petru Tighineanu

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez

Within the framework of complex system design, it is often necessary to solve mixed variable optimization problems, in which the objective and constraint functions can depend simultaneously on continuous and discrete variables.…

Optimization and Control · Mathematics 2020-03-10 Julien Pelamatti , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

The challenge of noisy multi-objective optimization lies in the constant trade-off between exploring new decision points and improving the precision of known points through resampling. This decision should take into account both the…

Machine Learning · Computer Science 2025-04-25 Timo Budszuhn , Mark Joachim Krallmann , Daniel Horn

Variational quantum algorithms are a class of techniques intended to be used on near-term quantum computers. The goal of these algorithms is to perform large quantum computations by breaking the problem down into a large number of shallow…

Quantum Physics · Physics 2023-03-24 Ryan Shaffer , Lucas Kocia , Mohan Sarovar

The optimization of algorithm (hyper-)parameters is crucial for achieving peak performance across a wide range of domains, ranging from deep neural networks to solvers for hard combinatorial problems. The resulting algorithm configuration…

Artificial Intelligence · Computer Science 2017-03-31 Katharina Eggensperger , Marius Lindauer , Holger H. Hoos , Frank Hutter , Kevin Leyton-Brown

Structural reliability methods aim at computing the probability of failure of systems with respect to some prescribed performance functions. In modern engineering such functions usually resort to running an expensive-to-evaluate…

Methodology · Statistics 2011-05-10 V. Dubourg , F. Deheeger , B. Sudret