English
Related papers

Related papers: Multi-Fidelity Methods for Optimization: A Survey

200 papers

The increasing use of autonomous and semi-autonomous agents in society has made it crucial to validate their safety. However, the complex scenarios in which they are used may make formal verification impossible. To address this challenge,…

Systems and Control · Electrical Eng. & Systems 2023-03-03 Jared J. Beard , Ali Baheri

Reliability-based design optimization (RBDO) provides a rational and sound framework for finding the optimal design while taking uncertainties into ac-count. The main issue in implementing RBDO methods, particularly stochastic simu-lation…

Applications · Statistics 2020-03-03 Wang-Sheng Liu , Sai Hung Cheung

Choices in scientific research and management require balancing multiple, often competing objectives.Multiple-objective optimization (MOO) provides a unifying framework for solving multiple objective problems. Model selection is a critical…

Applications · Statistics 2018-10-26 Perry Williams , William Kendall , Mevin Hooten

This paper presents a novel and lightweight hyperparameter optimization (HPO) method, MOdular FActorial Design (MOFA). MOFA pursues several rounds of HPO, where each round alternates between exploration of hyperparameter space by factorial…

Machine Learning · Computer Science 2021-06-04 Bo Xiong , Yimin Huang , Hanrong Ye , Steffen Staab , Zhenguo Li

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a robotic system, intelligently trading off…

Machine Learning · Computer Science 2018-11-05 Jialin Song , Yuxin Chen , Yisong Yue

Feature-based offline algorithm selection has shown its effectiveness in a wide range of optimization problems, including the black-box optimization problem. An algorithm selection system selects the most promising optimizer from an…

Machine Learning · Computer Science 2024-05-21 Takushi Yoshikawa , Ryoji Tanabe

Black-box model-based optimization (MBO) problems, where the goal is to find a design input that maximizes an unknown objective function, are ubiquitous in a wide range of domains, such as the design of proteins, DNA sequences, aircraft,…

Machine Learning · Computer Science 2022-02-18 Brandon Trabucco , Xinyang Geng , Aviral Kumar , Sergey Levine

In complex real-world settings, optimization is challenged by the presence of diverse models of differing fidelity. In many optimization problems, a single model is treated as the most accurate representation of the underlying system, while…

Machine Learning · Statistics 2026-05-07 Danielle F. Morey , Giulia Pedrielli , Cherry Y. Wakayama , Zelda B. Zabinsky

Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance…

Machine Learning · Computer Science 2022-11-16 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Sebastian Rojas Gonzalez

The objective of this study is to establish a gradient-free topology optimization framework that facilitates more global solution searches to avoid entrapping in undesirable local optima, especially in problems with strong non-linearity.…

Optimization and Control · Mathematics 2025-03-07 Hiroki Kawabe , Kentaro Yaji , Yuichiro Aoki

Efficient Global Optimization (EGO) is the canonical form of Bayesian optimization that has been successfully applied to solve global optimization of expensive-to-evaluate black-box problems. However, EGO struggles to scale with dimension,…

Optimization and Control · Mathematics 2022-04-26 Youssef Diouane , Victor Picheny , Rodolphe Le Riche , Alexandre Scotto Di Perrotolo

Research on new optimization algorithms is often funded based on the motivation that such algorithms might improve the capabilities to deal with real-world and industrially relevant optimization challenges. Besides a huge variety of…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Ramses Sala , Ralf Müller

We consider the problem of generating a time-optimal quadrotor trajectory that attains a set of prescribed waypoints. This problem is challenging since the optimal trajectory is located on the boundary of the set of dynamically feasible…

Robotics · Computer Science 2020-06-05 Gilhyun Ryou , Ezra Tal , Sertac Karaman

Multi-fidelity modeling and learning are important in physical simulation-related applications. It can leverage both low-fidelity and high-fidelity examples for training so as to reduce the cost of data generation while still achieving good…

Machine Learning · Computer Science 2022-10-25 Shibo Li , Zheng Wang , Robert M. Kirby , Shandian Zhe

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

Multi-fidelity models are of great importance due to their capability of fusing information coming from different numerical simulations, surrogates, and sensors. We focus on the approximation of high-dimensional scalar functions with low…

Numerical Analysis · Mathematics 2023-09-13 Francesco Romor , Marco Tezzele , Markus Mrosek , Carsten Othmer , Gianluigi Rozza

The field of portfolio selection is an active research topic, which combines elements and methodologies from various fields, such as optimization, decision analysis, risk management, data science, forecasting, etc. The modeling and…

Portfolio Management · Quantitative Finance 2020-10-28 A. Georgantas

In an era where data-driven decision-making and computational efficiency are paramount, optimization plays a foundational role in advancing fields such as mathematics, computer science, operations research, machine learning, and beyond.…

Numerical Analysis · Mathematics 2025-03-11 Jun Lu

Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple information sources such…

Machine Learning · Computer Science 2026-02-17 Luuk Jacobs , Mohammad Ali Javidian

In model-based optimisation (MBO) we are interested in using machine learning to design candidates that maximise some measure of reward with respect to a black box function called the (ground truth) oracle, which is expensive to compute…

Machine Learning · Statistics 2024-01-17 Christopher Beckham , Alexandre Piche , David Vazquez , Christopher Pal