English
Related papers

Related papers: Multi-fidelity error estimation accelerates greedy…

200 papers

Fine-tuning policies learned offline remains a major challenge in application domains. Monotonic performance improvement during \emph{fine-tuning} is often challenging, as agents typically experience performance degradation at the early…

Machine Learning · Computer Science 2025-05-05 Han Wang , Adam White , Martha White

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive…

Data Structures and Algorithms · Computer Science 2016-03-18 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

This work introduces a novel blackbox optimization algorithm for computationally expensive constrained multi-fidelity problems. When applying a direct search method to such problems, the scarcity of feasible points may lead to numerous…

Optimization and Control · Mathematics 2025-04-09 Stéphane Alarie , Charles Audet , Miguel Diago , Sébastien Le Digabel , Xavier Lebeuf

Scientific and engineering problems often involve parametric partial differential equations (PDEs), such as uncertainty quantification, optimizations, and inverse problems. However, solving these PDEs repeatedly can be prohibitively…

Numerical Analysis · Mathematics 2023-07-04 Jun Sur Richard Park , Xueyu Zhu

Online model selection involves selecting a model from a set of candidate models 'on the fly' to perform prediction on a stream of data. The choice of candidate models henceforth has a crucial impact on the performance. Although employing a…

Machine Learning · Computer Science 2024-01-22 Pouya M. Ghari , Yanning Shen

Model Predictive Control (MPC) is typically characterized for being computationally demanding, as it requires solving optimization problems online; a particularly relevant point when considering its implementation in embedded systems. To…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Victor Gracia , Pablo Krupa , Teodoro Alamo , Daniel Limon

We demonstrate that the greedy algorithm for reduction of divisors on metric graphs need not terminate by modeling the Euclidean algorithm in this context. We observe that any infinite reduction has a well defined limit allowing us to treat…

Combinatorics · Mathematics 2015-04-17 Spencer Backman

Multi-fidelity methods combine inexpensive low-fidelity simulations with costly but highfidelity simulations to produce an accurate model of a system of interest at minimal cost. They have proven useful in modeling physical systems and have…

Artificial Intelligence · Computer Science 2014-08-12 Erik J. Schlicht , Ritchie Lee , David H. Wolpert , Mykel J. Kochenderfer , Brendan Tracey

A multi-fidelity (MF) active learning method is presented for design optimization problems characterized by noisy evaluations of the performance metrics. Namely, a generalized MF surrogate model is used for design-space exploration,…

Optimization and Control · Mathematics 2022-07-12 Riccardo Pellegrini , Jeroen Wackers , Riccardo Broglia , Andrea Serani , Michel Visonneau , Matteo Diez

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

Machine Learning · Computer Science 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

We consider a wide class of the discrete optimization problems with interval objective function. We give a generalization of the greedy algorithm for the problems. Using the algorithm, we obtain the set of all possible greedy solutions and…

Data Structures and Algorithms · Computer Science 2020-09-29 Alexander Prolubnikov

Reduced-order models (ROM) are popular in online motion planning due to their simplicity. A good ROM for control captures critical task-relevant aspects of the full dynamics while remaining low dimensional. However, planning within the…

Robotics · Computer Science 2024-04-04 Yu-Ming Chen , Jianshu Hu , Michael Posa

Multi-fidelity machine learning methods address the accuracy-efficiency trade-off by integrating scarce, resource-intensive high-fidelity data with abundant but less accurate low-fidelity data. We propose a practical multi-fidelity strategy…

Machine Learning · Computer Science 2025-03-26 Jiaxiang Yi , Ji Cheng , Miguel A. Bessa

This paper presents an algorithm for the preprocessing of observation data aimed at improving the robustness of orbit determination tools. Two objectives are fulfilled: obtain a refined solution to the initial orbit determination problem…

Numerical Analysis · Mathematics 2023-11-07 Alberto Fossà , Roberto Armellin , Emmanuel Delande , Matteo Losacco , Francesco Sanfedino

Applications of reduced basis method emulators are increasing in low-energy nuclear physics because they enable fast and accurate sampling of high-fidelity calculations, enabling robust uncertainty quantification. In this paper, we develop,…

Nuclear Theory · Physics 2025-08-05 J. M. Maldonado , C. Drischler , R. J. Furnstahl , P. Mlinarić

Model order reduction seeks to approximate large-scale dynamical systems by lower-dimensional reduced models. For linear systems, a small reduced dimension directly translates into low computational cost, ensuring online efficiency. This…

Numerical Analysis · Mathematics 2025-12-17 Björn Liljegren-Sailer

We consider online convex optimization with time-varying stage costs and additional switching costs. Since the switching costs introduce coupling across all stages, multi-step-ahead (long-term) predictions are incorporated to improve the…

Machine Learning · Computer Science 2020-11-26 Yingying Li , Na Li

To provide a novel tool for the investigation of the energy landscape of the Edwards-Anderson spin-glass model we introduce an algorithm that allows an efficient execution of a greedy optimization based on data from a previously performed…

Disordered Systems and Neural Networks · Physics 2023-12-01 Stefan Schnabel , Wolfhard Janke

This study presents an enhanced multi-fidelity Deep Operator Network (DeepONet) framework for efficient spatio-temporal flow field prediction when high-fidelity data is scarce. Key innovations include: a merge network replacing traditional…

Fluid Dynamics · Physics 2025-07-18 Sunwoong Yang , Youngkyu Lee , Namwoo Kang