English
Related papers

Related papers: Worst-Case Learning under a Multi-fidelity Model

200 papers

Testing controllers in safety-critical systems is vital for ensuring their safety and preventing failures. In this paper, we address the falsification problem within learning-based closed-loop control systems through simulation. This…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

The performance of machine learning surrogates is critically dependent on data quality and quantity. This presents a major challenge, as high-fidelity (HF) data is often scarce and computationally expensive to acquire, while low-fidelity…

Machine Learning · Computer Science 2026-02-03 Jice Zeng , David Barajas-Solano , Hui Chen

In high-stakes engineering applications, optimization algorithms must come with provable worst-case guarantees over a mathematically defined class of problems. Designing for the worst case, however, inevitably sacrifices performance on the…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Andrea Martin , Ian R. Manchester , Luca Furieri

When attempting to recover functions from observational data, one naturally seeks to do so in an optimal manner with respect to some modeling assumption. With a focus put on the worst-case setting, this is the standard goal of Optimal…

Optimization and Control · Mathematics 2020-04-02 Mahmood Ettehad , Simon Foucart

Recent work in unsupervised representation learning has focused on learning deep directed latent-variable models. Fitting these models by maximizing the marginal likelihood or evidence is typically intractable, thus a common approximation…

Machine Learning · Computer Science 2018-02-15 Alexander A. Alemi , Ben Poole , Ian Fischer , Joshua V. Dillon , Rif A. Saurous , Kevin Murphy

Generative models at times produce "invalid" outputs, such as images with generation artifacts and unnatural sounds. Validity-constrained distribution learning attempts to address this problem by requiring that the learned distribution have…

Machine Learning · Computer Science 2024-10-22 Nick Rittler , Kamalika Chaudhuri

This paper deals with surrogate modelling of a computer code output in a hierarchical multi-fidelity context, i.e., when the output can be evaluated at different levels of accuracy and computational cost. Using observations of the output at…

Statistics Theory · Mathematics 2023-12-06 Baptiste Kerleguer , Claire Cannamela , Josselin Garnier

Aerodynamic shape optimization in industry still faces challenges related to robustness and scalability. This aspect becomes crucial for advanced optimizations that rely on expensive high-fidelity flow solvers, where computational budget…

Fluid Dynamics · Physics 2025-05-26 Marc Schouler , Anca Belme , Paola Cinnella

In a multifidelity setting, data are available under the same conditions from two (or more) sources, e.g. computer codes, one being lower-fidelity but computationally cheaper, and the other higher-fidelity and more expensive. This work…

Methodology · Statistics 2024-09-25 Minji Kim , Kevin O'Connor , Vladas Pipiras , Themistoklis Sapsis

Hyperparameter tuning is an omnipresent problem in machine learning as it is an integral aspect of obtaining the state-of-the-art performance for any model. Most often, hyperparameters are optimized just by training a model on a grid of…

Machine Learning · Computer Science 2019-06-28 Hadi S. Jomaa , Josif Grabocka , Lars Schmidt-Thieme

Linear fixed point equations in Hilbert spaces arise in a variety of settings, including reinforcement learning, and computational methods for solving differential and integral equations. We study methods that use a collection of random…

Machine Learning · Computer Science 2020-12-11 Wenlong Mou , Ashwin Pananjady , Martin J. Wainwright

In many applications, ranging from logistics to engineering, a designer is faced with a sequence of optimization tasks for which the objectives are in the form of black-box functions that are costly to evaluate. Furthermore, higher-fidelity…

Machine Learning · Computer Science 2025-01-09 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

We develop a new and general encode-approximate-reconstruct operator learning model that leverages learned neural representations of bases for input and output function distributions. We introduce the concepts of \textit{numerical operator…

Machine Learning · Computer Science 2025-07-11 Jacob Hauck , Yanzhi Zhang

A multi-fidelity regression model is proposed for combining multiple datasets with different fidelities, particularly abundant low-fidelity data and scarce high-fidelity observations. The model builds upon recent multi-fidelity frameworks…

Fluid Dynamics · Physics 2023-11-21 Mohammad Hossein Saadat

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby

A multi-fidelity (MF) active learning method is presented for design optimization problems characterized by noisy evaluations of the performance metrics. Namely, a generalized MF surrogate model is used for design-space exploration,…

Optimization and Control · Mathematics 2022-07-12 Riccardo Pellegrini , Jeroen Wackers , Riccardo Broglia , Andrea Serani , Michel Visonneau , Matteo Diez

A multi-fidelity simulator is a numerical model, in which one of the inputs controls a trade-off between the realism and the computational cost of the simulation. Our goal is to estimate the probability of exceeding a given threshold on a…

Methodology · Statistics 2021-03-31 Rémi Stroh , Julien Bect , Séverine Demeyer , Nicolas Fischer , Emmanuel Vazquez

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distribution, and Monte Carlo sampling…

Numerical Analysis · Mathematics 2022-09-22 S. Ashwin Renganathan , Vishwas Rao , Ionel M. Navon

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

Supervised machine learning describes the practice of fitting a parameterized model to labeled input-output data. Supervised machine learning methods have demonstrated promise in learning efficient surrogate models that can (partially)…

Machine Learning · Statistics 2026-03-24 Atticus Rex , Elizabeth Qian , David Peterson