English
Related papers

Related papers: Goal-oriented adaptive surrogate construction for …

200 papers

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

The general problem of characterizing gas source parameters based on concentration measurements is known to be a difficult task. As many inverse problems, one of the main obstacles for accurate estimation is the non-uniqueness of solution,…

Computational Physics · Physics 2023-06-22 Omri Buchman , Eyal Fattal

Delayed primary outcomes and administratively censored follow-up create a general semiparametric estimation problem: the target causal functional depends on an endpoint observed only for a shrinking subset of units at analysis time, while…

Methodology · Statistics 2026-04-02 Lin Li , Tuo Lin , Yiwen Chen , Xin M. Tu

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

In this work we provide a theoretical framework for structured prediction that generalizes the existing theory of surrogate methods for binary and multiclass classification based on estimating conditional probabilities with smooth convex…

Machine Learning · Computer Science 2019-02-14 Alex Nowak-Vila , Francis Bach , Alessandro Rudi

Gaussian processes (GPs) are a Bayesian machine learning approach widely used to construct surrogate models for the uncertainty quantification of computer simulation codes in industrial applications. It provides both a mean predictor and an…

Surrogate models driven by sizeable datasets and scientific machine-learning methods have emerged as an attractive microstructure simulation tool with the potential to deliver predictive microstructure evolution dynamics with huge savings…

Materials Science · Physics 2024-01-22 Shaoxun Fan , Andrew L. Hitt , Ming Tang , Babak Sadigh , Fei Zhou

We are interested in building low-dimensional surrogate models to reduce optimization costs, while having theoretical guarantees that the optimum will satisfy the constraints of the full-size model, by making conservative approximations.…

Numerical Analysis · Mathematics 2025-11-12 Philippe-André Luneau

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

The paper presents a new efficient and robust method for rare event probability estimation for computational models of an engineering product or a process returning categorical information only, for example, either success or failure. For…

Computational Engineering, Finance, and Science · Computer Science 2022-10-11 Miroslav Vořechovský

Many problems in computer vision have recently been tackled using models whose predictions cannot be easily interpreted, most commonly deep neural networks. Surrogate explainers are a popular post-hoc interpretability method to further…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ricardo Kleinlein , Alexander Hepburn , Raúl Santos-Rodríguez , Fernando Fernández-Martínez

Offline design optimization problem arises in numerous science and engineering applications including material and chemical design, where expensive online experimentation necessitates the use of in silico surrogate functions to predict and…

Machine Learning · Computer Science 2025-03-05 Minh Hoang , Azza Fadhel , Aryan Deshwal , Janardhan Rao Doppa , Trong Nghia Hoang

Bayesian formulations of inverse problems are attractive for their ability to incorporate prior knowledge and update probabilistic models as new data become available. Markov chain Monte Carlo (MCMC) methods sample posterior probability…

Geophysics · Physics 2025-05-07 Giovanni Angelo Meles , Stefano Marelli , Niklas Linde

This work proposes an adaptive framework to solve a robust structural shape optimization problem governed by linear elasticity models that account for uncertainties in the loading and material inputs. A posteriori error estimators are…

Optimization and Control · Mathematics 2026-02-06 Oğuz Han Altıntaş , Hamdullah Yücel

Metaheuristic search algorithms look for solutions that either maximise or minimise a set of objectives, such as cost or performance. However most real-world optimisation problems consist of nonlinear problems with complex constraints and…

Neural and Evolutionary Computing · Computer Science 2022-06-29 Manjinder Singh , Alexander E. I. Brownlee , David Cairns

We formalize and study the natural approach of designing convex surrogate loss functions via embeddings, for problems such as classification, ranking, or structured prediction. In this approach, one embeds each of the finitely many…

Machine Learning · Computer Science 2022-01-12 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

This paper presents the development of an algorithm, termed the Global-Local Hybrid Surrogate (GLHS), designed to efficiently compute the probability of rare failure events in complex systems. The primary goal is to enhance the accuracy of…

Computational Engineering, Finance, and Science · Computer Science 2026-03-19 Audrey Gaymann , Juan M. Cardenas , Sung Min Jo , Marco Panesi , Alireza Doostan

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Offline model-based optimization seeks to optimize against a learned surrogate model without querying the true oracle objective function during optimization. Such tasks are commonly encountered in protein design, robotics, and clinical…

Machine Learning · Computer Science 2024-09-27 Michael S. Yao , Yimeng Zeng , Hamsa Bastani , Jacob Gardner , James C. Gee , Osbert Bastani