English
Related papers

Related papers: One-shot Learning of Surrogates in PDE-constrained…

200 papers

Deep learning has proven to be effective in a wide variety of loss minimization problems. However, many applications of interest, like minimizing projected Bellman error and min-max optimization, cannot be modelled as minimizing a scalar…

Machine Learning · Computer Science 2025-05-27 Ryan D'Orazio , Danilo Vucetic , Zichu Liu , Junhyung Lyle Kim , Ioannis Mitliagkas , Gauthier Gidel

The widespread adoption of machine learning surrogate models has significantly improved the scale and complexity of systems and processes that can be explored accurately and efficiently using atomistic modeling. However, the inherently…

Chemical Physics · Physics 2025-03-13 Federico Grasselli , Sanggyu Chong , Venkat Kapil , Silvia Bonfanti , Kevin Rossi

In constraint learning, we use a neural network as a surrogate for part of the constraints or of the objective function of an optimization model. However, the tractability of the resulting model is heavily influenced by the size of the…

Optimization and Control · Mathematics 2026-03-19 Hung Pham , Aiden Ren , Ibrahim Tahir , Jiatai Tong , Thiago Serra

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

Machine Learning · Computer Science 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

Production optimization in stress-sensitive unconventional reservoirs is governed by a nonlinear trade-off between pressure-driven flow and stress-induced degradation of fracture conductivity and matrix permeability. While higher drawdown…

Machine Learning · Computer Science 2026-04-02 Mahammad Valiyev , Jodel Cornelio , Behnam Jafarpour

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

A probabilistic performance-oriented control design optimization approach is introduced for flight systems. Aiming at estimating rare-event probabilities accurately and efficiently, subset simulation is combined with surrogate modeling…

Systems and Control · Electrical Eng. & Systems 2021-04-20 Dalong Shi , Florian Holzapfel

Stochastic unit commitment models typically handle uncertainties in forecast demand by considering a finite number of realizations from a stochastic process model for loads. Accurate evaluations of expectations or higher moments for the…

Systems and Control · Computer Science 2014-07-09 Cosmin Safta , Richard L. Chen , Habib N. Najm , Ali Pinar , Jean-paul watson

We present a framework for automatically structuring and training fast, approximate, deep neural surrogates of stochastic simulators. Unlike traditional approaches to surrogate modeling, our surrogates retain the interpretable structure and…

Specifying a governing physical model in the presence of missing physics and recovering its parameters are two intertwined and fundamental problems in science. Modern machine learning allows one to circumvent these, via emulators and…

Machine Learning · Computer Science 2020-06-30 Daniel J. Tait , Theodoros Damoulas

The increasing penetration of renewable generation introduces uncertainty into power systems, challenging traditional deterministic optimization methods. Chance-constrained optimization offers an approach to balancing cost and risk;…

Optimization and Control · Mathematics 2025-11-06 Amir Bahador Javadi , Amin Kargarian

Decision-making in manufacturing often involves optimizing key process parameters using data collected from simulation experiments. Gaussian processes are widely used to surrogate the underlying system and guide optimization. Uncertainty…

Applications · Statistics 2025-07-30 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

This paper proposes a machine-learning-based solution approach for solving multi-horizon stochastic programs. The approach embeds a deep learning neural network into a multi-horizon stochastic program to approximate the recourse operational…

Optimization and Control · Mathematics 2025-12-03 Hongyu Zhang , Gabriele Sormani , Enza Messina , Alan King , Francesca Maggioni

This work proposes a framework for multistage adjustable robust optimization that unifies the treatment of three different types of endogenous uncertainty, where decisions, respectively, (i) alter the uncertainty set, (ii) affect the…

Optimization and Control · Mathematics 2020-08-31 Qi Zhang , Wei Feng

Simulation models are widely used in practice to facilitate decision-making in a complex, dynamic and stochastic environment. But they are computationally expensive to execute and optimize, due to lack of analytical tractability. Simulation…

Optimization and Control · Mathematics 2021-06-14 L. Jeff Hong , Xiaowei Zhang

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

We present a novel active learning algorithm, termed as iterative surrogate model optimization (ISMO), for robust and efficient numerical approximation of PDE constrained optimization problems. This algorithm is based on deep neural…

Optimization and Control · Mathematics 2020-12-30 Kjetil O. Lye , Siddhartha Mishra , Deep Ray , Praveen Chandrasekhar

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss