English
Related papers

Related papers: One-shot Learning of Surrogates in PDE-constrained…

200 papers

We investigate optimal order execution problems in discrete time with instantaneous price impact and stochastic resilience. First, in the setting of linear transient price impact we derive a closed-form recursion for the optimal strategy,…

Trading and Market Microstructure · Quantitative Finance 2023-10-31 Tao Chen , Mike Ludkovski , Moritz Voß

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

We present a hybrid sampling-surrogate approach for reducing the computational expense of uncertainty quantification in nonlinear dynamical systems. Our motivation is to enable rapid uncertainty quantification in complex mechanical systems…

Computation · Statistics 2022-01-27 Hang Yang , Yuji Fujii , K. W. Wang , Alex A. Gorodetsky

Transmission expansion planning (TEP) plays a critical role in ensuring power system reliability and facilitating the integration of renewable energy resources. However, this process requires planners to constantly deal with significant…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Victor Schmitt , Farzaneh Pourahmadi , Angela Flores-Quiroz , Pablo Apablaza , Pierluigi Mancarella

PAC-Bayes learning is a comprehensive setting for (i) studying the generalisation ability of learning algorithms and (ii) deriving new learning algorithms by optimising a generalisation bound. However, optimising generalisation bounds might…

Machine Learning · Statistics 2024-11-27 Antoine Picard-Weibel , Roman Moscoviz , Benjamin Guedj

We present an algorithm for a class of statistical inference problems. The main idea is to reformulate the inference problem as an optimization procedure, based on the generation of surrogate (auxiliary) functions. This approach is…

Optimization and Control · Mathematics 2018-05-22 Rodrigo Carvajal , Rafael Orellana , Dimitrios Katselis , Pedro Escárate , Juan. C. Agüero

The embedded ensemble propagation approach introduced in [49] has been demonstrated to be a powerful means of reducing the computational cost of sampling-based uncertainty quantification methods, particularly on emerging computational…

Computation · Statistics 2017-05-08 Marta D'Elia , Eric Phipps , Ahmad Rushdi , Mohamed Ebeida

For many novel applications, such as patient-specific computer-aided surgery, conventional solution techniques of the underlying nonlinear problems are usually computationally too expensive and are lacking information about how certain can…

Machine Learning · Computer Science 2022-07-18 Saurabh Deshpande , Jakub Lengiewicz , Stéphane P. A. Bordas

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

Scenario reduction algorithms can be an effective means to provide a tractable description of the uncertainty in optimal control problems. However, they might significantly compromise the performance of the controlled system. In this paper,…

Optimization and Control · Mathematics 2024-04-12 Francesco Cordiano , Bart De Schutter

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

There is now significant historical data available on decision making in organizations, consisting of the decision problem, what decisions were made, and how desirable the outcomes were. Using this data, it is possible to learn a surrogate…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Olivier Francon , Santiago Gonzalez , Babak Hodjat , Elliot Meyerson , Risto Miikkulainen , Xin Qiu , Hormoz Shahrzad

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta

Calibration of neural networks is a topical problem that is becoming more and more important as neural networks increasingly underpin real-world applications. The problem is especially noticeable when using modern neural networks, for which…

Machine Learning · Computer Science 2023-08-29 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

Numerical simulations in climate, chemistry, or astrophysics are computationally too expensive for uncertainty quantification or parameter-exploration at high-resolution. Reduced-order or surrogate models are multiple orders of magnitude…

Machine Learning · Computer Science 2022-07-26 Björn Lütjens , Catherine H. Crawford , Campbell D Watson , Christopher Hill , Dava Newman

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh