English
Related papers

Related papers: Adaptive Learning-based Surrogate Method for Stoch…

200 papers

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

Variational inference is a powerful paradigm for approximate Bayesian inference with a number of appealing properties, including support for model learning and data subsampling. By contrast MCMC methods like Hamiltonian Monte Carlo do not…

Machine Learning · Statistics 2022-07-14 Martin Jankowiak , Du Phan

In networked dynamical systems, inferring governing parameters is crucial for predicting nodal dynamics, such as gene expression levels, species abundance, or population density. While many parameter estimation techniques rely on…

Adaptation and Self-Organizing Systems · Physics 2025-03-25 Yanna Ding , Malik Magdon-Ismail , Jianxi Gao

We investigate optimal order execution problems in discrete time with instantaneous price impact and stochastic resilience. First, in the setting of linear transient price impact we derive a closed-form recursion for the optimal strategy,…

Trading and Market Microstructure · Quantitative Finance 2023-10-31 Tao Chen , Mike Ludkovski , Moritz Voß

Accurate simulation of brain deformation is a key component for developing realistic, interactive neurosurgical simulators, as complex nonlinear deformations must be captured to ensure realistic tool-tissue interactions. However,…

We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…

Machine Learning · Statistics 2025-09-29 Luca Callisti , Marco Romito , Francesco Triggiano

The paper proposes and investigates an approach for surrogate-assisted performance prediction of data-driven knowledge discovery algorithms. The approach is based on the identification of surrogate models for prediction of the target…

Machine Learning · Computer Science 2022-01-25 Anastasia A. Funkner , Aleksey N. Yakovlev , Sergey V. Kovalchuk

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

For semi-supervised techniques to be applied safely in practice we at least want methods to outperform their supervised counterparts. We study this question for classification using the well-known quadratic surrogate loss function. Using a…

Machine Learning · Statistics 2016-02-26 Jesse H. Krijthe , Marco Loog

Stochastic unit commitment models typically handle uncertainties in forecast demand by considering a finite number of realizations from a stochastic process model for loads. Accurate evaluations of expectations or higher moments for the…

Systems and Control · Computer Science 2014-07-09 Cosmin Safta , Richard L. Chen , Habib N. Najm , Ali Pinar , Jean-paul watson

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based…

Systems and Control · Electrical Eng. & Systems 2024-10-24 Matthew Bossart , Jose Daniel Lara , Ciaran Roberts , Rodrigo Henriquez-Auba , Duncan Callaway , Bri-Mathias Hodge

We consider solving nonlinear optimization problems with a stochastic objective and deterministic equality constraints. We assume for the objective that its evaluation, gradient, and Hessian are inaccessible, while one can compute their…

Optimization and Control · Mathematics 2022-06-07 Sen Na , Mihai Anitescu , Mladen Kolar

We introduce a local surrogate approach for explainable time-series forecasting. An initially non-interpretable predictive model to improve the forecast of a classical time-series 'base model' is used. 'Explainability' of the correction is…

Machine Learning · Statistics 2025-01-17 Alfredo Lopez , Florian Sobieczky

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-03-05 Bei Pang , Zhigang Ren , Yongsheng Liang , An Chen

Machine learning models play a vital role in time series forecasting. These models, however, often overlook an important element: point uncertainty estimates. Incorporating these estimates is crucial for effective risk management, informed…

Machine Learning · Computer Science 2024-09-11 Leonid Erlygin , Vladimir Zholobov , Valeriia Baklanova , Evgeny Sokolovskiy , Alexey Zaytsev

Fast machine learning-based surrogate models are trained to emulate slow, high-fidelity engineering simulation models to accelerate engineering design tasks. This introduces uncertainty as the surrogate is only an approximation of the…

Machine Learning · Statistics 2020-10-08 Paul Westermann , Ralph Evins

Recent advancements in Markov chain Monte Carlo (MCMC) sampling and surrogate modelling have significantly enhanced the feasibility of Bayesian analysis across engineering fields. However, the selection and integration of surrogate models…

Computational Physics · Physics 2024-11-22 Leon Riccius , Iuri B. C. M. Rocha , Joris Bierkens , Hanne Kekkonen , Frans P. van der Meer

We propose a novel training method based on nonlinear multilevel minimization techniques, commonly used for solving discretized large scale partial differential equations. Our multilevel training method constructs a multilevel hierarchy by…

Machine Learning · Computer Science 2020-06-30 Vanessa Braglia , Alena Kopaničáková , Rolf Krause

Decentralized sparsity learning has attracted a significant amount of attention recently due to its rapidly growing applications. To obtain the robust and sparse estimators, a natural idea is to adopt the non-smooth median loss combined…

Machine Learning · Statistics 2022-03-02 Weidong Liu , Xiaojun Mao , Xin Zhang

In performative stochastic optimization, decisions can influence the distribution of random parameters, rendering the data-generating process itself decision-dependent. In practice, decision-makers rarely have access to the true…

Optimization and Control · Mathematics 2025-10-27 Zhuangzhuang Jia , Yijie Wang , Roy Dong , Grani A. Hanasusanto