English
Related papers

Related papers: Data-driven surrogates for high dimensional models…

200 papers

Stochastic subgrid-scale parametrizations aim to incorporate effects of unresolved processes in an effective model by sampling from a distribution usually described in terms of resolved modes. This is an active research area in climate,…

Computational Physics · Physics 2021-12-01 Jeric Alcala , Ilya Timofeyev

Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates…

Methodology · Statistics 2021-08-27 Annie Sauer , Robert B. Gramacy , David Higdon

Mean field games (MFGs) describe the collective behavior of large populations of interacting agents. In this work, we tackle ill-posed inverse problems in potential MFGs, aiming to recover the agents' population, momentum, and environmental…

Machine Learning · Computer Science 2025-02-18 Jingguo Zhang , Xianjin Yang , Chenchen Mou , Chao Zhou

Engineering disciplines often rely on extensive simulations to ensure that structures are designed to withstand harsh conditions while avoiding over-engineering for unlikely scenarios. Assessments such as Serviceability Limit State (SLS)…

Machine Learning · Computer Science 2025-12-19 Vegard Flovik , Sebastian Winter , Christian Agrell

This paper addresses uncertainty quantification (UQ) for problems where scalar (or low-dimensional vector) response quantities are insufficient and, instead, full-field (very high-dimensional) responses are of interest. To do so, an…

Probability · Mathematics 2018-04-18 D. G Giovanis , M. D. Shields

Neural rendering methods have significantly advanced photo-realistic 3D scene rendering in various academic and industrial applications. The recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering quality and speed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Tao Lu , Mulin Yu , Linning Xu , Yuanbo Xiangli , Limin Wang , Dahua Lin , Bo Dai

Estimation of patient-specific model parameters is important for personalized modeling, although sparse and noisy clinical data can introduce significant uncertainty in the estimated parameter values. This importance source of uncertainty,…

Machine Learning · Statistics 2020-06-04 Jwala Dhamala , John L. Sapp , B. Milan Horácek , Linwei Wang

We provide a survey of nonstationary surrogate models which utilize Gaussian processes (GPs) or variations thereof, including nonstationary kernel adaptations, partition and local GPs, and spatial warpings through deep Gaussian processes.…

Methodology · Statistics 2024-12-04 Annie S. Booth , Andrew Cooper , Robert B. Gramacy

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

Optimization and Control · Mathematics 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

First-order methods such as stochastic gradient descent (SGD) are currently the standard algorithm for training deep neural networks. Second-order methods, despite their better convergence rate, are rarely used in practice due to the…

Machine Learning · Computer Science 2019-09-26 Tianle Cai , Ruiqi Gao , Jikai Hou , Siyu Chen , Dong Wang , Di He , Zhihua Zhang , Liwei Wang

Gaussian processes with derivative information are useful in many settings where derivative information is available, including numerous Bayesian optimization and regression tasks that arise in the natural sciences. Incorporating derivative…

Machine Learning · Computer Science 2021-07-12 Misha Padidar , Xinran Zhu , Leo Huang , Jacob R. Gardner , David Bindel

Subspace data representation has recently become a common practice in many computer vision tasks. It demands generalizing classical machine learning algorithms for subspace data. Low-Rank Representation (LRR) is one of the most successful…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Boyue Wang , Yongli Hu , Junbin Gao , Yanfeng Sun , Baocai Yin

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

In this paper, we propose a deep learning based reduced order modeling method for stochastic underground flow problems in highly heterogeneous media. We aim to utilize supervised learning to build a reduced surrogate model from the…

Numerical Analysis · Mathematics 2022-07-27 Yiran Wang , Eric Chung , Shubin Fu

Mesh-based numerical solvers are an important part in many design tool chains. However, accurate simulations like computational fluid dynamics are time and resource consuming which is why surrogate models are employed to speed-up the…

Machine Learning · Computer Science 2023-07-27 Sebastian Strönisch , Maximilian Sander , Andreas Knüpfer , Marcus Meyer

Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a…

Numerical Analysis · Mathematics 2025-01-03 Xili Wang , Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

Many computer vision algorithms employ subspace models to represent data. The Low-rank representation (LRR) has been successfully applied in subspace clustering for which data are clustered according to their subspace structures. The…

Computer Vision and Pattern Recognition · Computer Science 2015-04-09 Boyue Wang , Yongli Hu , Junbin Gao , Yanfeng Sun , Baocai Yin

Stiff ordinary differential equations (ODEs) play an important role in many scientific and engineering applications. Often, the dependence of the solution of the ODE on additional parameters is of interest, e.g.\ when dealing with…

Numerical Analysis · Mathematics 2025-11-11 Idoia Cortes Garcia , P. Förster , W. Schilders , S. Schöps

Extracting meaningful information from high-dimensional data poses a formidable modeling challenge, particularly when the data is obscured by noise or represented through different modalities. This research proposes a novel non-parametric…

Machine Learning · Computer Science 2024-08-27 Navid Ziaei , Behzad Nazari , Uri T. Eden , Alik Widge , Ali Yousefi

In this contribution we present an accelerated optimization-based approach for combined state and parameter reduction of a parametrized linear control system which is then used as a surrogate model in a Bayesian inverse setting. Following…

Optimization and Control · Mathematics 2016-08-22 Christian Himpe , Mario Ohlberger