English
Related papers

Related papers: Non-intrusive surrogate modelling using sparse ran…

200 papers

A machine-learning-based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (e.g., random forests, LASSO)…

Numerical Analysis · Computer Science 2017-06-02 Sumeet Trehan , Kevin Carlberg , Louis J. Durlofsky

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many…

Methodology · Statistics 2024-06-19 Joy N. Mueller , Khachik Sargsyan , Craig J. Daniels , Habib N. Najm

Sparse additive modeling is a class of effective methods for performing high-dimensional nonparametric regression. This paper develops a sparse additive model focused on estimation of treatment effect-modification with simultaneous…

Methodology · Statistics 2020-06-02 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

Fast inference of numerical model parameters from data is an important prerequisite to generate predictive models for a wide range of applications. Use of sampling-based approaches such as Markov chain Monte Carlo may become intractable…

Machine Learning · Computer Science 2022-08-10 Yu Wang , Fang Liu , Daniele E. Schiavazzi

Numerical solutions of partial differential equations (PDEs) require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques seek to…

Computational Physics · Physics 2022-05-18 James Duvall , Karthik Duraisamy , Shaowu Pan

In networked dynamical systems, inferring governing parameters is crucial for predicting nodal dynamics, such as gene expression levels, species abundance, or population density. While many parameter estimation techniques rely on…

Adaptation and Self-Organizing Systems · Physics 2025-03-25 Yanna Ding , Malik Magdon-Ismail , Jianxi Gao

In many randomized trials, outcomes such as essays or open-ended responses must be manually scored as a preliminary step to impact analysis, a process that is costly and limiting. Model-assisted estimation offers a way to combine surrogate…

Methodology · Statistics 2026-02-16 Reagan Mozer , Nicole E. Pashley , Luke Miratrix

In this manuscript, we research on the behaviors of surrogates for the rank function on different image processing problems and their optimization algorithms. We first propose a novel nonconvex rank surrogate on the general rank…

Machine Learning · Computer Science 2024-09-23 Cho-Ying Wu , Jian-Jiun Ding

In climate systems, physiological models, optics, and many more, surrogate models are developed to reconstruct chaotic dynamical systems. We introduce four data-driven measures using global attractor properties to evaluate the quality of…

Computational Physics · Physics 2025-06-12 Luci Fumagalli , Kathy Lüdge , Jana de Wiljes , Heikki Haario , Lina Jaurigue

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

Thanks to their versatility, ease of deployment and high-performance, surrogate models have become staple tools in the arsenal of uncertainty quantification (UQ). From local interpolants to global spectral decompositions, surrogates are…

Machine Learning · Statistics 2020-02-12 C. Lataniotis , S. Marelli , B. Sudret

Surrogates in lieu of expensive-to-evaluate performance functions can accelerate the reliability analysis greatly. This paper proposes a new two-stage framework for surrogate-aided reliability analysis named Surrogates for Importance…

Other Statistics · Statistics 2020-01-29 Wang-Sheng Liu , Sai Hung Cheung , Wen-Jun Cao

In this paper we introduce a novel way of estimating prediction uncertainty in deep networks through the use of uncertainty surrogates. These surrogates are features of the penultimate layer of a deep network that are forced to match…

Machine Learning · Computer Science 2021-04-19 Radhakrishna Achanta , Natasa Tagasovska

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

Recently, a surrogate model was proposed that employs a factorization machine to approximate the underlying input-output mapping of the original system, with quantum annealing used to optimize the resulting surrogate function. Inspired by…

Machine Learning · Computer Science 2026-01-21 Anbang Wang , Dunbo Cai , Yu Zhang , Yangqing Huang , Xiangyang Feng , Zhihong Zhang

Predicting the behavior of complex systems in engineering often involves significant uncertainty about operating conditions, such as external loads, environmental effects, and manufacturing variability. As a result, uncertainty…

Computation · Statistics 2025-07-17 S. Marelli , S. Schär , B. Sudret

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg

Multidisciplinary design optimization methods aim at adapting numerical optimization techniques to the design of engineering systems involving multiple disciplines. In this context, a large number of mixed continuous, integer and…

We propose a model order reduction approach for non-intrusive surrogate modeling of parametric dynamical systems. The reduced model over the whole parameter space is built by combining surrogates in frequency only, built at few selected…

Numerical Analysis · Mathematics 2021-09-23 Fabio Nobile , Davide Pradovera