English
Related papers

Related papers: Deep neural network surrogates for non-smooth quan…

200 papers

Advancements in modern science have led to the increasing availability of non-Euclidean data in metric spaces. This paper addresses the challenge of modeling relationships between non-Euclidean responses and multivariate Euclidean…

Methodology · Statistics 2025-05-13 Su I Iao , Yidong Zhou , Hans-Georg Müller

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Stochastic partial differential equations (SPDEs) are ubiquitous in engineering and computational sciences. The stochasticity arises as a consequence of uncertainty in input parameters, constitutive relations, initial/boundary conditions,…

Data Analysis, Statistics and Probability · Physics 2020-01-29 Sharmila Karumuri , Rohit Tripathy , Ilias Bilionis , Jitesh Panchal

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Many real-world applications demand accurate and fast predictions, as well as reliable uncertainty estimates. However, quantifying uncertainty on high-dimensional predictions is still a severely under-investigated problem, especially when…

Computational Engineering, Finance, and Science · Computer Science 2025-02-04 Saurabh Deshpande , Hussein Rappel , Mark Hobbs , Stéphane P. A. Bordas , Jakub Lengiewicz

The solution of partial differential equations (PDEs) plays a central role in numerous applications in science and engineering, particularly those involving multiphase flow in porous media. Complex, nonlinear systems govern these problems…

Modern deep learning models are highly overparameterized, resulting in large sets of parameter configurations that yield the same outputs. A significant portion of this redundancy is explained by symmetries in the parameter…

Machine Learning · Computer Science 2025-12-12 Bo Zhao , Robin Walters , Rose Yu

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

Non-Euclidean constraints are inherent in many kinds of data in computer vision and machine learning, typically as a result of specific invariance requirements that need to be respected during high-level inference. Often, these geometric…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Suhas Lohit , Pavan Turaga

The paper addresses Bayesian inferences in inverse problems with uncertainty quantification involving a computationally expensive forward map associated with solving a partial differential equations. To mitigate the computational cost, the…

Methodology · Statistics 2023-12-18 A. Galaviz , J. A. Christen , A. Capella

A new method to solve computationally challenging (random) parametric obstacle problems is developed and analyzed, where the parameters can influence the related partial differential equation (PDE) and determine the position and surface…

Machine Learning · Computer Science 2025-04-08 Martin Eigel , Cosmas Heiß , Janina E. Schütte

Neural PDE surrogates can improve the cost-accuracy tradeoff of classical solvers, but often generalize poorly to new initial conditions and accumulate errors over time. Physical and symmetry constraints have shown promise in closing this…

Machine Learning · Computer Science 2025-06-09 Yunfei Huang , David S. Greenberg

Inverse modeling for computing a high-dimensional spatially-varying property field from indirect sparse and noisy observations is a challenging problem. This is due to the complex physical system of interest often expressed in the form of…

Computational Physics · Physics 2021-02-22 Govinda Anantha Padmanabha , Nicholas Zabaras

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

A regression problem with dependent data is considered. Regularity assumptions on the dependency of the data are introduced, and it is shown that under suitable structural assumptions on the regression function a deep recurrent neural…

Machine Learning · Statistics 2020-11-03 Michael Kohler , Adam Krzyzak

We propose to impose symmetry in neural network parameters to improve parameter usage and make use of dedicated convolution and matrix multiplication routines. Due to significant reduction in the number of parameters as a result of the…

Machine Learning · Computer Science 2019-01-11 Xu Shell Hu , Sergey Zagoruyko , Nikos Komodakis

Learning data representations under uncertainty is an important task that emerges in numerous scientific computing and data analysis applications. However, uncertainty quantification techniques are computationally intensive and become…

Machine Learning · Computer Science 2025-08-06 Paz Fink Shustin , Shashanka Ubaru , Małgorzata J. Zimoń , Songtao Lu , Vasileios Kalantzis , Lior Horesh , Haim Avron

In this work, we investigate the use of deep neural networks (DNNs) as surrogates for solving the inverse acoustic scattering problem of recovering a sound-soft obstacle from phaseless far-field measurements. We approximate the forward maps…

Numerical Analysis · Mathematics 2025-09-08 Yuxin Fan , Jiho Hong , Bangti Jin

Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant…

Machine Learning · Computer Science 2024-02-16 Jonas Kneifl , Jörg Fehr , Steven L. Brunton , J. Nathan Kutz

This script offers an implementation-oriented introduction to deep learning methods for solving and estimating high-dimensional dynamic stochastic models in economics and finance. Its starting point is the curse of dimensionality:…

General Economics · Economics 2026-05-15 Simon Scheidegger