English
Related papers

Related papers: Deep neural network surrogates for non-smooth quan…

200 papers

We propose a deep neural network (DNN) as a fast surrogate model for local stress (and in principle strain) calculation in inhomogeneous non-linear material systems. We show that the DNN predicts the local stresses with about 3.8% mean…

Materials Science · Physics 2021-03-17 Jaber Rezaei Mianroodi , Nima H. Siboni , Dierk Raabe

The goal of this paper is to analyze the geometric properties of deep neural network classifiers in the input space. We specifically study the topology of classification regions created by deep networks, as well as their associated decision…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Alhussein Fawzi , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard , Stefano Soatto

Neural networks have become a powerful tool as surrogate models to provide numerical solutions for scientific problems with increased computational efficiency. This efficiency can be advantageous for numerically challenging problems where…

Machine Learning · Statistics 2023-10-25 Pelin Ersin , Emma Hayes , Peter Matthews , Paramjyoti Mohapatra , Elisa Negrini , Karl Schulz

Peridynamics is a non-local continuum mechanics theory that offers unique advantages for modeling problems involving discontinuities and complex deformations. Within the peridynamic framework, various formulations exist, among which the…

Computational Physics · Physics 2024-11-15 Xuan Hu , Qijun Chen , Nicholas H. Luo , Richy J. Zheng , Shaofan Li

Neural surrogates for Partial Differential Equations (PDEs) often suffer significant performance degradation when evaluated on problem configurations outside their training distribution, such as new initial conditions or structural…

Machine Learning · Computer Science 2026-02-11 Paul Setinek , Gianluca Galletti , Thomas Gross , Dominik Schnürer , Johannes Brandstetter , Werner Zellinger

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

In this work, we investigate the value of uncertainty modeling in 3D super-resolution with convolutional neural networks (CNNs). Deep learning has shown success in a plethora of medical image transformation problems, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Ryutaro Tanno , Daniel E. Worrall , Aurobrata Ghosh , Enrico Kaden , Stamatios N. Sotiropoulos , Antonio Criminisi , Daniel C. Alexander

Deep Operator Networks are emerging as fundamental tools among various neural network types to learn mappings between function spaces, and have recently gained attention due to their ability to approximate nonlinear operators. In…

Machine Learning · Computer Science 2026-01-15 Beatrice Ceccanti , Mattia Galanti , Ivo Roghair , Martin van Sint Annaland

Deep neural networks (DNNs) have received tremendous attention and achieved great success in various applications, such as image and video analysis, natural language processing, recommendation systems, and drug discovery. However, inherent…

Machine Learning · Computer Science 2023-04-21 Xujiang Zhao

Machine learning surrogates are increasingly employed to replace expensive computational models for physics-based reliability analysis. However, their use introduces epistemic uncertainty from model approximation errors, which couples with…

Machine Learning · Computer Science 2025-09-24 Amirreza Tootchi , Xiaoping Du

In many cutting-edge applications, high-fidelity computational models prove to be too slow for practical use and are therefore replaced by much faster surrogate models. Recently, deep learning techniques have increasingly been utilized to…

Machine Learning · Computer Science 2024-04-03 Saurabh Deshpande , Stéphane P. A. Bordas , Jakub Lengiewicz

We study consistency properties of machine learning methods based on minimizing convex surrogates. We extend the recent framework of Osokin et al. (2017) for the quantitative analysis of consistency properties to the case of inconsistent…

Machine Learning · Computer Science 2019-01-10 Kirill Struminsky , Simon Lacoste-Julien , Anton Osokin

The curse of dimensionality is commonly encountered in numerical partial differential equations (PDE), especially when uncertainties have to be modeled into the equations as random coefficients. However, very often the variability of…

Numerical Analysis · Mathematics 2021-07-01 Yuehaw Khoo , Jianfeng Lu , Lexing Ying

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-29 Laurence Perreault Levasseur , Yashar D. Hezaveh , Risa H. Wechsler

Quantifying similarity between neural representations -- e.g. hidden layer activation vectors -- is a perennial problem in deep learning and neuroscience research. Existing methods compare deterministic responses (e.g. artificial networks…

Machine Learning · Computer Science 2023-02-07 Lyndon R. Duong , Jingyang Zhou , Josue Nassar , Jules Berman , Jeroen Olieslagers , Alex H. Williams

Predicting multiphysics dynamics is computationally expensive and challenging due to the severe coupling of multi-scale, heterogeneous physical processes. While neural surrogates promise a paradigm shift, the field currently suffers from an…

Unsupervised attributed graph representation learning is challenging since both structural and feature information are required to be represented in the latent space. Existing methods concentrate on learning latent representation via…

Machine Learning · Computer Science 2021-04-28 Zelin Zang , Siyuan Li , Di Wu , Jianzhu Guo , Yongjie Xu , Stan Z. Li

In this work we propose a deep neural network based surrogate model for a plasma shadowgraph - a technique for visualization of perturbations in a transparent medium. We are substituting the numerical code by a computationally cheaper…

The Information Bottleneck principle offers both a mechanism to explain how deep neural networks train and generalize, as well as a regularized objective with which to train models. However, multiple competing objectives are proposed in the…

Machine Learning · Computer Science 2021-01-06 Andreas Kirsch , Clare Lyle , Yarin Gal

High resolution simulations of incompressible flows have become routine across a range of engineering applications. Despite their routine use, due to the high dimensional parameter space present for most practical applications, a…

Fluid Dynamics · Physics 2022-11-14 Christopher J. McDevitt , Eric Fowler , Subrata Roy