English
Related papers

Related papers: Multi-level neural networks for PDEs with uncertai…

200 papers

This study used a multigrid-based convolutional neural network architecture known as MgNet in operator learning to solve numerical partial differential equations (PDEs). Given the property of smoothing iterations in multigrid methods where…

Machine Learning · Computer Science 2023-02-03 Jianqing Zhu , Juncai He , Qiumei Huang

This paper presents a learnable solver tailored to iteratively solve sparse linear systems from discretized partial differential equations (PDEs). Unlike traditional approaches relying on specialized expertise, our solver streamlines the…

Numerical Analysis · Mathematics 2024-05-10 Yan Xie , Minrui Lv , Chensong Zhang

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

Fully connected multilayer perceptrons are used for obtaining numerical solutions of partial differential equations in various dimensions. Independent variables are fed into the input layer, and the output is considered as solution's value.…

Neural and Evolutionary Computing · Computer Science 2020-01-28 V. I. Avrutskiy

We investigate numerous structural connections between numerical algorithms for partial differential equations (PDEs) and neural architectures. Our goal is to transfer the rich set of mathematical foundations from the world of PDEs to…

Numerical Analysis · Mathematics 2022-03-22 Tobias Alt , Karl Schrader , Matthias Augustin , Pascal Peter , Joachim Weickert

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Deep learning has emerged as a compelling framework for scientific and engineering computing, motivating growing interest in neural network-based solvers for partial differential equations (PDEs). Within this landscape, network…

Numerical Analysis · Mathematics 2026-04-06 Tao Cheng , Lili Ju , Zhonghua Qiao , Xiaoping Zhang

The current deep learning model is of a single-grade, that is, it learns a deep neural network by solving a single nonconvex optimization problem. When the layer number of the neural network is large, it is computationally challenging to…

Machine Learning · Computer Science 2023-02-02 Yuesheng Xu

This paper studies numerical solutions for parameterized partial differential equations (P-PDEs) with deep learning (DL). P-PDEs arise in many important application areas and the computational cost using traditional numerical schemes can be…

Numerical Analysis · Mathematics 2020-11-03 Yuyan Chen , Bin Dong , Jinchao Xu

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent…

Optimization and Control · Mathematics 2022-10-28 Patrick L. Combettes , Jean-Christophe Pesquet , Audrey Repetti

Domain decomposition methods (DDMs) are popular solvers for discretized systems of partial differential equations (PDEs), with one-level and multilevel variants. These solvers rely on several algorithmic and mathematical parameters,…

Machine Learning · Computer Science 2023-03-03 Ali Taghibakhshi , Nicolas Nytko , Tareq Uz Zaman , Scott MacLachlan , Luke Olson , Matthew West

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are…

Machine Learning · Computer Science 2019-04-16 Tim Dockhorn

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the…

Optimization and Control · Mathematics 2019-11-27 Chin Pang Ho , Michal Kocvara , Panos Parpas

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

Numerical Analysis · Mathematics 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

We describe and analyze a hybrid finite element/neural network method for predicting solutions of partial differential equations. The methodology is designed for obtaining fine scale fluctuations from neural networks in a local manner. The…

Numerical Analysis · Mathematics 2026-02-24 Uladzislau Kapustsin , Utku Kaya , Johannes Pfefferer , Thomas Richter

In this paper, we investigate the combination of multigrid methods and neural networks, starting from a Finite Element discretization of an elliptic PDE. Multigrid methods use interpolation operators to transfer information between…

Numerical Analysis · Mathematics 2021-09-14 Claudio Tomasi , Rolf Krause