English
Related papers

Related papers: Deep Equilibrium Based Neural Operators for Steady…

200 papers

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

This paper introduces an operator-based neural network, the mirror-padded Fourier neural operator (MFNO), designed to learn the dynamics of stochastic systems. MFNO extends the standard Fourier neural operator (FNO) by incorporating mirror…

Machine Learning · Computer Science 2025-07-25 Wonjae Lee , Taeyoung Kim , Hyungbin Park

Memory complexity and data scarcity have so far prohibited learning solution operators of partial differential equations (PDEs) at high resolutions. We address these limitations by introducing a new data efficient and highly parallelizable…

Machine Learning · Computer Science 2023-10-03 Jean Kossaifi , Nikola Kovachki , Kamyar Azizzadenesheli , Anima Anandkumar

This work introduces a paradigm for constructing parametric neural operators that are derived from finite-dimensional representations of Green's operators for linear partial differential equations (PDEs). We refer to such neural operators…

Machine Learning · Computer Science 2026-04-10 Hugo Melchers , Joost Prins , Michael Abdelmalik

Accurately learning solution operators for time-dependent partial differential equations (PDEs) from sparse and irregular data remains a challenging task. Recurrent DeepONet extensions inherit the discrete-time limitations of…

Computational Engineering, Finance, and Science · Computer Science 2025-07-04 Diab W. Abueidda , Mbebo Nonna , Panos Pantidis , Mostafa E. Mobasher

Neural operators, which aim to approximate mappings between infinite-dimensional function spaces, have been widely applied in the simulation and prediction of physical systems. However, the limited representational capacity of network…

Machine Learning · Computer Science 2025-06-03 Jin Song , Kenji Kawaguchi , Zhenya Yan

The finite element method (FEM) is a well-established numerical method for solving partial differential equations (PDEs). However, its mesh-based nature gives rise to substantial computational costs, especially for complex multiscale…

Computational Engineering, Finance, and Science · Computer Science 2025-06-24 Weihang Ouyang , Yeonjong Shin , Si-Wei Liu , Lu Lu

Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning.…

Numerical Analysis · Mathematics 2023-06-27 Samuel N. Cohen , Deqing Jiang , Justin Sirignano

This paper introduces a novel two-stream deep model based on graph convolutional network (GCN) architecture and feed-forward neural networks (FFNN) for learning the solution of nonlinear partial differential equations (PDEs). The model aims…

Machine Learning · Computer Science 2022-05-02 Onur Bilgin , Thomas Vergutz , Siamak Mehrkanoon

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

Machine Learning · Statistics 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Constitutive modeling based on continuum mechanics theory has been a classical approach for modeling the mechanical responses of materials. However, when constitutive laws are unknown or when defects and/or high degrees of heterogeneity are…

Machine Learning · Computer Science 2022-07-27 Huaiqian You , Quinn Zhang , Colton J. Ross , Chung-Hao Lee , Yue Yu

We investigate numerous structural connections between numerical algorithms for partial differential equations (PDEs) and neural architectures. Our goal is to transfer the rich set of mathematical foundations from the world of PDEs to…

Numerical Analysis · Mathematics 2022-03-22 Tobias Alt , Karl Schrader , Matthias Augustin , Pascal Peter , Joachim Weickert

Partial Differential Equations (PDEs) are used to model a variety of dynamical systems in science and engineering. Recent advances in deep learning have enabled us to solve them in a higher dimension by addressing the curse of…

Deep Equilibrium Model (DEQ), which serves as a typical implicit neural network, emphasizes their memory efficiency and competitive performance compared to explicit neural networks. However, there has been relatively limited theoretical…

Machine Learning · Computer Science 2024-12-05 Haixiang Sun , Ye Shi

This work proposes an autoencoder neural network as a non-linear generalization of projection-based methods for solving Partial Differential Equations (PDEs). The proposed deep learning architecture presented is capable of generating the…

Computational Physics · Physics 2020-06-25 Jaime Lopez Garcia , Angel Rivero Jimenez

Deep learning has emerged as a compelling framework for scientific and engineering computing, motivating growing interest in neural network-based solvers for partial differential equations (PDEs). Within this landscape, network…

Numerical Analysis · Mathematics 2026-04-06 Tao Cheng , Lili Ju , Zhonghua Qiao , Xiaoping Zhang

Neural operators (NOs) provide fast, resolution-invariant surrogates for mapping input fields to PDE solution fields, but their predictions can exhibit significant epistemic uncertainty due to finite data, imperfect optimization, and…

Machine Learning · Computer Science 2026-03-13 Haoze Song , Zhihao Li , Mengyi Deng , Xin Li , Duyi Pan , Zhilu Lai , Wei Wang

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu