English
Related papers

Related papers: Positional Embeddings for Solving PDEs with Evolut…

200 papers

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

We propose a partial differential-integral equation (PDE) framework for deep neural networks (DNNs) and their associated learning problem by taking the continuum limits of both network width and depth. The proposed model captures the…

Optimization and Control · Mathematics 2024-11-12 Peter Markowich , Simone Portaro

Physics-informed neural networks (PINNs) [31] use automatic differentiation to solve partial differential equations (PDEs) by penalizing the PDE in the loss function at a random set of points in the domain of interest. Here, we develop a…

Neural and Evolutionary Computing · Computer Science 2019-12-03 E. Kharazmi , Z. Zhang , G. E. Karniadakis

Numerical solutions to high-dimensional partial differential equations (PDEs) based on neural networks have seen exciting developments. This paper derives complexity estimates of the solutions of $d$-dimensional second-order elliptic PDEs…

Numerical Analysis · Mathematics 2021-11-09 Ziang Chen , Jianfeng Lu , Yulong Lu

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution…

Optimization and Control · Mathematics 2024-09-24 Minsoo Kim , Hongseok Kim

Physical systems whose dynamics are governed by partial differential equations (PDEs) find applications in numerous fields, from engineering design to weather forecasting. The process of obtaining the solution from such PDEs may be…

Machine Learning · Computer Science 2022-09-21 Pratyush Bhatt , Yash Kumar , Azzeddine Soulaimani

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise…

Machine Learning · Computer Science 2024-04-30 Mengge Du , Yuntian Chen , Longfeng Nie , Siyu Lou , Dongxiao Zhang

A burgeoning line of research leverages deep neural networks to approximate the solutions to high dimensional PDEs, opening lines of theoretical inquiry focused on explaining how it is that these models appear to evade the curse of…

Machine Learning · Computer Science 2023-03-28 Tanya Marwah , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

Given only a collection of points sampled from a Riemannian manifold embedded in a Euclidean space, in this paper we propose a new method to solve elliptic partial differential equations (PDEs) supplemented with boundary conditions. Notice…

Numerical Analysis · Mathematics 2022-11-29 Ryan Vaughn , Tyrus Berry , Harbir Antil

Within the framework of parameter dependent PDEs, we develop a constructive approach based on Deep Neural Networks for the efficient approximation of the parameter-to-solution map. The research is motivated by the limitations and drawbacks…

Numerical Analysis · Mathematics 2022-12-16 Nicola R. Franco , Andrea Manzoni , Paolo Zunino

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

The recent development of spectral method has been praised for its high-order convergence in simulating complex physical problems. The combination of embedded boundary method and spectral method becomes a mainstream way to tackle…

Numerical Analysis · Mathematics 2018-03-08 Po-Yi Wu , Cheng-Hong Robert Kao , Tony Wen-Hann Sheu

Information networks are ubiquitous and are ideal for modeling relational data. Networks being sparse and irregular, network embedding algorithms have caught the attention of many researchers, who came up with numerous embeddings algorithms…

Machine Learning · Computer Science 2020-09-25 Junshan Wang , Yilun Jin , Guojie Song , Xiaojun Ma

Partial differential equations (PDEs) form a central component of scientific computing. Among recent advances in deep learning, evolutionary neural networks have been developed to successively capture the temporal dynamics of time-dependent…

Machine Learning · Computer Science 2026-02-24 Bongseok Kim , Jiahao Zhang , Guang Lin

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

In recent years, neural networks have achieved remarkable progress in various fields and have also drawn much attention in applying them on scientific problems. A line of methods involving neural networks for solving partial differential…

Numerical Analysis · Mathematics 2025-05-20 Xianliang Xu , Ye Li , Zhongyi Huang

Motivated by recent research on Physics-Informed Neural Networks (PINNs), we make the first attempt to introduce the PINNs for numerical simulation of the elliptic Partial Differential Equations (PDEs) on 3D manifolds. PINNs are one of the…

Numerical Analysis · Mathematics 2021-03-05 Zhuochao Tang , Zhuojia Fu

We introduce a new class of spatially stochastic physics and data informed deep latent models for parametric partial differential equations (PDEs) which operate through scalable variational neural processes. We achieve this by assigning…

Machine Learning · Computer Science 2023-06-08 Arnaud Vadeboncoeur , Ieva Kazlauskaite , Yanni Papandreou , Fehmi Cirak , Mark Girolami , Ömer Deniz Akyildiz

We propose a unified framework for delay differential equations (DDEs) based on deep neural networks (DNNs) - the neural delay differential equations (NDDEs), aimed at solving the forward and inverse problems of delay differential…

Machine Learning · Computer Science 2024-08-27 Housen Wang , Yuxing Chen , Sirong Cao , Xiaoli Wang , Qiang Liu