English
Related papers

Related papers: Finite Difference Nets: A Deep Recurrent Framework…

200 papers

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise…

Machine Learning · Computer Science 2024-04-30 Mengge Du , Yuntian Chen , Longfeng Nie , Siyu Lou , Dongxiao Zhang

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

The working mechanisms of complex natural systems tend to abide by concise and profound partial differential equations (PDEs). Methods that directly mine equations from data are called PDE discovery, which reveals consistent physical laws…

Machine Learning · Computer Science 2023-03-17 Mengge Du , Yuntian Chen , Dongxiao Zhang

A state-of-the-art deep domain decomposition method (D3M) based on the variational principle is proposed for partial differential equations (PDEs). The solution of PDEs can be formulated as the solution of a constrained optimization…

Machine Learning · Computer Science 2020-04-03 Ke Li , Kejun Tang , Tianfan Wu , Qifeng Liao

We propose a novel framework, Continuous_Time Attention, which infuses partial differential equations (PDEs) into the Transformer's attention mechanism to address the challenges of extremely long input sequences. Instead of relying solely…

Machine Learning · Computer Science 2025-12-30 Yukun Zhang , Xueqing Zhou

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the…

Numerical Analysis · Mathematics 2021-11-10 Brek Meuris , Saad Qadeer , Panos Stinis

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Evolutional deep neural networks (EDNN) solve partial differential equations (PDEs) by marching the network representation of the solution fields, using the governing equations. Use of a single network to solve coupled PDEs on large domains…

Numerical Analysis · Mathematics 2024-07-18 Hadden Kim , Tamer A. Zaki

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Physics-informed neural networks (PINNs) constitute a flexible deep learning approach for solving partial differential equations (PDEs), which model phenomena ranging from heat conduction to quantum mechanical systems. Despite their…

Machine Learning · Computer Science 2026-03-17 Aleksander Krasowski , René P. Klausen , Aycan Celik , Sebastian Lapuschkin , Wojciech Samek , Jonas Naujoks

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

In this paper, we study a machine-learning-based solver for high-dimensional partial differential equations (PDEs). Computing accurate solutions efficiently for such problems remains challenging because of the curse of dimensionality, which…

Numerical Analysis · Mathematics 2026-04-27 Phuoc-Toan Huynh , Feng Bao , Haizhao Yang , Ahmed Zytoon

Time-dependent partial differential equations (PDEs) are ubiquitous in science and engineering. Recently, mostly due to the high computational cost of traditional solution techniques, deep neural network based surrogates have gained…

Machine Learning · Computer Science 2023-10-24 Phillip Lippe , Bastiaan S. Veeling , Paris Perdikaris , Richard E. Turner , Johannes Brandstetter

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

We investigate numerous structural connections between numerical algorithms for partial differential equations (PDEs) and neural architectures. Our goal is to transfer the rich set of mathematical foundations from the world of PDEs to…

Numerical Analysis · Mathematics 2022-03-22 Tobias Alt , Karl Schrader , Matthias Augustin , Pascal Peter , Joachim Weickert

The use of neural networks to approximate partial differential equations (PDEs) has gained significant attention in recent years. However, the approximation of PDEs with localised phenomena, e.g., sharp gradients and singularities, remains…

Numerical Analysis · Mathematics 2025-01-30 Santiago Badia , Wei Li , Alberto F. Martín

We consider using deep neural networks to solve time-dependent partial differential equations (PDEs), where multi-scale processing is crucial for modeling complex, time-evolving dynamics. While the U-Net architecture with skip connections…

Machine Learning · Computer Science 2024-03-29 Xuan Zhang , Jacob Helwig , Yuchao Lin , Yaochen Xie , Cong Fu , Stephan Wojtowytsch , Shuiwang Ji

Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at…

Machine Learning · Statistics 2021-03-31 Hassan Arbabi , Ioannis Kevrekidis