English
Related papers

Related papers: TENG: Time-Evolving Natural Gradient for Solving P…

200 papers

Data driven discovery of partial differential equations (PDEs) is a promising approach for uncovering the underlying laws governing complex systems. However, purely data driven techniques face the dilemma of balancing search space with…

Machine Learning · Computer Science 2025-05-12 Hao Xu , Yuntian Chen , Rui Cao , Tianning Tang , Mengge Du , Jian Li , Adrian H. Callaghan , Dongxiao Zhang

Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step…

Machine Learning · Computer Science 2025-10-07 Zhikai Wu , Sifan Wang , Shiyang Zhang , Sizhuang He , Min Zhu , Anran Jiao , Lu Lu , David van Dijk

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

The discovery of partial differential equations (PDEs) is a challenging task that involves both theoretical and empirical methods. Machine learning approaches have been developed and used to solve this problem; however, it is important to…

Machine Learning · Statistics 2023-06-09 Kalpesh More , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

In the realm of computational fluid dynamics, traditional numerical methods, which heavily rely on discretization, typically necessitate the formulation of partial differential equations (PDEs) in conservative form to accurately capture…

Neural network quantization aims to reduce the bit-widths of weights and activations, making it a critical technique for deploying deep neural networks on resource-constrained hardware. Most Quantization-Aware Training (QAT) methods rely on…

Machine Learning · Computer Science 2025-09-03 Kaiqi Zhao

Evolution equations, including both ordinary differential equations (ODEs) and partial differential equations (PDEs), play a pivotal role in modeling dynamic systems. However, achieving accurate long-time integration for these equations…

Numerical Analysis · Mathematics 2026-04-23 Xiaodong Feng , Haojiong Shangguan , Tao Tang , Xiaoliang Wan

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to…

Machine Learning · Computer Science 2022-05-31 Jaroslaw Rzepecki , Daniel Bates , Chris Doran

Partial differential equations (PDEs) play a foundational role in modeling physical phenomena. This study addresses the challenging task of determining variable coefficients within PDEs from measurement data. We introduce a novel neural…

Numerical Analysis · Mathematics 2023-10-17 Ke Chen , Jasen Lai , Chunmei Wang

Many Partial Differential Equations (PDEs) do not have analytical solution, and can only be solved by numerical methods. In this context, Physics-Informed Neural Networks (PINN) have become important in the last decades, since it uses a…

Numerical Analysis · Mathematics 2022-11-18 Lawson Oliveira Lima , Julien Rosenberger , Esteban Antier , Frederic Magoules

Natural gradient methods significantly accelerate the training of Physics-Informed Neural Networks (PINNs), but are often prohibitively costly. We introduce a suite of techniques to improve the accuracy and efficiency of energy natural…

Machine Learning · Computer Science 2025-10-24 Andrés Guzmán-Cordero , Felix Dangel , Gil Goldshlager , Marius Zeinhofer

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data…

Numerical Analysis · Mathematics 2021-04-21 Cheng Chang , Liu Liu , Tieyong Zeng

Multiscale and multiphysics problems need novel numerical methods in order for them to be solved correctly and predictively. To that end, we develop a wavelet based technique to solve a coupled system of nonlinear partial differential…

Numerical Analysis · Mathematics 2023-03-22 Cale Harnish , Luke Dalessandro , Karel Matous , Daniel Livescu

Modeling the traffic dynamics is essential for understanding and predicting the traffic spatiotemporal evolution. However, deriving the partial differential equation (PDE) models that capture these dynamics is challenging due to their…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Zihang Wei , Yunlong Zhang , Chenxi Liu , Yang Zhou

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

Solving time-dependent Partial Differential Equations (PDEs) is one of the most critical problems in computational science. While Physics-Informed Neural Networks (PINNs) offer a promising framework for approximating PDE solutions, their…

Neural network-based approaches have recently shown significant promise in solving partial differential equations (PDEs) in science and engineering, especially in scenarios featuring complex domains or incorporation of empirical data. One…

Machine Learning · Computer Science 2025-03-19 Chuqi Chen , Yahong Yang , Yang Xiang , Wenrui Hao