English
Related papers

Related papers: Pseudo-Hamiltonian neural networks for learning pa…

200 papers

We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of…

Machine Learning · Computer Science 2020-12-07 Jungeun Kim , Kookjin Lee , Dongeun Lee , Sheo Yon Jin , Noseong Park

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

The connection of Taylor maps and polynomial neural networks (PNN) to solve ordinary differential equations (ODEs) numerically is considered. Having the system of ODEs, it is possible to calculate weights of PNN that simulates the dynamics…

Neural and Evolutionary Computing · Computer Science 2020-08-11 Andrei Ivanov , Anna Golovkina , Uwe Iben

The last few years have witnessed an increased interest in incorporating physics-informed inductive bias in deep learning frameworks. In particular, a growing volume of literature has been exploring ways to enforce energy conservation while…

Machine Learning · Computer Science 2023-05-02 Yaofeng Desmond Zhong , Biswadip Dey , Amit Chakraborty

We introduce a compositional physics-aware FInite volume Neural Network (FINN) for learning spatiotemporal advection-diffusion processes. FINN implements a new way of combining the learning abilities of artificial neural networks with…

Machine Learning · Computer Science 2022-05-30 Matthias Karlbauer , Timothy Praditia , Sebastian Otte , Sergey Oladyshkin , Wolfgang Nowak , Martin V. Butz

Neural operator learning directly constructs the mapping relationship from the equation parameter space to the solution space, enabling efficient direct inference in practical applications without the need for repeated solution of partial…

Machine Learning · Computer Science 2026-04-28 Heng Wu , Junjie Wang , Benzhuo Lu

A feedforward neural network, including hidden layers, motivated by nonlinear functions (such as Tanh, ReLU, and Sigmoid functions), exhibits uniform approximation properties in Sobolev space, and discontinuous neural networks can reduce…

Numerical Analysis · Mathematics 2025-05-16 Xiaoyu Wang , Long Yuan , Yao Yu

Accurate models of the world are built upon notions of its underlying symmetries. In physics, these symmetries correspond to conservation laws, such as for energy and momentum. Yet even though neural network models see increasing use in the…

Machine Learning · Computer Science 2020-07-31 Miles Cranmer , Sam Greydanus , Stephan Hoyer , Peter Battaglia , David Spergel , Shirley Ho

In this paper, we introduce a shallow (one-hidden-layer) physics-informed neural network for solving partial differential equations on static and evolving surfaces. For the static surface case, with the aid of level set function, the…

Numerical Analysis · Mathematics 2025-03-20 Wei-Fan Hu , Yi-Jun Shih , Te-Sheng Lin , Ming-Chih Lai

This paper presents Discriminative Part Network (DP-Net), a deep architecture with strong interpretation capabilities, which exploits a pretrained Convolutional Neural Network (CNN) combined with a part-based recognition module. This system…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ronan Sicre , Hanwei Zhang , Julien Dejasmin , Chiheb Daaloul , Stéphane Ayache , Thierry Artières

We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a…

Machine Learning · Computer Science 2021-04-30 Marieme Ngom , Oana Marin

Physics-Informed Neural Networks (PINNs) are machine learning tools that approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost function of a Neural Network. Most…

Numerical Analysis · Mathematics 2022-08-29 Antonio Tadeu Azevedo Gomes , Larissa Miguez da Silva , Frederic Valentin

We develop improved physics-informed neural networks (PINNs) for high-order and high-dimensional power system models described by nonlinear ordinary differential equations. We propose some novel enhancements to improve PINN training and…

Machine Learning · Computer Science 2024-10-11 Vineet Jagadeesan Nair

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Physics-Informed Neural Networks (PINNs) have emerged as powerful tools for solving partial differential equations (PDEs). However, training PINNs from scratch is often computationally intensive and time-consuming. To address this problem,…

Numerical Analysis · Mathematics 2024-10-21 Sidi Wu

We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs), with a high degree of accuracy and up to a desired tolerance. We develop a differentiable…

Machine Learning · Computer Science 2023-04-19 Geoffrey Négiar , Michael W. Mahoney , Aditi S. Krishnapriyan

We introduce Sparse Symplectically Integrated Neural Networks (SSINNs), a novel model for learning Hamiltonian dynamical systems from data. SSINNs combine fourth-order symplectic integration with a learned parameterization of the…

Machine Learning · Computer Science 2020-10-29 Daniel M. DiPietro , Shiying Xiong , Bo Zhu

Deep learning has been highly successful in some applications. Nevertheless, its use for solving partial differential equations (PDEs) has only been of recent interest with current state-of-the-art machine learning libraries, e.g.,…

Machine Learning · Computer Science 2024-10-22 Hamid El Bahja , Jan Christian Hauffen , Peter Jung , Bubacarr Bah , Issa Karambal

This paper introduces a novel two-stream deep model based on graph convolutional network (GCN) architecture and feed-forward neural networks (FFNN) for learning the solution of nonlinear partial differential equations (PDEs). The model aims…

Machine Learning · Computer Science 2022-05-02 Onur Bilgin , Thomas Vergutz , Siamak Mehrkanoon

Neural ordinary differential equations (NODEs) treat computation of intermediate feature vectors as trajectories of ordinary differential equation parameterized by a neural network. In this paper, we propose a novel model, delay…

Machine Learning · Computer Science 2020-12-15 Srinivas Anumasa , P. K. Srijith