English
Related papers

Related papers: Neural Galerkin Schemes with Active Learning for H…

200 papers

Learning high-dimensional distributions is an important yet challenging problem in machine learning with applications in various domains. In this paper, we introduce new techniques to formulate the problem as solving Fokker-Planck equation…

Machine Learning · Computer Science 2021-05-11 Yufan Zhou , Changyou Chen , Jinhui Xu

Machine learning methods have been lately used to solve partial differential equations (PDEs) and dynamical systems. These approaches have been developed into a novel research field known as scientific machine learning in which techniques…

Machine Learning · Computer Science 2022-12-12 Junho Choi , Namjung Kim , Youngjoon Hong

In this article, we review the literature on statistical theories of neural networks from three perspectives: approximation, training dynamics and generative models. In the first part, results on excess risks for neural networks are…

Machine Learning · Statistics 2024-09-17 Namjoon Suh , Guang Cheng

Randomized neural networks (RNN) are a variation of neural networks in which the hidden-layer parameters are fixed to randomly assigned values and the output-layer parameters are obtained by solving a linear system by least squares. This…

Numerical Analysis · Mathematics 2022-06-14 Jingbo Sun , Suchuan Dong , Fei Wang

Neural networks are increasingly recognized as a powerful numerical solution technique for partial differential equations (PDEs) arising in diverse scientific computing domains, including quantum many-body physics. In the context of…

Numerical Analysis · Mathematics 2023-11-22 Chuhao Sun , Asaf Cohen , James Stokes , Shravan Veerapaneni

We present a neural network-based method for solving linear and nonlinear partial differential equations, by combining the ideas of extreme learning machines (ELM), domain decomposition and local neural networks. The field solution on each…

Numerical Analysis · Mathematics 2021-09-22 Suchuan Dong , Zongwei Li

Nowadays, neural networks are widely used in many applications as artificial intelligence models for learning tasks. Since typically neural networks process a very large amount of data, it is convenient to formulate them within the…

Optimization and Control · Mathematics 2021-11-10 M. Herty , T. Trimborn , G. Visconti

The study of parametric differential equations plays a crucial role in weather forecasting and epidemiological modeling. These phenomena are better represented using fractional derivatives due to their inherent memory or hereditary effects.…

Numerical Analysis · Mathematics 2025-03-31 S M Sivalingam , V Govindaraj , A. S. Hendy

Integro-differential equations, analyzed in this work, comprise an important class of models of continuum media with nonlocal interactions. Examples include peridynamics, population and opinion dynamics, the spread of disease models, and…

Numerical Analysis · Mathematics 2023-12-13 Georgi S. Medvedev

Over the past few years, neural network methods have evolved in various directions for approximating partial differential equations (PDEs). A promising new development is the integration of neural networks with classical numerical…

Numerical Analysis · Mathematics 2025-07-10 Georgios Grekas , Charalambos G. Makridakis , Tristan Pryer

We describe a neural-based method for generating exact or approximate solutions to differential equations in the form of mathematical expressions. Unlike other neural methods, our system returns symbolic expressions that can be interpreted…

Machine Learning · Computer Science 2020-11-16 Maysum Panju , Kourosh Parand , Ali Ghodsi

We solve high-dimensional steady-state Fokker-Planck equations on the whole space by applying tensor neural networks. The tensor networks are a linear combination of tensor products of one-dimensional feedforward networks or a linear…

Numerical Analysis · Mathematics 2024-11-04 Taorui Wang , Zheyuan Hu , Kenji Kawaguchi , Zhongqiang Zhang , George Em Karniadakis

When neural networks are used to solve differential equations, they usually produce solutions in the form of black-box functions that are not directly mathematically interpretable. We introduce a method for generating symbolic expressions…

Machine Learning · Computer Science 2020-11-05 Maysum Panju , Ali Ghodsi

Numerically solving high-dimensional partial differential equations (PDEs) is a major challenge. Conventional methods, such as finite difference methods, are unable to solve high-dimensional PDEs due to the curse-of-dimensionality. A…

Numerical Analysis · Mathematics 2023-05-11 Deqing Jiang , Justin Sirignano , Samuel N. Cohen

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

Neural networks are increasingly used to construct numerical solution methods for partial differential equations. In this expository review, we introduce and contrast three important recent approaches attractive in their simplicity and…

Numerical Analysis · Mathematics 2021-04-15 Jan Blechschmidt , Oliver G. Ernst

In this work, we present a hybrid numerical method for solving evolution partial differential equations (PDEs) by merging the time finite element method with deep neural networks. In contrast to the conventional deep learning-based…

Numerical Analysis · Mathematics 2024-09-05 Xiaodong Feng , Haojiong Shangguan , Tao Tang , Xiaoliang Wan , Tao Zhou

Probabilistic theory and differential equation are powerful tools for the interpretability and guidance of the design of machine learning models, especially for illuminating the mathematical motivation of learning latent variable from…

Machine Learning · Computer Science 2025-02-13 Zhuangwei Shi

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

This paper considers the filtering problem which consists in reconstructing the state of a dynamical system with partial observations coming from sensor measurements, and the knowledge that the dynamics are governed by a physical PDE model…

Numerical Analysis · Mathematics 2024-02-01 Joubine Aghili , Joy Zialesi Atokple , Marie Billaud-Friess , Guillaume Garnier , Olga Mula , Norbert Tognon