English
Related papers

Related papers: Computational characteristics of feedforward neura…

200 papers

A growing body of literature has been leveraging techniques of machine learning (ML) to build novel approaches to approximating the solutions to partial differential equations. Noticeably absent from the literature is a systematic…

Numerical Analysis · Mathematics 2026-05-19 Jonah A. Reeger

We propose the first learning scheme for functional differential equations (FDEs). FDEs play a fundamental role in physics, mathematics, and optimal control. However, the numerical analysis of FDEs has faced challenges due to its…

Numerical Analysis · Mathematics 2024-10-25 Taiki Miyagawa , Takeru Yokota

Neuro-dynamic programming is a class of powerful techniques for approximating the solution to dynamic programming equations. In their most computationally attractive formulations, these techniques provide the approximate solution only…

Machine Learning · Computer Science 2016-04-18 Wei Chen , Dayu Huang , Ankur A. Kulkarni , Jayakrishnan Unnikrishnan , Quanyan Zhu , Prashant Mehta , Sean Meyn , Adam Wierman

This paper employs physics-informed neural networks (PINNs) to solve Fisher's equation, a fundamental reaction-diffusion system with both simplicity and significance. The focus is on investigating Fisher's equation under conditions of large…

Machine Learning · Computer Science 2024-11-20 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

With rapid progress in deep learning, neural networks have been widely used in scientific research and engineering applications as surrogate models. Despite the great success of neural networks in fitting complex systems, two major…

Machine Learning · Computer Science 2023-06-13 Yuwen Deng , Wang Kang , Wei W. Xing

A classic approach for solving differential equations with neural networks builds upon neural forms, which employ the differential equation with a discretisation of the solution domain. Making use of neural forms for time-dependent…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Toni Schneidereit , Michael Breuß

A new penalty-free neural network method, PFNN-2, is presented for solving partial differential equations, which is a subsequent improvement of our previously proposed PFNN method [1]. PFNN-2 inherits all advantages of PFNN in handling the…

Numerical Analysis · Mathematics 2022-05-03 Hailong Sheng , Chao Yang

Solving differential equations efficiently and accurately sits at the heart of progress in many areas of scientific research, from classical dynamical systems to quantum mechanics. There is a surge of interest in using Physics-Informed…

Machine Learning · Computer Science 2022-07-06 Shaan Desai , Marios Mattheakis , Hayden Joy , Pavlos Protopapas , Stephen Roberts

Deep quantum neural networks may provide a promising way to achieve quantum learning advantage with noisy intermediate scale quantum devices. Here, we use deep quantum feedforward neural networks capable of universal quantum computation to…

Quantum Physics · Physics 2020-08-14 Zidu Liu , L. -M. Duan , Dong-Ling Deng

Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in…

High Energy Physics - Phenomenology · Physics 2009-10-28 Bernd A. Berg

The accurate numerical solution of partial differential equations is a central task in numerical analysis allowing to model a wide range of natural phenomena by employing specialized solvers depending on the scenario of application. Here,…

Numerical Analysis · Mathematics 2022-12-13 Moritz Reh , Martin Gärttner

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

Solving for detailed chemical kinetics remains one of the major bottlenecks for computational fluid dynamics simulations of reacting flows using a finite-rate-chemistry approach. This has motivated the use of fully connected artificial…

Computational Engineering, Finance, and Science · Computer Science 2021-10-11 Opeoluwa Owoyele , Pinaki Pal

This short, self-contained article seeks to introduce and survey continuous-time deep learning approaches that are based on neural ordinary differential equations (neural ODEs). It primarily targets readers familiar with ordinary and…

Machine Learning · Computer Science 2024-01-09 Lars Ruthotto

We propose Impatient Deep Neural Networks (DNNs) which deal with dynamic time budgets during application. They allow for individual budgets given a priori for each test example and for anytime prediction, i.e., a possible interruption at…

Computer Vision and Pattern Recognition · Computer Science 2016-10-11 Manuel Amthor , Erik Rodner , Joachim Denzler

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

Biological neural networks are often modeled as systems of coupled, nonlinear, ordinary or partial differential equations. The number of differential equations used to model a network increases with the size of the network and the level of…

Neurons and Cognition · Quantitative Biology 2022-08-09 Rishika Mohanta , Collins Assisi

Recently, there has been a lot of interest in using neural networks for solving partial differential equations. A number of neural network-based partial differential equation solvers have been formulated which provide performances…

Machine Learning · Computer Science 2020-04-21 Shehryar Malik , Usman Anwar , Ali Ahmed , Alireza Aghasi