English
Related papers

Related papers: Deep neural network approximation for high-dimensi…

200 papers

Partial differential equations play a fundamental role in the mathematical modelling of many processes and systems in physical, biological and other sciences. To simulate such processes and systems, the solutions of PDEs often need to be…

Numerical Analysis · Mathematics 2023-02-09 Tamara G. Grossmann , Urszula Julia Komorowska , Jonas Latz , Carola-Bibiane Schönlieb

In this paper, we leverage a recent deep kernel representer theorem to connect kernel based learning and (deep) neural networks in order to understand their interplay. In particular, we show that the use of special types of kernels yields…

Machine Learning · Computer Science 2025-09-19 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

This work investigates the electrical impedance tomography (EIT) problem when only limited boundary measurements are available, which is known to be challenging due to the extreme ill-posedness. Based on the direct sampling method (DSM), we…

Numerical Analysis · Mathematics 2020-09-18 Ruchi Guo , Jiahua Jiang

Deep neural networks (DNNs) have been widely applied to solve real-world regression problems. However, selecting optimal network structures remains a significant challenge. This study addresses this issue by linking neuron selection in DNNs…

Computation · Statistics 2025-09-30 Noah Yi-Ting Hung , Li-Hsiang Lin , Vince D. Calhoun

As a method of universal approximation deep neural networks (DNNs) are capable of finding approximate solutions to problems posed with little more constraints than a suitably-posed mathematical system and an objective function.…

Numerical Analysis · Mathematics 2022-03-02 D. W. Crews

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem…

Machine Learning · Computer Science 2023-01-02 Clara Lucía Galimberti , Luca Furieri , Liang Xu , Giancarlo Ferrari-Trecate

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

We demonstrate that deep neural networks with the ReLU activation function can efficiently approximate the solutions of various types of parametric linear transport equations. For non-smooth initial conditions, the solutions of these PDEs…

Numerical Analysis · Mathematics 2020-01-31 Fabian Laakmann , Philipp Petersen

Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays,…

Numerical Analysis · Mathematics 2024-11-14 Carlos Uriarte

We present a multidimensional deep learning implementation of a stochastic branching algorithm for the numerical solution of fully nonlinear PDEs. This approach is designed to tackle functional nonlinearities involving gradient terms of any…

Numerical Analysis · Mathematics 2023-09-12 Jiang Yu Nguwi , Guillaume Penent , Nicolas Privault

In this paper, an innovative Physical Model-driven Neural Network (PMNN) method is proposed to solve time-fractional differential equations. It establishes a temporal iteration scheme based on physical model-driven neural networks which…

Machine Learning · Computer Science 2023-10-10 Zhiying Ma , Jie Hou , Wenhao Zhu , Yaxin Peng , Ying Li

A state-of-the-art deep domain decomposition method (D3M) based on the variational principle is proposed for partial differential equations (PDEs). The solution of PDEs can be formulated as the solution of a constrained optimization…

Machine Learning · Computer Science 2020-04-03 Ke Li , Kejun Tang , Tianfan Wu , Qifeng Liao

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh

We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a…

Optimization and Control · Mathematics 2020-05-20 Lars Grüne

This paper proposes a deep-learning-based domain decomposition method (DeepDDM), which leverages deep neural networks (DNN) to discretize the subproblems divided by domain decomposition methods (DDM) for solving partial differential…

Numerical Analysis · Mathematics 2020-04-13 Wuyang Li , Xueshuang Xiang , Yingxiang Xu

We revisit the analogy between feed-forward deep neural networks (DNNs) and discrete dynamical systems derived from neural integral equations and their corresponding partial differential equation (PDE) forms. A comparative analysis between…

Machine Learning · Computer Science 2026-05-21 Abhisek Ganguly , Santosh Ansumali , Sauro Succi

Deep neural networks (DNN) have achieved unprecedented performance in computer-vision tasks almost ubiquitously in business, technology, and science. While substantial efforts are made to engineer highly accurate architectures and provide…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Sumedha Singla

In this paper we prove that rectified deep neural networks do not suffer from the curse of dimensionality when approximating McKean--Vlasov SDEs in the sense that the number of parameters in the deep neural networks only grows polynomially…

Numerical Analysis · Mathematics 2024-06-13 Ariel Neufeld , Tuan Anh Nguyen

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

Physics-informed neural networks (PINNs) have been demonstrated to be efficient in solving partial differential equations (PDEs) from a variety of experimental perspectives. Some recent studies have also proposed PINN algorithms for PDEs on…

Numerical Analysis · Mathematics 2024-08-06 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng , Ding-Xuan Zhou