English
Related papers

Related papers: Multi-scale Deep Neural Network (MscaleDNN) for So…

200 papers

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

Machine Learning · Computer Science 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

Deep Neural Networks (DNNs) have become very popular for prediction in many areas. Their strength is in representation with a high number of parameters that are commonly learned via gradient descent or similar optimization methods. However,…

Machine Learning · Statistics 2016-10-11 Anthony Caterini , Dong Eui Chang

Deep neural networks (DNNs) have demonstrated remarkable empirical performance in large-scale supervised learning problems, particularly in scenarios where both the sample size $n$ and the dimension of covariates $p$ are large. This study…

Machine Learning · Statistics 2024-07-12 Yuqian Zhang , Jelena Bradic

Deep learning has achieved great success in modeling dynamical systems, providing data-driven simulators to predict complex phenomena, even without known governing equations. However, existing models have two major limitations: their narrow…

Machine Learning · Computer Science 2024-10-16 Razmik Arman Khosrovian , Takaharu Yaguchi , Hiroaki Yoshimura , Takashi Matsubara

In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only…

Numerical Analysis · Mathematics 2024-04-15 Lorenc Kapllani , Long Teng

Deep neural networks (DNNs) on Riemannian manifolds have garnered increasing interest in various applied areas. For instance, DNNs on spherical and hyperbolic manifolds have been designed to solve a wide range of computer vision and nature…

Machine Learning · Statistics 2026-01-06 Xuan Son Nguyen , Shuo Yang , Aymeric Histace

Recent work has introduced a simple numerical method for solving partial differential equations (PDEs) with deep neural networks (DNNs). This paper reviews and extends the method while applying it to analyze one of the most fundamental…

Machine Learning · Computer Science 2019-05-14 Craig Michoski , Milos Milosavljevic , Todd Oliver , David Hatch

We present approximation results and numerical experiments for the use of randomized neural networks within physics-informed extreme learning machines to efficiently solve high-dimensional PDEs, demonstrating both high accuracy and low…

Numerical Analysis · Mathematics 2025-01-22 T. De Ryck , S. Mishra , Y. Shang , F. Wang

Deep neural networks (DNN) have been used successfully in many scientific problems for their high prediction accuracy, but their application to genetic studies remains challenging due to their poor interpretability. In this paper, we…

Machine Learning · Computer Science 2021-10-01 Peyman H. Kassani , Fred Lu , Yann Le Guen , Zihuai He

Many scientific and industrial applications require solving Partial Differential Equations (PDEs) to describe the physical phenomena of interest. Some examples can be found in the fields of aerodynamics, astrodynamics, combustion and many…

Computational Physics · Physics 2019-12-11 Juan B. Pedro , Juan Maroñas , Roberto Paredes

Recently proposed numerical algorithms for solving high-dimensional nonlinear partial differential equations (PDEs) based on neural networks have shown their remarkable performance. We review some of them and study their convergence…

Analysis of PDEs · Mathematics 2021-09-17 Maximilien Germain , Huyen Pham , Xavier Warin

Neural Networks (NNs) can be used to solve Ordinary and Partial Differential Equations (ODEs and PDEs) by redefining the question as an optimization problem. The objective function to be optimized is the sum of the squares of the PDE to be…

Machine Learning · Computer Science 2021-03-17 Veronica Guidetti , Francesco Muia , Yvette Welling , Alexander Westphal

This work investigates the electrical impedance tomography (EIT) problem when only limited boundary measurements are available, which is known to be challenging due to the extreme ill-posedness. Based on the direct sampling method (DSM), we…

Numerical Analysis · Mathematics 2020-09-18 Ruchi Guo , Jiahua Jiang

Diffractive neural networks leverage the high-dimensional characteristics of electromagnetic (EM) fields for high-throughput computing. However, the existing architectures face challenges in integrating large-scale multidimensional…

Optics · Physics 2025-09-09 Songtao Yang , Sheng Gao , Chu Wu , Zejia Zhao , Haiou Zhang , Xing Lin

Recently, it has been proposed in the literature to employ deep neural networks (DNNs) together with stochastic gradient descent methods to approximate solutions of PDEs. There are also a few results in the literature which prove that DNNs…

Numerical Analysis · Mathematics 2022-06-29 Philipp Grohs , Arnulf Jentzen , Diyora Salimova

The structure and weights of Deep Neural Networks (DNN) typically encode and contain very valuable information about the dataset that was used to train the network. One way to protect this information when DNN is published is to perform an…

Cryptography and Security · Computer Science 2021-04-29 Philip Derbeko , Shlomi Dolev

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

With the rapid advancement of graphical processing units, Physics-Informed Neural Networks (PINNs) are emerging as a promising tool for solving partial differential equations (PDEs). However, PINNs are not well suited for solving PDEs with…

Machine Learning · Computer Science 2024-05-28 Yuxiang Gao , Soheil Kolouri , Ravindra Duddu

Nonlinear partial differential equations (PDEs) are used to model dynamical processes in a large number of scientific fields, ranging from finance to biology. In many applications standard local models are not sufficient to accurately…

Numerical Analysis · Mathematics 2022-05-10 Victor Boussange , Sebastian Becker , Arnulf Jentzen , Benno Kuckuck , Loïc Pellissier

Neural network based methods have emerged as a promising paradigm for scientific computing, yet they face critical bottlenecks in high frequency function approximation and partial differential equation (PDE) solving.

Numerical Analysis · Mathematics 2026-04-06 Xuyang Gao , Liang Chen , Minqiang Xu , Jing Niu