English
Related papers

Related papers: Error estimates of deep learning methods for the n…

200 papers

Deep neural networks (DNNs) have significantly advanced machine learning, with model depth playing a central role in their successes. The dynamical system modeling approach has recently emerged as a powerful framework, offering new…

Machine Learning · Computer Science 2026-02-25 Jinshu Huang , Mingfei Sun , Chunlin Wu

In this work we consider a model problem of deep neural learning, namely the learning of a given function when it is assumed that we have access to its point values on a finite set of points. The deep neural network interpolant is the the…

Machine Learning · Statistics 2023-06-27 Michail Loulakis , Charalambos G. Makridakis

We introduce a new second-order inertial optimization method for machine learning called INNA. It exploits the geometry of the loss function while only requiring stochastic approximations of the function values and the generalized…

Machine Learning · Computer Science 2021-08-17 Camille Castera , Jérôme Bolte , Cédric Févotte , Edouard Pauwels

We propose a novel deep learning approach to nonparametric statistical inference for the conditional hazard function of survival time with right-censored data. We use a deep neural network (DNN) to approximate the logarithm of a conditional…

Methodology · Statistics 2024-10-24 Wen Su , Kin-Yat Liu , Guosheng Yin , Jian Huang , Xingqiu Zhao

Nonlinear differential equations are challenging to solve numerically and are important to understanding the dynamics of many physical systems. Deep neural networks have been applied to help alleviate the computational cost that is…

Numerical Analysis · Mathematics 2020-10-27 Bryce Chudomelka , Youngjoon Hong , Hyunwoo Kim , Jinyoung Park

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Recently, many studies have shed light on the high adaptivity of deep neural network methods in nonparametric regression models, and their superior performance has been established for various function classes. Motivated by this…

Statistics Theory · Mathematics 2023-07-04 Akihiro Oga , Yuta Koike

Deep Neural Networks (DNNs) are becoming integral components of real world services relied upon by millions of users. Unfortunately, architects of these systems can find it difficult to ensure reliable performance as irrelevant details like…

Machine Learning · Computer Science 2023-05-22 Arghya Datta , Subhrangshu Nandi , Jingcheng Xu , Greg Ver Steeg , He Xie , Anoop Kumar , Aram Galstyan

Identifying hidden dynamics from observed data is a significant and challenging task in a wide range of applications. Recently, the combination of linear multistep methods (LMMs) and deep learning has been successfully employed to discover…

Numerical Analysis · Mathematics 2022-09-14 Qiang Du , Yiqi Gu , Haizhao Yang , Chao Zhou

The advent of fast sensing technologies allows for real-time model updates in many applications where the model parameters are uncertain. Bayesian algorithms, such as ensemble smoothers, offer a real-time probabilistic inversion accounting…

Geophysics · Physics 2022-05-26 Muzammil Hussain Rammay , Sergey Alyaev , Ahmed H Elsheikh

For the nonlinear Richards equation as an unsaturated flow through heterogeneous media, we build a new coarse-scale approximation algorithm utilizing numerical homogenization. This approach follows deep neural networks (DNNs) to quickly and…

Numerical Analysis · Mathematics 2023-05-23 Sergei Stepanov , Denis Spiridonov , Tina Mai

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

In this work, we consider an inverse potential problem in the parabolic equation, where the unknown potential is a space-dependent function and the used measurement is the final time data. The unknown potential in this inverse problem is…

Numerical Analysis · Mathematics 2023-07-28 Mengmeng Zhang , Zhidong Zhang

In this paper, we consider a numerical homogenization of the poroelasticity problem with stochastic properties. The proposed method based on the construction of the deep neural network (DNN) for fast calculation of the effective properties…

Numerical Analysis · Mathematics 2018-10-04 Maria Vasilyeva , Aleksey Tyrylgin

There have been extensive studies on solving differential equations using physics-informed neural networks. While this method has proven advantageous in many cases, a major criticism lies in its lack of analytical error bounds. Therefore,…

Neural and Evolutionary Computing · Computer Science 2022-07-05 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

This paper aims to accelerate the test-time computation of deep convolutional neural networks (CNNs). Unlike existing methods that are designed for approximating linear filters or linear responses, our method takes the nonlinear units into…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Xiangyu Zhang , Jianhua Zou , Xiang Ming , Kaiming He , Jian Sun

We explore the suitability of deep learning to capture the physics of subgrid-scale ideal magnetohydrodynamics turbulence of 2-D simulations of the magnetized Kelvin-Helmholtz instability. We produce simulations at different resolutions to…

Computational Physics · Physics 2020-08-27 Shawn G. Rosofsky , E. A. Huerta

Generalization error bounds for deep neural networks trained by stochastic gradient descent (SGD) are derived by combining a dynamical control of an appropriate parameter norm and the Rademacher complexity estimate based on parameter norms.…

Machine Learning · Computer Science 2023-05-30 Mingze Wang , Chao Ma

We derive quantitative error bounds for deep neural networks (DNNs) approximating option prices on a $d$-dimensional risky asset as functions of the underlying model parameters, payoff parameters and initial conditions. We cover a general…

Mathematical Finance · Quantitative Finance 2023-09-27 Francesca Biagini , Lukas Gonon , Niklas Walter

We introduce a coarse-grained deep neural network model (CG-DNN) for liquid water that utilizes 50 rotational and translational invariant coordinates, and is trained exclusively against energies of ~30,000 bulk water configurations. Our…