English
Related papers

Related papers: Deep neural network approximations for Monte Carlo…

200 papers

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a…

Optimization and Control · Mathematics 2020-05-20 Lars Grüne

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

We develop several deep learning algorithms for approximating families of parametric PDE solutions. The proposed algorithms approximate solutions together with their gradients, which in the context of mathematical finance means that the…

Computational Finance · Quantitative Finance 2022-01-19 Marc Sabate Vidales , David Siska , Lukasz Szpruch

In this paper, we study the error in first order Sobolev norm in the approximation of solutions to linear parabolic PDEs. We use a Monte Carlo Euler scheme obtained from combining the Feynman--Kac representation with a Euler discretization…

Numerical Analysis · Mathematics 2023-06-30 Patrick Cheridito , Florian Rossmannek

A burgeoning line of research leverages deep neural networks to approximate the solutions to high dimensional PDEs, opening lines of theoretical inquiry focused on explaining how it is that these models appear to evade the curse of…

Machine Learning · Computer Science 2023-03-28 Tanya Marwah , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

In this paper, we establish that for a wide class of controlled stochastic differential equations (SDEs) with stiff coefficients, the value functions of corresponding zero-sum games can be represented by a deep artificial neural network…

Numerical Analysis · Mathematics 2020-05-14 Christoph Reisinger , Yufei Zhang

Deep neural networks (DNNs) achieve impressive results for complicated tasks like object detection on images and speech recognition. Motivated by this practical success, there is now a strong interest in showing good theoretical properties…

Machine Learning · Statistics 2020-06-16 Michael Kohler , Adam Krzyzak , Sophie Langer

Learning approximations to smooth target functions of many variables from finite sets of pointwise samples is an important task in scientific computing and its many applications in computational science and engineering. Despite well over…

Numerical Analysis · Mathematics 2024-04-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

In recent years residual neural networks (ResNets) as introduced by [He, K., Zhang, X., Ren, S., and Sun, J., Proceedings of the IEEE conference on computer vision and pattern recognition (2016), 770-778] have become very popular in a large…

Numerical Analysis · Mathematics 2021-11-02 Jonas Baggenstos , Diyora Salimova

We explain how to use Kolmogorov Superposition Theorem (KST) to break the curse of dimensionality when approximating a dense class of multivariate continuous functions. We first show that there is a class of functions called…

Numerical Analysis · Mathematics 2025-10-06 Ming-Jun Lai , Zhaiming Shen

The development of new classification and regression algorithms based on empirical risk minimization (ERM) over deep neural network hypothesis classes, coined deep learning, revolutionized the area of artificial intelligence, machine…

Machine Learning · Computer Science 2020-11-12 Julius Berner , Philipp Grohs , Arnulf Jentzen

We present polynomial-augmented neural networks (PANNs), a novel machine learning architecture that combines deep neural networks (DNNs) with a polynomial approximant. PANNs combine the strengths of DNNs (flexibility and efficiency in…

Machine Learning · Computer Science 2025-02-25 Madison Cooley , Shandian Zhe , Robert M. Kirby , Varun Shankar

We present approximation results and numerical experiments for the use of randomized neural networks within physics-informed extreme learning machines to efficiently solve high-dimensional PDEs, demonstrating both high accuracy and low…

Numerical Analysis · Mathematics 2025-01-22 T. De Ryck , S. Mishra , Y. Shang , F. Wang

Recent experiments have shown that deep networks can approximate solutions to high-dimensional PDEs, seemingly escaping the curse of dimensionality. However, questions regarding the theoretical basis for such approximations, including the…

Machine Learning · Computer Science 2021-07-07 Tanya Marwah , Zachary C. Lipton , Andrej Risteski

In this work, we study the approximation of expected values of functional quantities on the solution of a stochastic differential equation (SDE), where we replace the Monte Carlo estimation with the evaluation of a deep neural network. Once…

Numerical Analysis · Mathematics 2021-02-18 Thomas Gerstner , Bastian Harrach , Daniel Roth , Martin Simon

Deep neural networks have been widely used as universal approximators for functions with inherent physical structures, including permutation symmetry. In this paper, we construct symmetric deep neural networks to approximate symmetric…

Machine Learning · Computer Science 2025-11-18 Yulong Lu , Tong Mao , Jinchao Xu , Yahong Yang

In this dissertation we study the tractability of the information-based complexity $n(\varepsilon,d)$ for $d$-variate function approximation problems. In the deterministic setting for many unweighted problems the curse of dimensionality…

Numerical Analysis · Mathematics 2017-04-27 Robert J. Kunsch

In this paper, we establish a neural network to approximate functionals, which are maps from infinite dimensional spaces to finite dimensional spaces. The approximation error of the neural network is $O(1/\sqrt{m})$ where $m$ is the size of…

Numerical Analysis · Mathematics 2023-01-02 Yahong Yang , Yang Xiang

Recently a number of papers have suggested using neural-networks in order to approximate policy functions in DSGE models, while avoiding the curse of dimensionality, which for example arises when solving many HANK models, and while…

Theoretical Economics · Economics 2023-10-23 Emmet Hall-Hoffarth