中文
相关论文

相关论文: Deep ReLU neural networks overcome the curse of di…

200 篇论文

Recently, several deep learning (DL) methods for approximating high-dimensional partial differential equations (PDEs) have been proposed. The interest that these methods have generated in the literature is in large part due to simulations…

数值分析 · 数学 2026-04-30 Julia Ackermann , Arnulf Jentzen , Thomas Kruse , Benno Kuckuck , Joshua Lee Padgett

It is a challenging topic in applied mathematics to solve high-dimensional nonlinear partial differential equations (PDEs). Standard approximation methods for nonlinear PDEs suffer under the curse of dimensionality (COD) in the sense that…

机器学习 · 计算机科学 2024-06-18 Julia Ackermann , Arnulf Jentzen , Benno Kuckuck , Joshua Lee Padgett

In this paper we consider PIDEs with gradient-independent Lipschitz continuous nonlinearities and prove that deep neural networks with ReLU activation function can approximate solutions of such semilinear PIDEs without curse of…

数值分析 · 数学 2025-01-22 Ariel Neufeld , Tuan Anh Nguyen , Sizhou Wu

In recent years deep artificial neural networks (DNNs) have been successfully employed in numerical simulations for a multitude of computational problems including, for example, object and face recognition, natural language processing,…

数值分析 · 数学 2021-10-12 Arnulf Jentzen , Diyora Salimova , Timo Welti

We prove that multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation are capable of approximating solutions of semilinear Kolmogorov PDEs in $L^\mathfrak{p}$-sense, $\mathfrak{p}\in…

数值分析 · 数学 2026-03-24 Ariel Neufeld , Tuan Anh Nguyen

We demonstrate that deep neural networks with the ReLU activation function can efficiently approximate the solutions of various types of parametric linear transport equations. For non-smooth initial conditions, the solutions of these PDEs…

数值分析 · 数学 2020-01-31 Fabian Laakmann , Philipp Petersen

It is one of the most challenging issues in applied mathematics to approximately solve high-dimensional partial differential equations (PDEs) and most of the numerical approximation methods for PDEs in the scientific literature suffer from…

概率论 · 数学 2024-06-04 Fabian Hornung , Arnulf Jentzen , Diyora Salimova

We study the expression rates of deep neural networks (DNNs for short) for option prices written on baskets of $d$ risky assets, whose log-returns are modelled by a multivariate L\'evy process with general correlation structure of jumps. We…

数值分析 · 数学 2021-07-06 Lukas Gonon , Christoph Schwab

We study the properties of differentiable neural networks activated by rectified power unit (RePU) functions. We show that the partial derivatives of RePU neural networks can be represented by RePUs mixed-activated networks and derive upper…

机器学习 · 统计学 2024-04-23 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Jian Huang

In this article we identify a general class of high-dimensional continuous functions that can be approximated by deep neural networks (DNNs) with the rectified linear unit (ReLU) activation without the curse of dimensionality. In other…

数值分析 · 数学 2023-04-13 Adrian Riekert

In this article we study high-dimensional approximation capacities of shallow and deep artificial neural networks (ANNs) with the rectified linear unit (ReLU) activation. In particular, it is a key contribution of this work to reveal that…

数值分析 · 数学 2023-01-23 Lukas Gonon , Robin Graeber , Arnulf Jentzen

We prove that deep neural networks are capable of approximating solutions of semilinear Kolmogorov PDE in the case of gradient-independent, Lipschitz-continuous nonlinearities, while the required number of parameters in the networks grow at…

数值分析 · 数学 2022-05-31 Petru A. Cioica-Licht , Martin Hutzenthaler , P. Tobias Werner

Numerical experiments indicate that deep learning algorithms overcome the curse of dimensionality when approximating solutions of semilinear PDEs. For certain linear PDEs and semilinear PDEs with gradient-independent nonlinearities this has…

数值分析 · 数学 2024-09-24 Ariel Neufeld , Tuan Anh Nguyen

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

数值分析 · 数学 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

In this paper, we construct neural networks with ReLU, sine and $2^x$ as activation functions. For general continuous $f$ defined on $[0,1]^d$ with continuity modulus $\omega_f(\cdot)$, we construct ReLU-sine-$2^x$ networks that enjoy an…

机器学习 · 计算机科学 2022-08-16 Yuling Jiao , Yanming Lai , Xiliang Lu , Fengru Wang , Jerry Zhijian Yang , Yuanyuan Yang

This paper is devoted to studying the optimal expressive power of ReLU deep neural networks (DNNs) and its application in approximation via the Kolmogorov Superposition Theorem. We first constructively prove that any continuous piecewise…

机器学习 · 计算机科学 2023-08-11 Juncai He

On the forefront of scientific computing, Deep Learning (DL), i.e., machine learning with Deep Neural Networks (DNNs), has emerged a powerful new tool for solving Partial Differential Equations (PDEs). It has been observed that DNNs are…

机器学习 · 计算机科学 2025-11-12 Simone Brugiapaglia , Nick Dexter , Samir Karam , Weiqi Wang

This paper proposes a Kolmogorov high order deep neural network (K-HOrderDNN) for solving high-dimensional partial differential equations (PDEs), which improves the high order deep neural networks (HOrderDNNs). HOrderDNNs have been…

数值分析 · 数学 2025-05-09 Yaqin Zhang , Ke Li , Zhipeng Chang , Xuejiao Liu , Yunqing Huang , Xueshuang Xiang

Recent theoretical work has demonstrated that deep neural networks have superior performance over shallow networks, but their training is more difficult, e.g., they suffer from the vanishing gradient problem. This problem can be typically…

机器学习 · 统计学 2021-11-03 Lu Lu , Yanhui Su , George Em Karniadakis

Implementing deep neural networks for learning the solution maps of parametric partial differential equations (PDEs) turns out to be more efficient than using many conventional numerical methods. However, limited theoretical analyses have…

数值分析 · 数学 2022-08-31 Zhen Lei , Lei Shi , Chenyu Zeng
‹ 上一页 1 2 3 10 下一页 ›