English
Related papers

Related papers: Error analysis for the deep Kolmogorov method

200 papers

Machine learning techniques are being used as an alternative to traditional numerical discretization methods for solving hyperbolic partial differential equations (PDEs) relevant to fluid flow. Whilst numerical methods are higher fidelity,…

Fluid Dynamics · Physics 2025-05-29 R. G. Cassia , R. R. Kerswell

The ultimate goal of any numerical scheme for partial differential equations (PDEs) is to compute an approximation of user-prescribed accuracy at quasi-minimal computational time. To this end, algorithmically, the standard adaptive finite…

Numerical Analysis · Mathematics 2025-01-30 Philipp Bringmann , Michael Feischl , Ani Miraci , Dirk Praetorius , Julian Streitberger

The optimal Petrov-Galerkin formulation to solve partial differential equations (PDEs) recovers the best approximation in a specified finite-dimensional (trial) space with respect to a suitable norm. However, the recovery of this optimal…

In spite of the accomplishments of deep learning based algorithms in numerous applications and very broad corresponding research interest, at the moment there is still no rigorous understanding of the reasons why such algorithms produce…

Statistics Theory · Mathematics 2020-03-04 Arnulf Jentzen , Timo Welti

High-dimensional PDEs have been a longstanding computational challenge. We propose to solve high-dimensional PDEs by approximating the solution with a deep neural network which is trained to satisfy the differential operator, initial…

Mathematical Finance · Quantitative Finance 2018-10-17 Justin Sirignano , Konstantinos Spiliopoulos

Deep learning algorithms have been applied very successfully in recent years to a range of problems out of reach for classical solution paradigms. Nevertheless, there is no completely rigorous mathematical error and convergence analysis…

Numerical Analysis · Mathematics 2023-02-10 Christan Beck , Arnulf Jentzen , Benno Kuckuck

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

In this work we propose a deep adaptive sampling (DAS) method for solving partial differential equations (PDEs), where deep neural networks are utilized to approximate the solutions of PDEs and deep generative models are employed to…

Numerical Analysis · Mathematics 2022-07-06 Kejun Tang , Xiaoliang Wan , Chao Yang

Deep learning neural network technique (DNN) is one of the most efficient and general approach of multivariate data analysis of the collider experiments. The important step of the analysis is the optimization of the input space for…

High Energy Physics - Phenomenology · Physics 2020-08-26 Andrei Chernoded , Lev Dudko , Georgi Vorotnikov , Petr Volkov , Dmitri Ovchinnikov , Maxim Perfilov , Artem Shporin

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Recently, machine learning methods have gained significant traction in scientific computing, particularly for solving Partial Differential Equations (PDEs). However, methods based on deep neural networks (DNNs) often lack convergence…

Artificial Intelligence · Computer Science 2025-06-16 Li Liu , Heng Yong

We propose a novel numerical approach for nonlocal diffusion equations [8] with integrable kernels, based on the relationship between the backward Kolmogorov equation and backward stochastic differential equations (BSDEs) driven by L\`{e}vy…

Numerical Analysis · Mathematics 2015-07-28 Guannan Zhang , Weidong Zhao , Clayton Webster , Max Gunzburger

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

Machine Learning · Computer Science 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

We develop in this paper a multi-grade deep learning method for solving nonlinear partial differential equations (PDEs). Deep neural networks (DNNs) have received super performance in solving PDEs in addition to their outstanding success in…

Numerical Analysis · Mathematics 2023-09-15 Yuesheng Xu , Taishan Zeng

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

This work is concerned with the development of a family of Galerkin finite element methods for the classical Kolmogorov's equation. Kolmogorov's equation serves as a sufficiently rich, for our purposes, model problem for kinetic-type…

Numerical Analysis · Mathematics 2020-12-18 Emmanuil H. Georgoulis

We propose a new stabilised finite element method for the classical Kolmogorov equation. The latter serves as a basic model problem for large classes of kinetic-type equations and, crucially, is characterised by degenerate diffusion. The…

Numerical Analysis · Mathematics 2024-12-31 Zhaonan Dong , Emmanuil H. Georgoulis , Philip J. Herbert

The stochastic gradient descent (SGD) optimization algorithm plays a central role in a series of machine learning applications. The scientific literature provides a vast amount of upper error bounds for the SGD method. Much less attention…

Numerical Analysis · Mathematics 2020-10-05 Arnulf Jentzen , Philippe von Wurstemberger

We study an approximation method for partially observed Markov decision processes (POMDPs) with continuous spaces. Belief MDP reduction, which has been the standard approach to study POMDPs requires rigorous approximation methods for…

Optimization and Control · Mathematics 2025-01-20 Ali Devran Kara , Erhan Bayraktar , Serdar Yuksel

Differentially private stochastic gradient descent (DP-SGD) has become the standard algorithm for training machine learning models with rigorous privacy guarantees. Despite its widespread use, the theoretical understanding of its long-run…

Machine Learning · Computer Science 2025-11-21 Amartya Mukherjee , Jun Liu