English
Related papers

Related papers: Design and convergence analysis of numerical metho…

200 papers

Stability and convergence of full discretizations of various surface evolution equations are studied in this paper. The proposed discretization combines a higher-order evolving-surface finite element method (ESFEM) for space discretization…

Numerical Analysis · Mathematics 2018-02-08 Balázs Kovács , Christian Lubich

We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single-layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides…

Machine Learning · Computer Science 2022-03-28 Francesca Mignacco , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

The aim of this work is to devise and analyse an accurate numerical scheme to solve Erd\'elyi-Kober fractional diffusion equation. This solution can be thought as the marginal pdf of the stochastic process called the generalized grey…

Numerical Analysis · Mathematics 2022-02-15 Łukasz Płociniczak , Mateusz Świtała

We consider numerical schemes for computing the linear response of steady-state averages of stochastic dynamics with respect to a perturbation of the drift part of the stochastic differential equation. The schemes are based on Girsanov's…

Numerical Analysis · Mathematics 2019-12-18 Petr Plechac , Gabriel Stoltz , Ting Wang

Dynamical low-rank approximation (DLRA) is an emerging tool for reducing computational costs and provides memory savings when solving high-dimensional problems. In this work, we propose and analyze a semi-implicit dynamical low-rank…

Numerical Analysis · Mathematics 2023-08-14 Peimeng Yin , Eirik Endeve , Cory D. Hauck , Stefan R. Schnake

We propose and analyse numerical schemes for a system of quasilinear, degenerate evolution equations modelling biofilm growth as well as other processes such as flow through porous media and the spreading of wildfires. The first equation in…

Numerical Analysis · Mathematics 2024-04-05 R. K. H. Smeets , K. Mitra , I. S. Pop , S. Sonner

Optimization problem, which is aimed at finding the global minimal value of a given cost function, is one of the central problem in science and engineering. Various numerical methods have been proposed to solve this problem, among which the…

Optimization and Control · Mathematics 2022-10-07 Shaojun Dong , Fengyu Le , Meng Zhang , Si-Jing Tao , Chao Wang , Yong-Jian Han , Guo-Ping Guo

In this paper, we develop a class of high order conservative semi-Lagrangian (SL) discontinuous Galerkin (DG) methods for solving multi-dimensional linear transport equations. The methods rely on a characteristic Galerkin weak formulation,…

Numerical Analysis · Mathematics 2017-09-25 Xiaofeng Cai , Wei Guo , Jing-Mei Qiu

We consider a variant of the stochastic gradient descent (SGD) with a random learning rate and reveal its convergence properties. SGD is a widely used stochastic optimization algorithm in machine learning, especially deep learning. Numerous…

Machine Learning · Statistics 2025-09-09 Naoki Yoshida , Shogo Nakakita , Masaaki Imaizumi

Numerically solving high-dimensional partial differential equations (PDEs) is a major challenge. Conventional methods, such as finite difference methods, are unable to solve high-dimensional PDEs due to the curse-of-dimensionality. A…

Numerical Analysis · Mathematics 2023-05-11 Deqing Jiang , Justin Sirignano , Samuel N. Cohen

In this article, a stochastic gradient based online learning algorithm for Extreme Learning Machines (ELM) is developed (SG-ELM). A stability criterion based on Lyapunov approach is used to prove both asymptotic stability of estimation…

Neural and Evolutionary Computing · Computer Science 2015-01-19 Vijay Manikandan Janakiraman , XuanLong Nguyen , Dennis Assanis

We demonstrate the large deviation principle in the small noise limit for the mild solution of stochastic evolution equations with monotone nonlinearity. A recently developed method, weak convergent method, has been employed in studying the…

Probability · Mathematics 2013-09-10 Hassan Dadashi

We consider a fully discretized numerical scheme for parabolic stochastic partial differential equations with multiplicative noise. Our abstract framework can be applied to formulate a non-iterative domain decomposition approach. Such…

Numerical Analysis · Mathematics 2024-12-16 Monika Eisenmann , Eskil Hansen , Marvin Jans

We present a structure-preserving Eulerian algorithm for solving $L^2$-gradient flows and a structure-preserving Lagrangian algorithm for solving generalized diffusions. Both algorithms employ neural networks as tools for spatial…

Numerical Analysis · Mathematics 2024-04-16 Ziqing Hu , Chun Liu , Yiwei Wang , Zhiliang Xu

High-dimensional PDEs have been a longstanding computational challenge. We propose to solve high-dimensional PDEs by approximating the solution with a deep neural network which is trained to satisfy the differential operator, initial…

Mathematical Finance · Quantitative Finance 2018-10-17 Justin Sirignano , Konstantinos Spiliopoulos

Critical points of energy functionals, which are of broad interest, for instance, in physics and chemistry, in solid and quantum mechanics, in material science, or in general diffusion-reaction models arise as solutions to the associated…

Numerical Analysis · Mathematics 2025-10-20 Pascal Heid , Thomas P. Wihler

In this paper, we study the convergence analysis for a robust stochastic structure-preserving Lagrangian numerical scheme in computing effective diffusivity of time-dependent chaotic flows, which are modeled by stochastic differential…

Numerical Analysis · Mathematics 2021-06-03 Zhongjian Wang , Jack Xin , Zhiwen Zhang

We extend the Deep Galerkin Method (DGM) introduced in Sirignano and Spiliopoulos (2018)} to solve a number of partial differential equations (PDEs) that arise in the context of optimal stochastic control and mean field games. First, we…

Computational Finance · Quantitative Finance 2022-04-20 Ali Al-Aradi , Adolfo Correia , Danilo de Frietas Naiff , Gabriel Jardim , Yuri Saporito

Greedy Sampling Methods (GSMs) are widely used to construct approximate solutions of Configuration Optimization Problems (COPs), where a loss functional is minimized over finite configurations of points in a compact domain. While effective…

Optimization and Control · Mathematics 2026-01-09 Evie Nielen , Oliver Tse

The generalized linear model (GLM) plays a key role in regression analyses. In high-dimensional data, the sparse GLM has been used but it is not robust against outliers. Recently, the robust methods have been proposed for the specific…

Machine Learning · Statistics 2026-05-15 Takayuki Kawashima , Hironori Fujisawa