Related papers: Design and convergence analysis of numerical metho…
We consider Galerkin finite element methods for semilinear stochastic partial differential equations (SPDEs) with multiplicative noise and Lipschitz continuous nonlinearities. We analyze the strong error of convergence for spatially…
A time-stepping L1 scheme for subdiffusion equation with a Riemann--Liouville time-fractional derivative is developed and analyzed. This is the first paper to show that the L1 scheme for the model problem under consideration is second-order…
We present recent finite element numerical results on a model convection-diffusion problem in the singular perturbed case when the convection term dominates the problem. We compare the standard Galerkin discretization using the linear…
This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…
Using the weak convergence approach, we prove the large deviation principle (LDP) for solutions to quasilinear stochastic evolution equations with small Gaussian noise in the critical variational setting, a recently developed general…
Two numerical methods with graded temporal grids are analyzed for fractional evolution equations. One is a low-order discontinuous Galerkin (DG) discretization in the case of fractional order $0<\alpha<1$, and the other one is a low-order…
We study the acceleration of the Local Polynomial Interpolation-based Gradient Descent method (LPI-GD) recently proposed for the approximate solution of empirical risk minimization problems (ERM). We focus on loss functions that are…
This paper presents an Euler--Lagrange system for a continuous-time model of the accelerated gradient methods in smooth convex optimization and proposes an associated Lyapunov-function-based convergence analysis framework. Recently,…
In this work, we present the convergence analysis of one-point large deviations rate functions (LDRFs) of the spatial finite difference method (FDM) for stochastic wave equations with small noise, which is essentially about the asymptotical…
The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have…
This paper investigates the problems large-scale distributed composite convex optimization, with motivations from a broad range of applications, including multi-agent systems, federated learning, smart grids, wireless sensor networks,…
Differentially Private Stochastic Gradient Descent (DP-SGD) has been widely used for solving optimization problems with privacy guarantees in machine learning and statistics. Despite this, a systematic non-asymptotic convergence analysis…
Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…
A new simple Lagrangian method with favorable stability and efficiency properties for computing general plane curve evolutions is presented. The method is based on the flowing finite volume discretization of the intrinsic partial…
Gradient normalization and soft clipping are two popular techniques for tackling instability issues and improving convergence of stochastic gradient descent (SGD) with momentum. In this article, we study these types of methods through the…
We develop a fully discrete, semi-implicit mixed finite element method for approximating solutions to a class of fourth-order stochastic partial differential equations (SPDEs) with non-globally Lipschitz and non-monotone nonlinearities,…
Convection-diffusion-reaction equations are a class of second-order partial differential equations widely used to model phenomena involving the change of concentration/population of one or more substances/species distributed in space.…
A gradient discretisation method (GDM), Gradient schemes, Convergence analysis, Existence of weak solutions, Anisotropic reaction diffusion models, Dirichlet and Neumann boundary conditions, Non conforming finite element methods, Finite…
Stochastic Gradient Descent-Ascent (SGDA) is one of the most prominent algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. The success of the method led to…
The numerical solution of time-dependent radiative transfer problems is challenging, both, due to the high dimension as well as the anisotropic structure of the underlying integro-partial differential equation. In this paper we propose a…