English
Related papers

Related papers: On the stability of optimization algorithms given …

200 papers

We study the strong approximation of the solutions to singular stochastic kinetic equations (also referred to as second-order SDEs) driven by $\alpha$-stable processes, using an Euler-type scheme inspired by [11]. For these equations, the…

Probability · Mathematics 2025-11-18 Chengcheng Ling

We present a new efficient computational approach for time-dependent first-order Hamilton-Jacobi-Bellman PDEs. Since our method is based on a time-implicit Eulerian discretization, the numerical scheme is unconditionally stable, but…

Numerical Analysis · Mathematics 2013-06-18 Alexander Vladimirsky , Changxi Zheng

We prove the convergence of certain second-order numerical methods to weak solutions of the Navier-Stokes equations satisfying in addition the local energy inequality, and therefore suitable in the sense of Scheffer and…

Numerical Analysis · Mathematics 2022-03-02 Luigi C. Berselli , Stefano Spirito

We develop in this paper a new framework for discrete calculus of variations when the actions have densities involving an arbitrary discretization operator. We deduce the discrete Euler-Lagrange equations for piecewise continuous critical…

Optimization and Control · Mathematics 2011-06-28 Philippe Ryckelynck , Laurent Smoch

Learning neural ODEs often requires solving very stiff ODE systems, primarily using explicit adaptive step size ODE solvers. These solvers are computationally expensive, requiring the use of tiny step sizes for numerical stability and…

This paper deals with the backward Euler method applied to semilinear parabolic stochastic partial differential equations (SPDEs) driven by additive noise. The SPDE is discretized in space by the finite element method and in time by the…

Numerical Analysis · Mathematics 2020-01-01 Jean Daniel Mukam , Antoine Tambue

Canards are a well-studied phenomenon in fast-slow ordinary differential equations implying the delayed loss of stability after the slow passage through a singularity. Recent studies have shown that the corresponding maps stemming from…

Dynamical Systems · Mathematics 2023-04-19 Maximilian Engel , Georg A. Gottwald

Accurate simulations of ice sheet dynamics, mantle convection, lava flow, and other highly viscous free-surface flows involve solving the coupled Stokes/free-surface equations. In this paper, we theoretically analyze the stability and…

Numerical Analysis · Mathematics 2025-06-13 Igor Tominec , Lukas Lundgren , André Löfgren , Josefin Ahlkrona

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

This paper investigates the convex optimization problem with general convex inequality constraints. To cope with this problem, a discrete-time algorithm, called augmented primal-dual gradient algorithm (Aug-PDG), is studied and analyzed. It…

Optimization and Control · Mathematics 2020-11-18 Min Meng , Xiuxian Li

We present a coupled system of ODEs which, when discretized with a constant time step/learning rate, recovers Nesterov's accelerated gradient descent algorithm. The same ODEs, when discretized with a decreasing learning rate, leads to novel…

Optimization and Control · Mathematics 2020-09-02 Maxime Laborde , Adam M. Oberman

We consider a numerical approximation of a linear quadratic control problem constrained by the stochastic heat equation with non-homogeneous Neumann boundary conditions. This involves a combination of distributed and boundary control, as…

Numerical Analysis · Mathematics 2021-09-28 Peter Benner , Tony Stillfjord , Christoph Trautwein

We study the problem of zero-order optimization of a strongly convex function. The goal is to find the minimizer of the function by a sequential exploration of its values, under measurement noise. We study the impact of higher order…

Machine Learning · Computer Science 2022-11-28 Arya Akhavan , Massimiliano Pontil , Alexandre B. Tsybakov

In this paper, the entropy conservative/stable algorithms presented by Del Rey Fernandez and coauthors [18,16,17] for the compressible Euler and Navier-Stokes equations on nonconforming p-refined/coarsened curvilinear grids is extended to…

Numerical Analysis · Mathematics 2019-10-08 David C. Del Rey Fernandez , Mark H. Carpenter , Lisandro Dalcin , Stefano Zampini , Matteo Parsani

We present a robust and accurate discretization approach for incompressible turbulent flows based on high-order discontinuous Galerkin methods. The DG discretization of the incompressible Navier-Stokes equations uses the local…

Fluid Dynamics · Physics 2018-08-01 Niklas Fehn , Wolfgang A Wall , Martin Kronbichler

We develop a rigorous theory for a structure-preserving discretisation of the incompressible Euler and Navier--Stokes equations, based on discrete exterior calculus on prismatic Delaunay--Voronoi meshes over closed Riemannian manifolds. The…

Analysis of PDEs · Mathematics 2026-05-22 Peter Korn

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

Driven by the challenging task of finding robust discretization methods for Galbrun's equation, we investigate conditions for stability and different aspects of robustness for different finite element schemes on a simplified version of the…

Numerical Analysis · Mathematics 2022-06-01 Tilman Alemán , Martin Halla , Christoph Lehrenfeld , Paul Stocker

Neural-ODE parameterize a differential equation using continuous depth neural network and solve it using numerical ODE-integrator. These models offer a constant memory cost compared to models with discrete sequence of hidden layers in which…

Machine Learning · Computer Science 2025-03-27 Sheikh Waqas Akhtar

We propose a method to enhance the stability of a neural ordinary differential equation (neural ODE) by reducing the maximum error growth subsequent to a perturbation of the initial value. Since the stability depends on the logarithmic norm…

Numerical Analysis · Mathematics 2025-08-13 Arturo De Marinis , Nicola Guglielmi , Stefano Sicilia , Francesco Tudisco
‹ Prev 1 4 5 6 7 8 10 Next ›