English
Related papers

Related papers: On the stability of optimization algorithms given …

200 papers

This paper concerns an optimization algorithm for unconstrained non-convex problems where the objective function has sparse connections between the unknowns. The algorithm is based on applying a dissipation preserving numerical integrator,…

Optimization and Control · Mathematics 2018-09-26 Torbjørn Ringholm , Jasmina Lazić , Carola-Bibiane Schönlieb

This paper studies inf-sup stable finite element discretizations of the evolutionary Navier--Stokes equations with a grad-div type stabilization. The analysis covers both the case in which the solution is assumed to be smooth and…

Numerical Analysis · Mathematics 2017-05-29 Javier de Frutos , Bosco García-Archilla , Volker John , Julia Novo

This paper aims to investigate the numerical approximation of a general second order parabolic stochastic partial differential equation(SPDE) driven by multiplicative and additive noise under more relaxed conditions. The SPDE is discretized…

Numerical Analysis · Mathematics 2020-01-01 Antoine Tambue , Jean Daniel Mukam

This paper is concerned with developing and analyzing two novel implicit temporal discretization methods for the stochastic semilinear wave equations with multiplicative noise. The proposed methods are natural extensions of well-known…

Numerical Analysis · Mathematics 2024-08-26 Xiaobing Feng , Yukun Li , Liet Vo

We consider unconstrained minimization of smooth convex functions. We propose a novel variational perspective using forced Euler-Lagrange equation that allows for studying high-resolution ODEs. Through this, we obtain a faster convergence…

Optimization and Control · Mathematics 2023-11-06 Hoomaan Maskan , Konstantinos C. Zygalakis , Alp Yurtsever

We prove that the implicit time Euler scheme coupled with finite elements space discretization for the 2D Navier-Stokes equations on the torus subject to a random perturbation converges in $L^2(\Omega)$, and describe the rate of convergence…

Probability · Mathematics 2020-04-16 Hakima Bessaih , Annie Millet

This paper considers the implicit Euler discretization of Levant's arbitrary order robust exact differentiator in presence of sampled measurements. Existing implicit discretizations of that differentiator are shown to exhibit either…

Numerical Analysis · Mathematics 2024-08-02 Richard Seeber

Discrete gradient methods are geometric integration techniques that can preserve the dissipative structure of gradient flows. Due to the monotonic decay of the function values, they are well suited for general convex and nonconvex…

Optimization and Control · Mathematics 2024-07-17 Matthias J. Ehrhardt , Erlend S. Riis , Torbjørn Ringholm , Carola-Bibiane Schönlieb

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

The numerical solution of the Stokes equations on an evolving domain with a moving boundary is studied based on the arbitrary Lagrangian-Eulerian finite element method and a second-order projection method along the trajectories of the…

Numerical Analysis · Mathematics 2023-10-13 Qiqi Rao , Jilu Wang , Yupei Xie

Recent work on high-resolution ordinary differential equations (HR-ODEs) captures fine nuances among different momentum-based optimization methods, leading to accurate theoretical insights. However, these HR-ODEs often appear disconnected,…

Optimization and Control · Mathematics 2025-03-20 Hoomaan Maskan , Konstantinos C. Zygalakis , Armin Eftekhari , Alp Yurtsever

In this study, we investigate the performance of two novel first-order optimization algorithms, namely the rescaled-gradient flow (RGF) and the signed-gradient flow (SGF). These algorithms are derived from the forward Euler discretization…

Machine Learning · Computer Science 2025-03-19 Siqi Zhang , Mouhacine Benosman , Orlando Romero

We analyse errors of randomized explicit and implicit Euler schemes for approximate solving of ordinary differential equations (ODEs). We consider classes of ODEs for which the right-hand side functions satisfy Lipschitz condition globally…

Numerical Analysis · Mathematics 2021-05-03 Tomasz Bochacik , Paweł Przybyłowicz

We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…

Optimization and Control · Mathematics 2020-03-10 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

A popular and efficient discretization of evolutions involving the singular $p$-Laplace operator is based on a factorization of the differential operator into a linear part which is treated implicitly and a regularized singular factor which…

Numerical Analysis · Mathematics 2017-12-12 Sören Bartels , Lars Diening , Ricardo H. Nochetto

An efficient approximate version of implicit Taylor methods for initial-value problems of systems of ordinary differential equations (ODEs) is introduced. The approach, based on an approximate formulation of Taylor methods, produces a…

Numerical Analysis · Mathematics 2024-02-05 Antonio Baeza , Raimund Bürger , María del Carmen Martí , Pep Mulet , David Zorío

This paper aims to investigate the numerical approximation of semilinear non-autonomous stochastic partial differential equations (SPDEs) driven by multiplicative or additive noise. Such equations are more realistic than autonomous SPDEs…

Numerical Analysis · Mathematics 2020-11-18 Jean Daniel Mukam , Antoine Tambue

This study investigates the use of continuous-time dynamical systems for sparse signal recovery. The proposed dynamical system is in the form of a nonlinear ordinary differential equation (ODE) derived from the gradient flow of the Lasso…

Information Theory · Computer Science 2023-03-30 Tadashi Wadayama , Ayano Nakai-Kasai

This paper is concerned with the adaptive numerical treatment of stochastic partial differential equations. Our method of choice is Rothe's method. We use the implicit Euler scheme for the time discretization. Consequently, in each step, an…

Model-free reinforcement learning attempts to find an optimal control action for an unknown dynamical system by directly searching over the parameter space of controllers. The convergence behavior and statistical properties of these…

Optimization and Control · Mathematics 2021-03-17 Hesameddin Mohammadi , Armin Zare , Mahdi Soltanolkotabi , Mihailo R. Jovanović