English
Related papers

Related papers: Numerical methods that preserve a Lyapunov functio…

200 papers

We combine the recent relaxation approach with multiderivative Runge-Kutta methods to preserve conservation or dissipation of entropy functionals for ordinary and partial differential equations. Relaxation methods are minor modifications of…

Numerical Analysis · Mathematics 2024-06-19 Hendrik Ranocha , Jochen Schütz

A general procedure for constructing conservative numerical integrators for time dependent partial differential equations is presented. In particular, linearly implicit methods preserving a time discretised version of the invariant is…

Numerical Analysis · Mathematics 2011-05-05 Morten Dahlby , Brynjulf Owren

We propose a novel algorithmic method for constructing invariant variational schemes of systems of ordinary differential equations that are the Euler-Lagrange equations of a variational principle. The method is based on the invariantization…

Numerical Analysis · Mathematics 2021-09-28 Alex Bihlo , James Jackaman , Francis Valiquette

We present a new class of exponential integrators for ordinary differential equations. They are locally exact, i.e., they preserve the linearization of the original system at every point. Their construction consists in modifying existing…

Numerical Analysis · Mathematics 2011-04-08 Jan L. Cieśliński

The existing discrete variational derivative method is only second-order accurate and fully implicit. In this paper, we propose a framework to construct an arbitrary high-order implicit (original) energy stable scheme and a second-order…

Numerical Analysis · Mathematics 2022-10-24 Jizu Huang

Systems with predetermined Lyapunov functions play an important role in many areas of applied mathematics, physics and engineering: dynamic optimization methods (objective functions and their modifications), machine learning (loss…

Dynamical Systems · Mathematics 2024-10-17 Sergey V. Stasenko , Alexander N. Kirdin

For many problems, some of which are reviewed in the paper, popular algorithms like Douglas--Rachford (DR), ADMM, and FISTA produce approximating sequences that show signs of spiraling toward the solution. We present a meta-algorithm that…

Optimization and Control · Mathematics 2022-09-09 Scott B. Lindstrom

In this paper, we consider the initial value problem for some nonlinear second-order ODEs of Duffing type. We study the large time behavior of the solutions to this problem, from both the perspectives of mathematical and numerical analysis.…

Classical Analysis and ODEs · Mathematics 2025-04-03 Yusuke Kunimoto , Ikki Fukuda

We propose discrete mappings of second order that have a discrete analogue of Lyapunov function. The mappings are extensions of the integrable Quispel-Roberts-Thompson (QRT) mapping, and a discrete Lyapunov function of the mappings is…

Exactly Solvable and Integrable Systems · Physics 2009-11-11 Hironori Inoue , Daisuke Takahashi , Junta Matsukidaira

We present effective numerical algorithms for locally recovering unknown governing differential equations from measurement data. We employ a set of standard basis functions, e.g., polynomials, to approximate the governing equation with high…

Numerical Analysis · Mathematics 2020-05-05 Kailiang Wu , Dongbin Xiu

When implementing the gradient descent method in low precision, the employment of stochastic rounding schemes helps to prevent stagnation of convergence caused by the vanishing gradient effect. Unbiased stochastic rounding yields zero bias…

Machine Learning · Computer Science 2023-02-28 Lu Xia , Stefano Massei , Michiel E. Hochstenbach , Barry Koren

Recently, there has been an increasing interest in using tools from dynamical systems to analyze the behavior of simple optimization algorithms such as gradient descent and accelerated variants. This paper strengthens such connections by…

Optimization and Control · Mathematics 2018-08-02 Guilherme França , Daniel P. Robinson , René Vidal

A numerical method is developed leading to Lyapunov operators to approximate the solution of two-dimensional Boussinesq equation. It consists of an order reduction method and a finite difference discretization. It is proved to be uniquely…

Numerical Analysis · Mathematics 2010-11-08 Anouar Ben Mabrouk , Riadh Chteoui

We propose a method for training ordinary differential equations by using a control-theoretic Lyapunov condition for stability. Our approach, called LyaNet, is based on a novel Lyapunov loss formulation that encourages the inference…

Machine Learning · Computer Science 2022-02-08 Ivan Dario Jimenez Rodriguez , Aaron D. Ames , Yisong Yue

We consider systems of ordinary differential equations with known first integrals. The notion of a discrete tangent space is introduced as the orthogonal complement of an arbitrary set of discrete gradients. Integrators which exactly…

Numerical Analysis · Mathematics 2015-05-20 Morten Dahlby , Brynjulf Owren , Takaharu Yaguchi

A delay Lyapunov matrix corresponding to an exponentially stable system of linear time-invariant delay differential equations can be characterized as the solution of a boundary value problem involving a matrix valued delay differential…

Numerical Analysis · Mathematics 2018-08-28 Wim Michiels , Bin Zhou

A unified theoretical framework is suggested to examine the energy dissipation properties at all stages of additive implicit-explicit Runge-Kutta (IERK) methods up to fourth-order accuracy for gradient flow problems. We construct some…

Numerical Analysis · Mathematics 2024-10-10 Hong-lin Liao , Xuping Wang , Cao Wen

In this paper, we introduce and analyse numerical schemes for the homogeneous and the kinetic L\'evy-Fokker-Planck equation. The discretizations are designed to preserve the main features of the continuous model such as conservation of…

Numerical Analysis · Mathematics 2022-07-26 Nathalie Ayi , Maxime Herda , Hélène Hivert , Isabelle Tristani

We present an exposition of a method of discretizing ordinary differential equations while preserving their Lie point symmetries. This method is very general and can be applied to any ODE with a nontrivial symmetry group. The method is…

Mathematical Physics · Physics 2009-11-01 R. Rebelo , P. Winternitz

We formulate two classes of first-order algorithms more general than previously studied for minimizing smooth and strongly convex or, respectively, smooth and convex functions. We establish sufficient conditions, via new discrete Lyapunov…

Optimization and Control · Mathematics 2023-04-21 Penghui Fu , Zhiqiang Tan