English
Related papers

Related papers: The Kullback-Leibler Divergence as a Lyapunov Func…

200 papers

This paper examines the convergence of no-regret learning in games with continuous action sets. For concreteness, we focus on learning via "dual averaging", a widely used class of no-regret learning schemes where players take small steps…

Optimization and Control · Mathematics 2018-01-17 Panayotis Mertikopoulos , Zhengyuan Zhou

We show that the existence of a Lyapunov-Krasovskii functional (LKF) with pointwise dissipation (i.e. dissipation in terms of the current solution norm) suffices for input-to-state stability, provided that uniform global stability can also…

Optimization and Control · Mathematics 2026-03-17 Andrii Mironchenko , Fabian Wirth , Antoine Chaillet , Lucas Brivadis

The thermodynamic uncertainty relation, which establishes a universal trade-off between nonequilibrium current fluctuations and dissipation, has been found for various Markovian systems. However, this relation has not been revealed for…

Statistical Mechanics · Physics 2019-07-24 Tan Van Vu , Yoshihiko Hasegawa

Generative models based on static scalar energy functions represent an emerging paradigm in which a single time independent potential drives sample generation through its gradient field, eliminating the need for time conditioning entirely.…

Machine Learning · Computer Science 2026-05-08 Yixuan Wang , Wenqian Xue , Warren E. Dixon

This short note is on a property of the Kullback-Leibler (KL) divergence which indicates that independent Gaussian distributions minimize the KL divergence from given independent Gaussian distributions. The primary purpose of this note is…

Information Theory · Computer Science 2020-12-04 Song Fang , Quanyan Zhu

In evolutionary game theory, evolutionarily stable states are characterised by the folk theorem because exact solutions to the replicator equation are difficult to obtain. It is generally assumed that the folk theorem, which is the…

Computer Science and Game Theory · Computer Science 2015-09-08 Jiawei Li , Graham Kendall

The notion of feedback integrators permits Euclidean integration schemes for dynamical systems evolving on manifolds. Here, a constructive Lyapunov function for the attitude dynamics embedded in an ambient Euclidean space has been proposed.…

Systems and Control · Computer Science 2019-03-26 Tejaswi K. C. , Srikant Sukumar , Ravi Banavar

In games with continuous strategy spaces, if a rest point of the replicator dynamics is asymptotically stable then the rest point must be finitely supported (van Veelen, M., Spreij, P., 2009. Evolution in games with a continuous action…

Optimization and Control · Mathematics 2016-05-25 Dharini Hingu , K. S. Mallikarjuna Rao , A. J. Shaiju

We consider third-order dynamic systems which have an integral feedback action and discontinuous relay disturbance. More specifically for the applications, the focus is on the integral plus state-feedback control of the motion systems with…

Optimization and Control · Mathematics 2025-02-18 Michael Ruderman

Kullback-Leibler (KL) control enables efficient numerical methods for nonlinear optimal control problems. The crucial assumption of KL control is the full controllability of the transition distribution. However, this assumption is often…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Kaito Ito , Kenji Kashima

Robustness to outliers is a central issue in real-world machine learning applications. While replacing a model to a heavy-tailed one (e.g., from Gaussian to Student-t) is a standard approach for robustification, it can only be applied to…

Machine Learning · Statistics 2018-03-01 Futoshi Futami , Issei Sato , Masashi Sugiyama

In this paper, some new upper bounds for Kullback-Leibler divergence(KL-divergence) based on $L^1, L^2$ and $L^\infty$ norms of density functions are discussed. Our findings unveil that the convergence in KL-divergence sense sandwiches…

Probability · Mathematics 2024-10-31 Liuquan Yao , Songhao Liu

We construct two models of discrete-time replicator dynamics with time delay. In the social-type model, players imitate opponents taking into account average payoffs of games played some units of time ago. In the biological-type model, new…

Populations and Evolution · Quantitative Biology 2013-05-30 Jan Alboszta , Jacek Miekisz

A family of replicator-like dynamics, called the escort replicator equation, is constructed using information-geometric concepts and generalized information entropies and diverenges from statistical thermodynamics. Lyapunov functions and…

Dynamical Systems · Mathematics 2012-02-27 Marc Harper

We study the convergence properties of a payoff-based higher-order version of replicator dynamics, a widely studied model in evolutionary dynamics and game-theoretic learning, in contractive games. Recent work has introduced a…

Systems and Control · Electrical Eng. & Systems 2026-03-20 Hassan Abdelraouf , Vijay Gupta , Jeff S. Shamma

This paper illustrates novel methods for nonstationary time series modeling along with their applications to selected problems in neuroscience. These methods are semi-parametric in that inferences are derived by combining sequential…

Applications · Statistics 2010-11-03 Fabio Rigat , Jim Q. Smith

Lyapunov's theorem provides a foundational characterization of stable equilibrium points in dynamical systems. In this paper, we develop a framework for stability for F-coalgebras. We give two definitions for a categorical setting in which…

Dynamical Systems · Mathematics 2025-05-30 Aaron D. Ames , Sébastien Mattenet , Joe Moeller

Empirically defining some constant probabilistic orbits of f(x) and g(x) iterated high-order functions, the stability of these functions in possible entangled interaction dynamics of the environment through its orbit's connectivity (open…

Chaotic Dynamics · Physics 2019-11-19 Charles Roberto Telles

Expectation maximization (EM) is the default algorithm for fitting probabilistic models with missing or latent variables, yet we lack a full understanding of its non-asymptotic convergence properties. Previous works show results along the…

Machine Learning · Computer Science 2022-03-01 Frederik Kunstner , Raunak Kumar , Mark Schmidt

This paper deals with the stability analysis of a mass-spring system subject to friction using Lyapunov-based arguments. As the described system presents a stick-slip phenomenon, the mass may then periodically sticks to the ground. The…

Optimization and Control · Mathematics 2021-03-09 Matthieu Barreau , Sophie Tarbouriech , Frederic Gouaisbaut