English
Related papers

Related papers: The Kullback-Leibler Divergence as a Lyapunov Func…

200 papers

This paper establishes integral representations of mild solutions of impulsive Hilfer fractional differential equations with impulsive conditions and fluctuating lower bounds at impulsive points. Further, the paper provides sufficient…

Optimization and Control · Mathematics 2022-05-18 Divya Raghavan , Sukavanam Nagarajan , Chengbo Zhai

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

The replicator equation is a simple model of evolution that leads to stable form of Nash Equilibrium, Evolutionary Stable Strategy (ESS). It has been studied in connection with Evolutionary Game Theory and was originally developed for…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Tinsae G. Dulecha

We prove that impulsive systems, which possess an ISS Lyapunov function, are ISS for time sequences satisfying the fixed dwell-time condition. If an ISS Lyapunov function is the exponential one, we provide a stronger result, which…

Dynamical Systems · Mathematics 2012-12-24 Sergey Dashkovskiy , Andrii Mironchenko

We derive a closed form solution for the Kullback-Leibler divergence between two Weibull distributions. These notes are meant as reference material and intended to provide a guided tour towards a result that is often mentioned but seldom…

Information Theory · Computer Science 2013-10-15 Christian Bauckhage

Motivated by a recent work on the metabolism of carbohydrates in bacteria, we study the kinetics and thermodynamics of two classic models for reversible polymerization, one preserving the total polymer concentration and the other one not.…

Statistical Mechanics · Physics 2015-09-30 Sourabh Lahiri , Yang Wang , Massimiliano Esposito , David Lacoste

The Kullback-Leibler (KL) divergence is a fundamental equation of information theory that quantifies the proximity of two probability distributions. Although difficult to understand by examining the equation, an intuition and understanding…

Information Theory · Computer Science 2014-04-09 Jonathon Shlens

The uniform distribution is an important counterexample in game theory as many of the canonical game dynamics have been shown not to converge to the equilibrium in certain cases. In particular none of the canonical game dynamics converge to…

Computer Science and Game Theory · Computer Science 2012-07-03 Dashiell E. A. Fryer

We prove that impulsive systems, which possess an ISS Lyapunov function, are ISS for impulse time sequences, which satisfy the fixed dwell-time condition. If the ISS Lyapunov function is the exponential one, we provide stronger result,…

Optimization and Control · Mathematics 2012-12-24 Sergey Dashkovskiy , Andrii Mironchenko

We combine momentum from machine learning with evolutionary dynamics, where momentum can be viewed as a simple mechanism of intergenerational memory. Using information divergences as Lyapunov functions, we show that momentum accelerates the…

Machine Learning · Computer Science 2025-11-05 Marc Harper , Joshua Safyan

Stability analysis plays a crucial role in studying the behavior of dynamical systems with theoretical and engineering applications. Among various kinds of stability, the stability of equilibrium points is of the greatest importance which…

Dynamical Systems · Mathematics 2019-01-25 Arash Mehrjou , Bernhard Schölkopf

Standard problem of one-degree-of-freedom mechanical systems with Coulomb friction is revised for a relay-based feedback stabilization. It is recalled that such a system with Coulomb friction is asymptotically stabilizable via a relay-based…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Michael Ruderman , Leonid Fridman

Population games can be regarded as a tool to study the strategic interaction of a population of players. Although several attention has been given to such field, most of the available works have focused only on the unconstrained case. That…

Optimization and Control · Mathematics 2020-08-21 Juan Martinez-Piazuelo , Nicanor Quijano , Carlos Ocampo-Martinez

Interpretation of animal behavior, especially as cooperative or selfish, is a challenge for evolutionary theory. Strategy of a competition should follow from corresponding Darwinian payoffs for the available behavioral options. The payoffs…

Populations and Evolution · Quantitative Biology 2008-09-09 Alexander Feigel , Avraham Englander , Assaf Engel

For a dynamical system, it is known that the existence of a Lyapunov-type density function, called Lyapunov density or Rantzer's density function, implies convergence of Lebesgue almost all solutions to an equilibrium. Using the duality…

Adaptation and Self-Organizing Systems · Physics 2018-03-12 Ozkan Karabacak , Rafael Wisniewski , John-Josef Leth

People tend to align their use of language to the linguistic behaviour of their own ingroup and to simultaneously diverge from the language use of outgroups. This paper proposes to model this phenomenon of sociolinguistic identity…

Physics and Society · Physics 2020-11-25 Henri Kauhanen

The concept of an evolutionarily stable strategy (ESS), introduced by Smith and Price, is a refinement of Nash equilibrium in 2-player symmetric games in order to explain counter-intuitive natural phenomena, whose existence is not…

Computational Complexity · Computer Science 2017-01-30 Themistoklis Melissourgos , Paul Spirakis

Switched linear hyperbolic partial differential equations are considered in this paper. They model infinite dimensional systems of conservation laws and balance laws, which are potentially affected by a distributed source or sink term. The…

Optimization and Control · Mathematics 2014-10-01 Christophe Prieur , Antoine Girard , Emmanuel Witrant

Evolutionary game theory has impacted many fields of research by providing a mathematical framework for studying the evolution and maintenance of social and moral behaviors. This success is owed in large part to the demonstration that the…

Physics and Society · Physics 2024-06-03 José F. Fontanari

Motivated by the increasingly popular Score-based Generative Modeling (SGM), we study the Inexact Langevin Dynamics (ILD) and Inexact Langevin Algorithm (ILA) where a score function estimate is used in place of the exact score. We establish…

Machine Learning · Computer Science 2026-03-31 Kaylee Yingxi Yang , Andre Wibisono