English
Related papers

Related papers: Tsallis Entropy Regularization for Linearly Solvab…

200 papers

Entropy regularization is used to get improved optimization performance in reinforcement learning tasks. A common form of regularization is to maximize policy entropy to avoid premature convergence and lead to more stochastic policies for…

Machine Learning · Computer Science 2019-12-12 Riashat Islam , Zafarali Ahmed , Doina Precup

Numerical experiments support the interesting conjecture that statistical methods be applicable not only to fully-chaotic systems, but also at the edge of chaos by using Tsallis' generalizations of the standard exponential and entropy. In…

Statistical Mechanics · Physics 2017-08-23 Marcello Lissia , Massimo Coraddu , Roberto Tonelli

The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…

Quantum Physics · Physics 2017-01-17 J. S. Dehesa , I. V. Toranzo , D. Puertas-Centeno

We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques. We present a framework which allows for system identification through…

Optimization and Control · Mathematics 2019-07-09 Sarah Dean , Stephen Tu , Nikolai Matni , Benjamin Recht

In this paper, we study entropic uncertainty relations on a finite-dimensional Hilbert space and provide several tighter bounds for multi-measurements, with some of them also valid for R\'{e}nyi and Tsallis entropies besides the Shannon…

Quantum Physics · Physics 2016-05-02 Yunlong Xiao , Naihuan Jing , Shao-Ming Fei , Tao Li , Xianqing Li-Jost , Teng Ma , Zhi-Xi Wang

Shannon entropy, as a chaos indicator, is used for online Poincar\'e map regularization and dynamic aperture optimization in the National Synchrotron Light Source-II (NSLS-II) ring. Although various chaos indicators are widely used in…

As additivity is a characteristic property of the classical information measure, Shannon entropy, pseudo-additivity is a characteristic property of Tsallis entropy. Renyi generalized Shannon entropy by means of Kolmogorov-Nagumo averages,…

Mathematical Physics · Physics 2007-05-23 Ambedkar Dukkipati , M. Narsimha Murty , Shalabh Bhatnagar

We consider the meta-equilibrium state of a composite system made up of independent subsystems satisfying the additive form of external constraints, as recently discussed by Abe [Phys. Rev. E {\bf 63}, 061105 (2001)]. We derive the additive…

Statistical Mechanics · Physics 2009-11-10 Ramandeep S. Johal

We generalize the completely monotone conjecture ([CG15]) from Shannon entropy to the Tsallis entropy up for orders up to at least four. To this end, we employ the algorithm ([J\"un16, JM06a]) which employs the technique of systematic…

Analysis of PDEs · Mathematics 2022-12-20 Li-Chang Hung

Regularization of control policies using entropy can be instrumental in adjusting predictability of real-world systems. Applications benefiting from such approaches range from, e.g., cybersecurity, which aims at maximal unpredictability, to…

Systems and Control · Electrical Eng. & Systems 2026-02-18 Menno van Zutphen , Giannis Delimpaltadakis , Maurice Heemels , Duarte Antunes

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

Reinforcement Learning (RL) has emerged as a powerful framework for sequential decision-making in dynamic environments, particularly when system parameters are unknown. This paper investigates RL-based control for entropy-regularized…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Gabriel Diaz , Lucky Li , Wenhao Zhang

By replacing linear averaging in Shannon entropy with Kolmogorov-Nagumo average (KN-averages) or quasilinear mean and further imposing the additivity constraint, R\'{e}nyi proposed the first formal generalization of Shannon entropy. Using…

Information Theory · Computer Science 2007-07-13 Ambedkar Dukkipati , M. Narasimha Murty , Shalabh Bhatnagar

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

It is shown that distributions arising in Renyi-Tsallis maximum entropy setting are related to the Generalized Pareto Distributions (GPD) that are widely used for modeling the tails of distributions. The relevance of such modelization, as…

Information Theory · Computer Science 2008-05-06 J. -F. Bercher , C. Vignat

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

We investigate the cumulative Tsallis entropy, an information measure recently introduced as a cumulative version of the classical Tsallis differential entropy, which is itself a generalization of the Boltzmann-Gibbs statistics. This…

Statistics Theory · Mathematics 2023-06-02 Guillaume Dulac , Thomas Simon

Kullback-Leibler relative-entropy has unique properties in cases involving distributions resulting from relative-entropy minimization. Tsallis relative-entropy is a one parameter generalization of Kullback-Leibler relative-entropy in the…

Mathematical Physics · Physics 2009-11-11 Ambedkar Dukkipati , M. Narasimha Murty , Shalabh Bhatnagar

Many complex systems are characterized by non-Boltzmann distribution functions of their statistical variables. If one wants to -- justified or not -- hold on to the maximum entropy principle for complex statistical systems (non-Boltzmann)…

Statistical Mechanics · Physics 2009-11-13 Stefan Thurner , Rudolf Hanel

Tsallis has proposed a generalisation of the standard entropy, which has since been applied to a variety of physical systems. In the canonical ensemble approach that is mostly used, average energy is given by an unnromalised, or normalised,…

Statistical Mechanics · Physics 2009-10-31 S. Kalyana Rama