English
Related papers

Related papers: Tsallis Entropy Regularization for Linearly Solvab…

200 papers

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

Machine Learning · Computer Science 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose

In this work we determine and discuss the entropic uncertainty measures of Shannon type for all the discrete stationary states of the multidimensional harmonic systems directly in terms of the states' hyperquantum numbers, the…

Quantum Physics · Physics 2018-12-19 I. V. Toranzo , J. S. Dehesa

Quasi-power law ensembles are discussed from the perspective of nonextensive Tsallis distributions characterized by a nonextensive parameter $q$. A number of possible sources of such distributions are presented in more detail. It is further…

Statistical Mechanics · Physics 2023-07-19 Grzegorz Wilk , Zbigniew Włodarczyk

In this paper, we propose a max-min entropy framework for reinforcement learning (RL) to overcome the limitation of the soft actor-critic (SAC) algorithm implementing the maximum entropy RL in model-free sample-based learning. Whereas the…

Machine Learning · Computer Science 2021-12-21 Seungyul Han , Youngchul Sung

Tsallis' non-extensive entropy $S_q$ enables us to treat both a power and exponential evolutions of underlying microscopic dynamics on equal footing by adjusting the variable entropic index $q$ to proper one $q^*$. We propose an alternative…

Statistical Mechanics · Physics 2009-11-07 Wada Tatsuaki , Saito Takeshi

The principal task to control dynamical systems is to ensure their stability. When the system is unknown, robust approaches are promising since they aim to stabilize a large set of plausible systems simultaneously. We study linear…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Lenart Treven , Sebastian Curi , Mojmir Mutny , Andreas Krause

Following the work on Shannon entropy together with the principle of maximum entropy, Luo & Singh (J. Hydrol. Eng., 2011, 16(4): 303-315) and Singh & Luo (J. Hydrol. Eng., 2011, 16(9): 725-735) explored the concept of non-extensive Tsallis…

Fluid Dynamics · Physics 2020-08-26 Manotosh Kumbhakar , Rajendra K. Ray , Koeli Ghoshal , Vijay P. Singh

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

Images obtained from coherent illumination processes are contaminated with speckle noise, with polarimetric synthetic aperture radar (PolSAR) imagery as a prominent example. With an adequacy widely attested in the literature, the scaled…

Methodology · Statistics 2015-06-11 Alejandro C. Frery , Renato J. Cintra , Abraão D. C. Nascimento

We consider an entropy-regularized version of optimal density control of deterministic discrete-time linear systems. Entropy regularization, or a maximum entropy (MaxEnt) method for optimal control has attracted much attention especially in…

Optimization and Control · Mathematics 2023-08-15 Kaito Ito , Kenji Kashima

In this letter, we study the limit behavior of the evolution of Tsallis entropy in self-gravitating systems. The study is carried out under two different situations, drawing the same conclusion. No matter in the energy transfer process or…

Statistical Mechanics · Physics 2017-10-11 Yahui Zheng , Jiulin Du , Faku Liang

A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…

Statistics Theory · Mathematics 2020-02-18 Ba Amadou Diadie , Lo Gane Samb

A large class of technically non-chaotic systems, involving scatterings of light particles by flat surfaces with sharp boundaries, is nonetheless characterized by complex random looking motion in phase space. For these systems one may…

Chaotic Dynamics · Physics 2009-11-10 Henk van Beijeren

We conclude a sequence of work by giving near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain…

Data Structures and Algorithms · Computer Science 2008-12-18 Nicholas J. A. Harvey , Jelani Nelson , Krzysztof Onak

We propose a new policy iteration theory as an important extension of soft policy iteration and Soft Actor-Critic (SAC), one of the most efficient model free algorithms for deep reinforcement learning. Supported by the new theory, arbitrary…

Machine Learning · Computer Science 2019-02-18 Gang Chen , Yiming Peng

We discuss the idea that the Tsallis-type (q-additive) entropic chain rule allows for a wider class of entropic functionals than previously thought. In particular, we point out that the ensuing entropy solutions (e.g., Tsallis entropy) can…

Mathematical Physics · Physics 2017-11-15 Petr Jizba , Jan Korbel

Maximum entropy principles in nonextensive statistical physics are revisited as an application of the Tsallis relative entropy defined for non-negative matrices in the framework of matrix analysis. In addtition, some matrix trace…

Statistical Mechanics · Physics 2010-01-12 Shigeru Furuichi

Some preliminary evidence suggests the conjecture that the collective behaviour of systems having long-range interactions may be described more effectively by the Tsallis rather than by the Boltzmann/Gibbs/Shannon entropy. To this end, we…

Statistical Mechanics · Physics 2017-05-19 Nikos Kalogeropoulos

The property of Tsallis entropy is examined when considering tow systems with different temperatures to be in contact with each other and to reach the thermal equilibrium. It is verified that the total Tsallis entropy of the two systems…

Statistical Mechanics · Physics 2015-08-10 Jiulin Du

There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz , Tom Leinster