Related papers: Tsallis Entropy Regularization for Linearly Solvab…
The recently successful Munchausen Reinforcement Learning (M-RL) features implicit Kullback-Leibler (KL) regularization by augmenting the reward function with logarithm of the current stochastic policy. Though significant improvement has…
The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised…
The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. ID3,…
In this work, we derive information-theoretic properties for a modified Tsallis entropy, hereinafter referred to as q-entropy. We introduce the notions of joint q-entropy, conditional q-entropy, relative q-entropy, conditional mutual…
We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.
In this paper we derived a 6N dimensional non-homogeneous evolution equation of Tsallis non-equilibrium entropy; presented a formula for entropy production rate (i.e. the law of entropy increase) for Tsallis entropy only when its index q>0,…
This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…
In the previous paper \cite{FYK}, we mainly studied the mathematical properties of Tsallis relative entropy with respect to the density operators. As an application of it, we adopt a parametrically extended entanglement-measure due to…
The maximum entropy principle is often used for bi-level or multi-level thresholding of images. For this purpose, some methods are available based on Shannon and Tsallis entropies. In this paper, we discuss them and propose a method based…
We revisit the well-studied problem of estimating the Shannon entropy of a probability distribution, now given access to a probability-revealing conditional sampling oracle. In this model, the oracle takes as input the representation of a…
In density estimation task, maximum entropy model (Maxent) can effectively use reliable prior information via certain constraints, i.e., linear constraints without empirical parameters. However, reliable prior information is often…
We demonstrate that dual entropy expressions of the Tsallis type apply naturally to statistical-mechanical systems that experience an exceptional contraction of their configuration space. The entropic index $\alpha>1$ describes the…
This study derived the vertical distribution of streamwise velocity in wide open channels by maximizing Tsallis entropy, in accordance with the maximum entropy principle, subject to the total probability rule and the conservation of mass,…
In this paper, we propose a novel maximum causal Tsallis entropy (MCTE) framework for imitation learning which can efficiently learn a sparse multi-modal policy distribution from demonstrations. We provide the full mathematical analysis of…
We study the evolution of Tsallis entropy along the heat flow and establish its concavity in arbitrary dimensions. Extending prior results that were restricted to the one-dimensional setting, we prove that the Tsallis entropy is concave in…
We show that Tsallis ensemble of power-law distributions provides a mechanical model of nonextensive equilibrium thermodynamics for small interacting Hamiltonian systems, i.e., using Boltzmann's original nomenclature, we prove that it is an…
We give the tight bounds of Tsallis relative operator entropy by using Hermite-Hadamard's inequality. Some reverse inequalities related to Young inequalities are also given. In addition, operator inequalities for normalized positive linear…
This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.
Recently, weighted cumulative residual Tsallis entropy has been introduced in the literature as a generalization of weighted cumulative residual entropy. We study some new properties of weighted cumulative residual Tsallis entropy measure.…
Euler turbulence has been experimentally observed to relax to a metaequilibrium state that does not maximize the Boltzmann entropy, but rather seems to minimize enstrophy. We show that a recent generalization of thermodynamics and…