English
Related papers

Related papers: Generalized Statistics Framework for Rate Distorti…

200 papers

The distortion-rate function of output-constrained lossy source coding with limited common randomness is analyzed for the special case of squared error distortion measure. An explicit expression is obtained when both source and…

Information Theory · Computer Science 2024-03-25 Li Xie , Liangyan Li , Jun Chen , Zhongshan Zhang

We perform a Taylor series expansion of Tsallis distribution by assuming the Tsallis parameter $q$ close to 1. The $q$ value shows the deviation of a system from a thermalised Boltzmann distribution. By taking up to first order in $(q-1)$,…

High Energy Physics - Phenomenology · Physics 2016-03-17 Trambak Bhattacharyya , Arvind Khuntia , Pragati Sahoo , Prakhar Garg , Pooja Pareek , Raghunath Sahoo , Jean Cleymans

This paper investigates applications of nonanticipative Rate Distortion Function (RDF) in a) zero-delay Joint Source-Channel Coding (JSCC) design based on average and excess distortion probability, b) in bounding the Optimal Performance…

Information Theory · Computer Science 2016-11-17 Photios A. Stavrou , Christos K. Kourtellaris , C. D. Charalambous

We apply Tsallis's q-indexed nonextensive entropy to formulate a random matrix theory (RMT), which may be suitable for systems with mixed regular-chaotic dynamics. We consider the super-extensive regime of q < 1. We obtain analytical…

Mathematical Physics · Physics 2011-12-06 A. Abd El-Hady , A. Y. Abul-Magd

We expand the Tsallis distribution in a Taylor series of powers of (q-1), where q is the Tsallis parameter, assuming q is very close to 1. This helps in studying the degree of deviation of transverse momentum spectra and other thermodynamic…

High Energy Physics - Phenomenology · Physics 2016-02-23 Trambak Bhattacharyya , Jean Cleymans , Arvind Khuntia , Pooja Pareek , Raghunath Sahoo

The statistical properties of fully developed hydrodynamic turbulence can be successfully described using methods from nonextensive statistical mechanics. The predicted probability densities and scaling exponents precisely coincide with…

Statistical Mechanics · Physics 2009-11-07 Christian Beck

We show that starting with either the non-extensive Tsallis entropy in Wang's formalism or the extensive Renyi entropy, it is possible to construct the equilibrium statistical mechanics with non-Gibbs canonical distribution functions. The…

High Energy Physics - Phenomenology · Physics 2009-11-10 A. S. Parvan , T. S. Biro

Superstatistics are superpositions of different statistics relevant for driven nonequilibrium systems with spatiotemporal inhomogeneities of an intensive variable (e.g., the inverse temperature). They contain Tsallis statistics as a special…

Statistical Mechanics · Physics 2007-05-23 Hugo Touchette , Christian Beck

We consider a novel variant of $d$-semifaithful lossy coding in which the distortion measure is revealed only to the encoder and only at run-time, as well as an extension of it in which the distortion constraint $d$ is also revealed at…

Information Theory · Computer Science 2022-10-05 Adeel Mahmood , Aaron B. Wagner

In this paper, we propose a new discriminative model named \emph{nonextensive information theoretical machine (NITM)} based on nonextensive generalization of Shannon information theory. In NITM, weight parameters are treated as random…

Machine Learning · Computer Science 2016-04-22 Chaobing Song , Shu-Tao Xia

We apply non-extensive methods to the statistical analysis of fully developed turbulent flows. Probability density functions of velocity differences at distance r obtained by extremizing the Tsallis entropies coincide well with what is…

Statistical Mechanics · Physics 2007-05-23 Christian Beck

Motivated by questions in lossy data compression and by theoretical considerations, we examine the problem of estimating the rate-distortion function of an unknown (not necessarily discrete-valued) source from empirical data. Our focus is…

Information Theory · Computer Science 2013-01-18 M. T. Harrison , I. Kontoyiannis

The problem of variable-rate lossless data compression is considered, for codes with and without prefix constraints. Sharp bounds are derived for the best achievable compression rate of memoryless sources, when the excess-rate probability…

Information Theory · Computer Science 2025-11-13 Andreas Theocharous , Lampros Gavalakis , Ioannis Kontoyiannis

This work investigates a quantum system described by a Hamiltonian operator in a two dimensional noncommutative space. The system consists of an electron subjected to a perpendicular magnetic field $\mathbf{B}$, coupled to a harmonic…

Quantum Physics · Physics 2025-11-27 Bienvenu Gnim Adewi , Isiaka Aremua

Gauss' law of error is generalized in Tsallis statistics such as multifractal systems, in which Tsallis entropy plays an essential role instead of Shannon entropy. For the generalization, we apply the new multiplication operation determined…

Statistical Mechanics · Physics 2007-05-23 Hiroki Suyari , Makoto Tsukada

In lossy compression, Blau and Michaeli [5] introduced the information rate-distortion-perception (RDP) function, extending traditional rate-distortion theory by incorporating perceptual quality. More recently, this framework was expanded…

Information Theory · Computer Science 2025-04-15 Nam Nguyen , Thinh Nguyen , Bella Bose

We revisit the derivation of a formula for the $q$-generalised multinomial coefficient rooted in the $q$-deformed algebra, a foundational framework in the study of nonextensive statistics. Previous approximate expressions in the literature…

Statistical Mechanics · Physics 2024-10-08 Keisuke Okamura

We consider the problem of distributed lossy linear function computation in a tree network. We examine two cases: (i) data aggregation (only one sink node computes) and (ii) consensus (all nodes compute the same function). By quantifying…

Information Theory · Computer Science 2017-01-16 Yaoqing Yang , Pulkit Grover , Soummya Kar

A new source model, which consists of an intrinsic state part and an extrinsic observation part, is proposed and its information-theoretic characterization, namely its rate-distortion function, is defined and analyzed. Such a source model…

Information Theory · Computer Science 2022-06-02 Jiakun Liu , Shuo Shao , Wenyi Zhang , H. Vincent Poor

We comment on some open questions and theoretical peculiarities in Tsallis nonextensive statistical mechanics. It is shown that the theoretical basis of the successful Tsallis' generalized exponential distribution shows some worrying…

Statistical Mechanics · Physics 2009-11-07 Qiuping A. Wang