Related papers: Generalized Statistics Framework for Rate Distorti…
In this article we use rate-distortion theory, a branch of information theory devoted to the problem of lossy compression, to shed light on an important problem in latent variable modeling of data: is there room to improve the model? One…
Consider a lossy compression system with $\ell$ distributed encoders and a centralized decoder. Each encoder compresses its observed source and forwards the compressed data to the decoder for joint reconstruction of the target signals under…
The purpose of this note is to argue that degree of nonextensivity as given by Tsallis distribution obtained from maximum entropy principle has a different origin than nonextensivity inferred from pseudo-additive property of Tsallis…
Following the basic prescriptions of the Tsallis' nonextensive relativistic thermodynamics, we investigate the relevance of nonextensive statistical effects on the relativistic nuclear and subnuclear equation of state. In this framework, we…
We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified.…
We prove achievability of the recently characterized quadratic Gaussian rate-distortion function (RDF) subject to the constraint that the distortion is uncorrelated to the source. This result is based on shaped dithered lattice quantization…
Consider a Gaussian memoryless multiple source with $m$ components with joint probability distribution known only to lie in a given class of distributions. A subset of $k \leq m$ components are sampled and compressed with the objective of…
In this paper, we discuss the worst-case of distortion riskmetrics for general distributions when only partial information (mean and variance) is known. This result is applicable to general class of distortion risk measures and variability…
This paper studies the rate-distortion-perception (RDP) tradeoff for a memoryless source model in the asymptotic limit of large block-lengths. The perception measure is based on a divergence between the distributions of the source and…
Tsallis' non-extensive statistical mechanics is claimed to be the correct tool to describe the behaviour of low-dimensional dissipative maps at the edge of chaos. Indeed, many different approaches confirm that, for those systems, the…
Examples of joint probability distributions are studied in terms of Tsallis' nonextensive statistics both for correlated and uncorrelated variables, in particular it is explicitely shown how correlations in the system can make Tsallis…
We extend the Rate-Distortion-Perception (RDP) framework to the R\'enyi information-theoretic regime, utilizing Sibson's $\alpha$-mutual information to characterize the fundamental limits under distortion and perception constraints. For…
In this paper we extend our recent results [Physica A340 (2004)110] on q-nonextensive statistics with non-Tsallis entropies. In particular, we combine an axiomatics of Renyi with the q-deformed version of Khinchin axioms to obtain the…
Within Tsallis' nonextensive statistics, a model is elaborated to address self-similar time series as a thermodynamic system. Thermodynamic-type characteristics relevant to temperature, pressure, entropy, internal and free energies are…
We describe some recent applications of Tsallis statistics in fully developed hydrodynamic turbulence and high energy physics. For many of these applications nonextensive properties arise from spatial fluctuations of the temperature or the…
Previous results on Renyi and Wang's formalism of the Tsallis thermostatics are founded by using an extensive variable z connected to the entropic parameter q. It is shown that in the thermodynamical limit both the Tsallis and Renyi…
Sequential rate-distortion (SRD) theory provides a framework for studying the fundamental trade-off between data-rate and data-quality in real-time communication systems. In this paper, we consider the SRD problem for multi-dimensional…
Based on the connection between Tsallis nonextensive statistics and fractional dimensional space, in this work we have introduced, with the aid of Verlinde's formalism, the Newton constant in a fractal space as a function of the…
This paper investigates the problem of variable-length lossy source coding allowing a positive excess distortion probability and an overflow probability of codeword lengths. Novel one-shot achievability and converse bounds of the optimal…
In this paper, we develop the lower and upper bounds of worst-case distortion riskmetrics and weighted entropy for unimodal, and symmetric unimodal distributions when mean and variance information are available. We also consider the sharp…