English
Related papers

Related papers: Explicit Bounds for Entropy Concentration under Li…

200 papers

Restriction is a natural quasi-order on $d$-way tensors. We establish a remarkable aspect of this quasi-order in the case of tensors over a fixed finite field -- namely, that it is a well-quasi-order: it admits no infinite antichains and no…

Algebraic Geometry · Mathematics 2025-09-03 Andreas Blatter , Jan Draisma , Filip Rupniewski

From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…

Information Theory · Computer Science 2018-08-01 Arash Atashpendar , David Mestel , A. W. Roscoe , Peter Y. A. Ryan

We consider relaxation of an isolated system to the equilibrium using detailed balance condition and Onsager's fluctuation approximation. There is a small deviation from the equilibrium in two parameters. For this system, explicit…

Statistical Mechanics · Physics 2012-07-20 V. D. Seleznev , L. M. Martyushev

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Trung Vu , Raviv Raich

Stochastic network models play a central role across a wide range of scientific disciplines, and questions of statistical inference arise naturally in this context. In this paper we investigate goodness-of-fit and two-sample testing…

Statistics Theory · Mathematics 2026-03-27 Subhro Ghosh , Rathindra Nath Karmakar , Samriddha Lahiry

A broad set of sufficient conditions that guarantees the existence of the maximum entropy (maxent) distribution consistent with specified bounds on certain generalized moments is derived. Most results in the literature are either focused on…

Information Theory · Computer Science 2009-09-29 Prakash Ishwar , Pierre Moulin

Consider a finite set of sources, each producing i.i.d. observations that follow a unique probability distribution on a finite alphabet. We study the problem of matching a finite set of observed sequences to the set of sources under the…

Information Theory · Computer Science 2014-12-09 Jayakrishnan Unnikrishnan

Neyman (1923/1990) introduced the randomization model, which contains the notation of potential outcomes to define causal effects and a framework for large-sample inference based on the design of the experiment. However, the existing theory…

Methodology · Statistics 2025-06-16 Lei Shi , Peng Ding

An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic…

Information Theory · Computer Science 2009-11-18 Yaming Yu

Weak solutions $m\colon\Omega\subset\mathbb{R}^2\to\mathbb{R}^2$ of the eikonal equation \begin{align*} |m|=1\text{ a.e. and }\mathrm{div}\: m =0\,, \end{align*} arise naturally as sharp interface limits of bounded energy configurations in…

Analysis of PDEs · Mathematics 2025-09-23 Xavier Lamy , Elio Marconi

Entanglement in a pure state of a many-body system can be characterized by the R\'enyi entropies $S^{(\alpha)}=\ln\textrm{tr}(\rho^\alpha)/(1-\alpha)$ of the reduced density matrix $\rho$ of a subsystem. These entropies are, however,…

Disordered Systems and Neural Networks · Physics 2020-06-18 Maximilian Kiefer-Emmanouilidis , Razmik Unanyan , Jesko Sirker , Michael Fleischhauer

We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations.

Statistics Theory · Mathematics 2019-03-22 Amadou Diadie Ba , Gane Samb Lo

Berry-Esseen-type bounds are developed in the multidimensional local limit theorem in terms of the Lyapunov coefficients and maxima of involved densities.

Probability · Mathematics 2024-07-31 Sergey Bobkov , Friedrich Götze

The time decay of fully discrete finite-volume approximations of porous-medium and fast-diffusion equations with Neumann or periodic boundary conditions is proved in the entropy sense. The algebraic or exponential decay rates are computed…

Numerical Analysis · Mathematics 2013-03-18 Claire Chainais-Hillairet , Ansgar Jüngel , Stefan Schuchnigg

We present a bouquet of continuity bounds for quantum entropies, falling broadly into two classes: First, a tight analysis of the Alicki-Fannes continuity bounds for the conditional von Neumann entropy, reaching almost the best possible…

Quantum Physics · Physics 2016-09-06 Andreas Winter

The entropy accumulation theorem, and its subsequent generalized version, is a powerful tool in the security analysis of many device-dependent and device-independent cryptography protocols. However, it has the drawback that the finite-size…

Quantum Physics · Physics 2025-12-22 Amir Arqand , Thomas A. Hahn , Ernest Y. -Z. Tan

Breaking of ensemble equivalence between the microcanonical ensemble and the canonical ensemble may occur for random graphs whose size tends to infinity, and is signaled by a non-zero specific relative entropy of the two ensembles. In [3]…

Statistical Mechanics · Physics 2018-08-22 Andrea Roccaverde

We derive a Gaussian Central Limit Theorem for the sample quantiles based on locally dependent random variables with explicit convergence rate. Our approach is based on converting the problem to a sum of indicator random variables, applying…

Probability · Mathematics 2025-03-05 Partha S. Dey , Grigory Terlov

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

The inductive size bias coupling technique and Stein's method yield a Berry-Esseen theorem for the number of urns having occupancy $d \ge 2$ when $n$ balls are uniformly distributed over $m$ urns. In particular, there exists a constant $C$…

Probability · Mathematics 2019-04-02 Jay Bartroff , Larry Goldstein