English
Related papers

Related papers: Breaking the Finite-Sample Barrier in Entropy Coup…

200 papers

Consider a measure-preserving transition kernel $T$ on an arbitrary probability space $(\mathbb X,\mathcal cA,\pi)$. In this level of generality, we prove that a one-step hyper-contractivity estimate of the form $\|T\|_{p\to q}\le 1$ with…

Probability · Mathematics 2026-02-20 Justin Salez

This paper establishes the minimum entropy principle (MEP) for the relativistic Euler equations with a broad class of equations of state (EOSs) and addresses the challenge of preserving the local version of the discovered MEP in high-order…

Numerical Analysis · Mathematics 2025-03-18 Shumo Cui , Kailiang Wu , Linfeng Xu

Sharp, nonasymptotic bounds are obtained for the relative entropy between the distributions of sampling with and without replacement from an urn with balls of $c\geq 2$ colors. Our bounds are asymptotically tight in certain regimes and,…

Probability · Mathematics 2026-01-14 Oliver Johnson , Lampros Gavalakis , Ioannis Kontoyiannis

Mixture distributions are a workhorse model for multimodal data in information theory, signal processing, and machine learning. Yet even when each component density is simple, the differential entropy of the mixture is notoriously hard to…

Information Theory · Computer Science 2026-02-18 Namyoon Lee

In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…

Quantum Physics · Physics 2018-10-25 Christian Majenz

We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling…

Statistics Theory · Mathematics 2020-10-16 Doron Cohen , Aryeh Kontorovich , Geoffrey Wolfer

The probability distribution of the total entropy production in the non-equilibrium steady state follows a symmetry relation called the fluctuation theorem. When a certain part of the system is masked or hidden, it is difficult to infer the…

Statistical Mechanics · Physics 2020-04-29 Deepak Gupta , Sanjib Sabhapandit

We present a comprehensive software framework for the finite-size security analysis of quantum random number generation (QRNG) and quantum key distribution (QKD) protocols, based on the Entropy Accumulation Theorem (EAT). Our framework…

Quantum Physics · Physics 2025-06-24 Piotr Mironowicz , Mohamed Bourennane

In this paper, both non-mixing and mixing local minima of the entropy are analyzed from the viewpoint of blind source separation (BSS); they correspond respectively to acceptable and spurious solutions of the BSS problem. The contribution…

Information Theory · Computer Science 2016-11-17 F. Vrins , D. -T. Pham , M. Verleysen

This thesis consolidates, improves and extends the smooth entropy framework for non-asymptotic information theory and cryptography. We investigate the conditional min- and max-entropy for quantum states, generalizations of classical R\'enyi…

Quantum Physics · Physics 2015-03-20 Marco Tomamichel

We study the entanglement entropy arising from coherent states and one--particle states. We show that it is possible to define a finite entanglement entropy by subtracting the vacuum entropy from that of the considered states, when the…

High Energy Physics - Theory · Physics 2009-10-28 Eric Benedict , So-Young Pi

In this paper, we study the minimal output entropy of EPOSIC channels. We determine the cases where their minimal output entropy is zero, and obtain some partial results on the fulfillment of their entanglement breaking property.Our results…

Mathematical Physics · Physics 2017-01-11 Muneerah Al Nuwairan

We investigate two classes of non-minimally coupled curvature-matter models in the FLRW universe with a perfect fluid and analyze their cosmological implications using Supernova Ia, Observed Hubble Data, and Baryon Acoustic Oscillation…

General Relativity and Quantum Cosmology · Physics 2024-12-31 Anirban Chatterjee , Akshay Panda , Abhijit Bandyopadhyay

Conformal field theories in curved backgrounds have been used to describe inhomogeneous one-dimensional systems, such as quantum gases in trapping potentials and non-equilibrium spin chains. This approach provided, in a elegant and simple…

Statistical Mechanics · Physics 2019-03-26 Sara Murciano , Paola Ruggiero , Pasquale Calabrese

We propose a test of independence of two multivariate random vectors, given a sample from the underlying population. Our approach, which we call MINT, is based on the estimation of mutual information, whose decomposition into joint and…

Methodology · Statistics 2017-11-20 Thomas B. Berrett , Richard J. Samworth

Maximization of an expensive, unimodal function under random observations has been an important problem in hyperparameter tuning. It features expensive function evaluations (which means small budgets) and a high level of noise. We develop…

Optimization and Control · Mathematics 2023-02-23 Xiaohe Luo , Warren B. Powell

In this manuscript, we consider a finite multivariate nonparametric mixture model where the dependence between the marginal densities is modeled using the copula device. Pseudo EM stochastic algorithms were recently proposed to estimate all…

Computation · Statistics 2022-12-14 Michael Levine , Gildas Mazo

We introduce a novel approach to finite sample robustness that avoids the pessimism of traditional breakdown analyses. We define the threshold breakdown point, the smallest contamination fraction needed to induce a prescribed deviation, and…

Statistics Theory · Mathematics 2026-05-19 Tianjun Ke , Marco Avella Medina

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1…

Data Analysis, Statistics and Probability · Physics 2011-11-09 P. Grassberger

We examine entropy production in reduced descriptions of collisionless plasmas. Introducing a closure dependent entropy hierarchy, we show that non-conservative moment closures generate a residual entropy associated with irreversible…

Plasma Physics · Physics 2026-02-03 Alexander G. Tevzadze