English
Related papers

Related papers: Relative entropy bounds for sampling with and with…

200 papers

The aim of this study is to generalise recent results of the two last authors on en-tropy methods for measure solutions of the renewal equation to other classes of structured population problems. Specifically, we develop a generalised…

Analysis of PDEs · Mathematics 2018-04-11 Tomasz Dębiec , Marie Doumic , Piotr Gwiazda , Emil Wiedemann

In the present work, we provide the asymptotic behavior of the residual-past entropy, of the mean residual-past lifetime distribution and of the residual-past inaccuracy measure. We are interested in these measures of uncertainty in the…

Statistics Theory · Mathematics 2019-12-03 Ba Amadou Diadie

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

Probability · Mathematics 2024-12-05 Pierre Monmarché , Katharina Schuh

We derive asymptotic formulas for the number of integer partitions with given sums of $j$th powers of the parts for $j$ belonging to a finite, non-empty set $J \subset \mathbb N$. The method we use is based on the `principle of maximum…

Combinatorics · Mathematics 2021-01-01 Gweneth McKinley , Marcus Michelen , Will Perkins

We consider systems of conservation laws endowed with a convex entropy. We show the contraction, up to a translation, to extremal entropic shocks, for a pseudo-distance based on the notion of relative entropy. The contraction holds for…

Analysis of PDEs · Mathematics 2013-09-17 Alexis Vasseur

Randomization tests rely on simple data transformations and possess an appealing robustness property. In addition to being finite-sample valid if the data distribution is invariant under the transformation, these tests can be asymptotically…

Methodology · Statistics 2024-04-23 Panos Toulis

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

This paper concerns the estimation of sums of functions of observable and unobservable variables. Lower bounds for the asymptotic variance and a convolution theorem are derived in general finite- and infinite-dimensional models. An explicit…

Statistics Theory · Mathematics 2007-06-13 Cun-Hui Zhang

We study (asymmetric) $U$-statistics based on a stationary sequence of $m$-dependent variables; moreover, we consider constrained $U$-statistics, where the defining multiple sum only includes terms satisfying some restrictions on the gaps…

Probability · Mathematics 2022-03-10 Svante Janson

Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when…

Statistical Mechanics · Physics 2013-04-04 Valentina Baccetti , Matt Visser

In a recent work on the bipartite Erd\H{o}s-R\'{e}nyi graph, Do et al. (2023) established upper bounds on the number of connected labeled bipartite graphs with a fixed surplus. We use some recent encodings of bipartite random graphs in…

Combinatorics · Mathematics 2024-11-15 David Clancy

A lower bound for the Wehrl entropy of a single quantum spin is derived. The high-spin asymptotics of this bound coincides with Lieb's conjecture up to, but not including, terms of first and higher order in the inverse spin quantum number.…

Mathematical Physics · Physics 2009-11-10 Bernhard G. Bodmann

The entropy per coordinate in a log-concave random vector of any dimension with given density at the mode is shown to have a range of just 1. Uniform distributions on convex bodies are at the lower end of this range, the distribution with…

Information Theory · Computer Science 2024-05-07 Sergey Bobkov , Mokshay Madiman

A novel, non-trivial, probabilistic upper bound on the entropy of an unknown one-dimensional distribution, given the support of the distribution and a sample from that distribution, is presented. No knowledge beyond the support of the…

Information Theory · Computer Science 2007-07-13 Joseph DeStefano , Erik Learned-Miller

Consider an urn containing balls labeled with integer values. Define a discrete-time random process by drawing two balls, one at a time and with replacement, and noting the labels. Add a new ball labeled with the sum of the two drawn…

Probability · Mathematics 2023-06-22 Mackenzie Simper

General hyperbolic systems of balance laws with inhomogeneity in space and time in all constitutive functions are studied in the context of relative entropy. A framework is developed in this setting that contributes to a measure-valued weak…

Analysis of PDEs · Mathematics 2022-06-02 Cleopatra Christoforou

We consider the entropy of the solution to the heat equation on a Riemannian manifold. When the manifold is compact, we provide two estimates on the rate of change of the entropy in terms of the lower bound on the Ricci curvature and the…

Differential Geometry · Mathematics 2013-01-30 Adrian P. C. Lim , Dejun Luo

This work considers new entropy-based proofs of some known, or otherwise refined, combinatorial bounds for bipartite graphs. These include upper bounds on the number of the independent sets, lower bounds on the minimal number of colors in…

Information Theory · Computer Science 2021-06-15 Igal Sason

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

Entropy serves as a central observable which indicates uncertainty in many chemical, thermodynamical, biological and ecological systems, and the principle of the maximum entropy (MaxEnt) is widely supported in natural science. Recently,…

Physics and Society · Physics 2015-06-03 Bin Xu , Hongen Zhang , Zhijian Wang , Jianbo Zhang