English
Related papers

Related papers: Quantum query complexity of entropy estimation

200 papers

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…

Statistical Mechanics · Physics 2017-09-20 Vincenzo Alba , Pasquale Calabrese

Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…

Disordered Systems and Neural Networks · Physics 2025-08-27 Nina Javerzat , Eric Bertin , Misaki Ozawa

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

The R\'enyi entropies $R_{p}[\rho], 0<p<\infty$ of the probability density $\rho_{n,l,m}(\vec{r})$ of a physical system completely characterize the chemical and physical properties of the quantum state described by the three integer quantum…

Quantum Physics · Physics 2016-04-01 I. V. Toranzo , J. S. Dehesa

We demonstrate that the Renyi-2 entropy provides a natural measure of information for any multimode Gaussian state of quantum harmonic systems, operationally linked to the phase-space Shannon sampling entropy of the Wigner distribution of…

Quantum Physics · Physics 2013-05-27 Gerardo Adesso , Davide Girolami , Alessio Serafini

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1…

Data Analysis, Statistics and Probability · Physics 2011-11-09 P. Grassberger

We develop a quantum version of the probability estimation framework [arXiv:1709.06159] for randomness generation with quantum side information. We show that most of the properties of probability estimation hold for quantum probability…

Quantum Physics · Physics 2023-02-06 Emanuel Knill , Yanbao Zhang , Honghao Fu

Finite-size general security proofs for quantum key distribution based on R\'enyi entropies have recently been introduced. These approaches are more flexible and provide tighter bounds on the secret key rate than traditional formulations…

Uniform continuity bounds on entropies are generally expressed in terms of a single distance measure between a pair of probability distributions or quantum states, typically, the total variation distance or trace distance. However, if an…

Quantum Physics · Physics 2025-01-09 Michael G. Jabbour , Nilanjana Datta

Unraveling the secrets of how much nonstabilizerness a quantum dynamic can generate is crucial for harnessing the power of magic states, the essential resources for achieving quantum advantage and realizing fault-tolerant quantum…

Quantum Physics · Physics 2024-09-11 Chengkai Zhu , Yu-Ao Chen , Zanqiu Shen , Zhiping Liu , Zhan Yu , Xin Wang

This paper gives upper and lower bounds on the minimum error probability of Bayesian $M$-ary hypothesis testing in terms of the Arimoto-R\'enyi conditional entropy of an arbitrary order $\alpha$. The improved tightness of these bounds over…

Information Theory · Computer Science 2017-12-06 Igal Sason , Sergio Verdú

Quantum technologies offer significant advancements in information processing and communication, notably in the domain of random number generation (RNG). The use of Bell inequalities enables users to certify the randomness of outputs…

Quantum Physics · Physics 2025-12-01 Robert Okuła , Piotr Mironowicz

Entanglement entropy is an essential metric for characterizing quantum many-body systems, but its numerical evaluation for neural network representations of quantum states has so far been inefficient and demonstrated only for the restricted…

Quantum Physics · Physics 2020-12-21 Zhaoyou Wang , Emily J. Davis

The fundamental goal of information theory is to characterize complex operational tasks using efficiently computable information quantities, Shannon's capacity formula being the prime example of this. However, many tasks in quantum…

Quantum Physics · Physics 2025-07-22 Salman Beigi , Roberto Rubboli , Marco Tomamichel

A method for estimating the Shannon differential entropy of multidimensional random variables using independent samples is described. The method is based on decomposing the distribution into a product of the marginal distributions and the…

Statistical Mechanics · Physics 2020-04-22 Gil Ariel , Yoram Louzoun

Quantum information-theoretic approach has been identified as a way to understand the foundations of quantum mechanics as early as 1950 due to Shannon. However there hasn't been enough advancement or rigorous development of the subject. In…

Quantum Physics · Physics 2018-07-04 Shubhayan Sarkar

Shannon's entropy is one of the building blocks of information theory and an essential aspect of Machine Learning methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable…

Statistics Theory · Mathematics 2022-05-25 Jialin Zhang , Jingyi Shi

Information has an entropic character which can be analyzed within the Statistical Theory in molecular systems. R. Landauer and C.H. Bennett showed that a logical copy can be carried out in the limit of no dissipation if the computation is…

Biological Physics · Physics 2012-08-15 J. Ricardo Arias-Gonzalez

Feature selection, in the context of machine learning, is the process of separating the highly predictive feature from those that might be irrelevant or redundant. Information theory has been recognized as a useful concept for this task, as…

Machine Learning · Computer Science 2020-01-28 Catuscia Palamidessi , Marco Romanelli