English
Related papers

Related papers: R\'enyi entropy for multivariate controlled autore…

200 papers

A task is randomly drawn from a finite set of tasks and is described using a fixed number of bits. All the tasks that share its description must be performed. Upper and lower bounds on the minimum $\rho$-th moment of the number of performed…

Information Theory · Computer Science 2014-10-07 Christoph Bunte , Amos Lapidoth

Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical…

We investigate quantum R\'enyi entropic quantities, specifically those derived from 'sandwiched' divergence. This divergence is one of several proposed R\'enyi generalisations of the quantum relative entropy. We may define R\'enyi…

Quantum Physics · Physics 2021-10-04 Alexander McKinlay

We use a R\'enyi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum or classical communication between two parties. These include state redistribution,…

Quantum Physics · Physics 2016-08-10 Felix Leditzky , Mark M. Wilde , Nilanjana Datta

A scheme is presented to extract detailed dynamical signatures from successive measurements of complex systems. Relative entropy based time series tools are used to quantify the gain in predictive power of increasing past knowledge. By…

Data Analysis, Statistics and Probability · Physics 2008-12-31 Nick S. Jones

A large class of strongly correlated quantum systems can be described in certain large-N limits by quadratic in field actions along with self-consistency equations that determine the two-point functions. We use the replica approach and the…

Strongly Correlated Electrons · Physics 2024-02-20 Siqi Shao , Yashar Komijani

Atar, Chowdhary and Dupuis have recently exhibited a variational formula for exponential integrals of bounded measurable functions in terms of R\'enyi divergences. We develop a variational characterization of the R\'enyi divergences between…

Information Theory · Computer Science 2017-01-27 Venkat Anantharam

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Hussein Sibai , Sayan Mitra

The rate of entropy production provides a useful quantitative measure of a non-equilibrium system and estimating it directly from time-series data from experiments is highly desirable. Several approaches have been considered for stationary…

Statistical Mechanics · Physics 2022-02-21 Shun Otsubo , Sreekanth K Manikandan , Takahiro Sagawa , Supriya Krishnamurthy

The entropy production is one of the most essential features for systems operating out of equilibrium. The formulation for discrete-state systems goes back to the celebrated Schnakenberg's work and hitherto can be carried out when for each…

Statistical Mechanics · Physics 2020-04-15 D. M. Busiello , D. Gupta , A. Maritan

The multi-entropy and dihedral measures are a class of tractable measures for multi-partite entanglement, which are labeled by the R\'enyi index (or replica number) $n$ as in the R\'enyi entanglement entropy. The purpose of this article is…

High Energy Physics - Theory · Physics 2025-06-13 Jonathan Harper , Ali Mollabashi , Tadashi Takayanagi , Kenya Tasuki

Despite being a well-established operational approach to quantify entanglement, R\'enyi entropy calculations have been plagued by their computational complexity. We introduce here a theoretical framework based on an optimal thermodynamic…

Statistical Mechanics · Physics 2022-07-14 Miha Srdinšek , Michele Casula , Rodolphe Vuilleumier

A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…

Information Theory · Computer Science 2026-03-10 Razvan Gabriel Iagar , David Puertas-Centeno

Semi-Markov processes play an important role in the effective description of partially accessible systems in stochastic thermodynamics. They occur, for instance, in coarse-graining procedures such as state lumping and when analyzing waiting…

Statistical Mechanics · Physics 2026-01-19 Alexander M. Maier , Jonas H. Fritz , Udo Seifert

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…

Statistical Mechanics · Physics 2017-09-20 Vincenzo Alba , Pasquale Calabrese

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

Quantum entanglement, lacking any classical counterpart, provides a fundamental new route to characterize the quantum nature of many-body states. In this work, we discuss an implementation of a new path integral method [Phys. Rev. Res. 2,…

Strongly Correlated Electrons · Physics 2024-02-06 Surajit Bera , Arijit Haldar , Sumilan Banerjee

The entropy production rate is central to the study of non-equilibrium systems. This parameter is closely connected to violation of time-reversal symmetry, energy consumption, efficiency, and other properties of interest; in short, it…

Statistical Mechanics · Physics 2026-05-28 John W. Biddle

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay