English
Related papers

Related papers: R\'enyi entropy for multivariate controlled autore…

200 papers

We present a general method for calculating R\'enyi entropies in the ground state of a one-dimensional critical system with mixed open boundaries, for an interval starting at one of its ends. In the conformal field theory framework, this…

Statistical Mechanics · Physics 2025-11-12 Benoit Estienne , Yacine Ikhlef , Andrei Rotaru

The interplay of quantum and classical fluctuations in the vicinity of a quantum critical point (QCP) gives rise to various regimes or phases with distinct quantum character. In this work, we show that the R\'enyi entropy is a precious tool…

Statistical Mechanics · Physics 2023-12-29 Miha Srdinšek , Michele Casula , Rodolphe Vuilleumier

We study the statistical physics of the classical Ising model in the so-called $\alpha$-R\'enyi ensemble, a finite-temperature thermal state approximation that minimizes a modified free energy based on the $\alpha$-R\'enyi entropy. We begin…

Statistical Mechanics · Physics 2025-09-23 Andrew Jreissaty , Juan Carrasquilla

Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…

Information Theory · Computer Science 2026-02-02 Roberto Rubboli , Erkka Haapasalo , Marco Tomamichel

We propose and experimentally measure an entropy that quantifies the volume of correlations among qubits. The experiment is carried out on a nearly isolated quantum system composed of a central spin coupled and initially uncorrelated with…

Quantum Physics · Physics 2021-08-25 Mohamad Niknam , Lea F. Santos , David G. Cory

Conventional information-theoretic quantities assume access to probability distributions. Estimating such distributions is not trivial. Here, we consider function-based formulations of cross entropy that sidesteps this a priori estimation…

Information Theory · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…

Information Theory · Computer Science 2012-04-13 Marek Śmieja , Jacek Tabor

In recent years entanglement measures, such as the von Neumann and the R\'enyi entropies, provided a unique opportunity to access elusive feature of quantum many-body systems. However, extracting entanglement properties analytically,…

Strongly Correlated Electrons · Physics 2017-07-03 Vincenzo Alba

R\'enyi transfer entropy (RTE) is a generalization of classical transfer entropy that replaces Shannon's entropy with R\'enyi's information measure. This, in turn, introduces a new tunable parameter $\alpha$, which accounts for sensitivity…

Pattern Formation and Solitons · Physics 2026-01-06 Zlata Tabachová , Petr Jizba , Hynek Lavička , Milan Paluš

The information on a quantum process acquired through measurements plays a crucial role in the determination of its non-equilibrium thermodynamic properties. We report on the experimental inference of the stochastic entropy production rate…

Recursive Bayesian inference (RBI) provides optimal Bayesian latent variable estimates in real-time settings with streaming noisy observations. Active RBI attempts to effectively select queries that lead to more informative observations to…

Machine Learning · Computer Science 2021-03-11 Yeganeh M. Marghi , Aziz Kocanaogullari , Murat Akcakaya , Deniz Erdogmus

Uncovering causal interdependencies from observational data is one of the great challenges of nonlinear time series analysis. In this paper, we discuss this topic with the help of information-theoretic concept known as R\'enyi information…

Information Theory · Computer Science 2022-06-28 Petr Jizba , Hynek Lavička , Zlata Tabachová

The measured relative entropy and measured R\'enyi relative entropy are quantifiers of the distinguishability of two quantum states $\rho$ and $\sigma$. They are defined as the maximum classical relative entropy or R\'enyi relative entropy…

Quantum Physics · Physics 2025-11-25 Zixin Huang , Mark M. Wilde

One among the most intriguing results coming from the application of statistical mechanics to the study of brain is the understanding that it, as a dynamical system, is inherently out of equilibrium. In the realm of non-equilibrium…

Disordered Systems and Neural Networks · Physics 2025-12-01 Dario Lucente , Giacomo Gradenigo , Luca Salasnich

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

Information Theory · Computer Science 2008-12-18 Jean-François Bercher

In this note, we studied the asymptotic behaviour of the length of the longest common substring for run-length encoded sequences. When the original sequences are generated by an $\alpha$-mixing process with exponential decay (or…

Probability · Mathematics 2020-12-14 Jerome Rousseau

In Tokenization and the Noiseless Channel (Zouhar et al., 2023a), R\'enyi efficiency is suggested as an intrinsic mechanism for evaluating a tokenizer: for NLP tasks, the tokenizer which leads to the highest R\'enyi efficiency of the…

Computation and Language · Computer Science 2024-03-01 Marco Cognetta , Vilém Zouhar , Sangwhan Moon , Naoaki Okazaki

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…

Statistical Mechanics · Physics 2022-08-04 Bruno Bertini , Katja Klobas , Vincenzo Alba , Gianluca Lagnese , Pasquale Calabrese

We propose a method for inferring entropy production (EP) in high-dimensional stochastic systems, including many-body systems and non-Markovian systems with long memory. Standard techniques for estimating EP become intractable in such…

Statistical Mechanics · Physics 2026-02-20 Miguel Aguilera , Sosuke Ito , Artemy Kolchinsky