English
Related papers

Related papers: R\'enyi entropy for multivariate controlled autore…

200 papers

We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…

Strongly Correlated Electrons · Physics 2010-11-02 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

Model predictive control (MPC) is a powerful control technique for online optimization using system model-based predictions over a finite time horizon. However, the computational cost MPC requires can be prohibitive in resource-constrained…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Juan Augusto Paredes Salazar , Ankit Goel

Renyi entropy with multiple disjoint intervals are computed from the improved swapping operations by two methods: one is from the direct diagonalization of the Hamiltonian and the other one is from the state-of-the-art machine learning…

Statistical Mechanics · Physics 2025-10-30 Han-Qing Shi , Hai-Qing Zhang

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 S. K. Katiyar , P. V. Arun

Time-reversal symmetry breaking and entropy production are universal features of nonequilibrium phenomena. Despite its importance in the physics of active and living systems, the entropy production of systems with many degrees of freedom…

The random matrix ensembles (RME) of quantum statistical Hamiltonians, e.g. Gaussian random matrix ensembles (GRME) and Ginibre random matrix ensembles (Ginibre RME), are applied in literature to following quantum statistical systems:…

Statistical Mechanics · Physics 2007-05-23 Maciej M. Duras

This paper explores some applications of a two-moment inequality for the integral of the $r$-th power of a function, where $0 < r< 1$. The first contribution is an upper bound on the R\'{e}nyi entropy of a random vector in terms of the two…

Information Theory · Computer Science 2017-02-24 Galen Reeves

A comprehensive investigation of the entanglement characteristics is carried out on tripartite spin-1/2 systems, examining prototypical tripartite states, the thermal Heisenberg model, and the transverse field Ising model. The entanglement…

Quantum Physics · Physics 2024-11-05 Marwa Mannaï , Hisham Sati , Tim Byrnes , Chandrashekar Radhakrishnan

The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t-entropy, which exploits the concavity of the inverse-tan function. We analytically…

Information Theory · Computer Science 2021-05-06 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

Quantum information processing is limited, in practice, to efficiently implementable operations. This motivates the study of quantum divergences that preserve their operational meaning while faithfully capturing these computational…

Quantum Physics · Physics 2025-09-26 Álvaro Yángüez , Thomas A. Hahn , Jan Kochanowski

Entropy production is arguably the most universally applicable measure of non-equilibrium behavior, particularly for systems coupled to a heat bath. This setting encompasses driven soft matter as well as biomolecular, biochemical, and…

Statistical Mechanics · Physics 2025-12-09 Udo Seifert

This study examines sharp bounds on Arimoto's conditional R\'enyi entropy of order $\beta$ with a fixed another one of distinct order $\alpha \neq \beta$. Arimoto inspired the relation between the R\'enyi entropy and the $\ell_{r}$-norm of…

Information Theory · Computer Science 2020-08-24 Yuta Sakai , Ken-ichi Iwata

Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum R\'enyi entropies. In order to do this, we appeal to a very general quantum encoding scheme that…

Quantum Physics · Physics 2017-10-05 G. Bellomo , G. M. Bosyk , F. Holik , S. Zozor

This paper introduces the Lambda extension of the R\'{e}nyi entropic value-at-risk ($\Lambda$-EVaR), a novel family of risk measures that unifies the flexible confidence level structure of the $\Lambda$-framework with the higher-moment…

Risk Management · Quantitative Finance 2026-04-14 Zhenfeng Zou

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

Measuring entropy production of a system directly from the experimental data is highly desirable since it gives a quantifiable measure of the time-irreversibility for non-equilibrium systems and can be used as a cost function to optimize…

Statistical Mechanics · Physics 2024-07-16 Prashant Singh , Karel Proesmans

We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…

Statistical Mechanics · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

In this paper, we present several novel representations of $\alpha$-mutual information ($\alpha$-MI) in terms of R{\' e}nyi divergence and conditional R{\' e}nyi entropy. The representations are based on the variational characterizations of…

Information Theory · Computer Science 2025-05-01 Akira Kamatsuka , Takashiro Yoshida

The Tsallis and R\'enyi entropies are important quantities in the information theory, statistics and related fields because the Tsallis entropy is an one parameter generalization of the Shannon entropy and the R\'enyi entropy includes…

Quantum Physics · Physics 2014-12-24 Yusuke Ide , Norio Konno , Junji Shikata