English
Related papers

Related papers: On the Practical Estimation and Interpretation of …

200 papers

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

One of the most influential results in neural network theory is the universal approximation theorem [1, 2, 3] which states that continuous functions can be approximated to within arbitrary accuracy by single-hidden-layer feedforward neural…

Machine Learning · Computer Science 2021-12-16 Clemens Hutter , Recep Gül , Helmut Bölcskei

Deep reinforcement learning (RL) has shown remarkable success in complex domains, however, the inherent black box nature of deep neural network policies raises significant challenges in understanding and trusting the decision-making…

Machine Learning · Computer Science 2025-01-20 Peilang Li , Umer Siddique , Yongcan Cao

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Mainstream Test-Time Adaptation (TTA) methods for adapting vision-language models, e.g., CLIP, typically rely on Shannon Entropy (SE) at test time to measure prediction uncertainty and inconsistency. However, since CLIP has a built-in bias…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xiangyu Wu , Dongming Jiang , Feng Yu , Yueying Tian , Jiaqi Tang , Qing-Guo Chen , Yang Yang , Jianfeng Lu

We explore a large class of correlation measures called the $\alpha-z$ R\'enyi mutual informations (RMIs). Unlike the commonly used notion of RMI involving linear combinations of R\'enyi entropies, the $\alpha-z$ RMIs are positive…

High Energy Physics - Theory · Physics 2024-08-27 Jonah Kudler-Flam , Laimei Nie , Akash Vijay

A two-parameter family of complexity measures $\tilde{C}^{(\alpha,\beta)}$ based on the R\'enyi entropies is introduced and characterized by a detailed study of its mathematical properties. This family is the generalization of a continuous…

Quantum Physics · Physics 2015-05-13 R. Lopez-Ruiz , A. Nagy , E. Romera , J. Sanudo

The equivalence between non-extensive C. Tsallis entropy and the extensive entropy introduced by Alfr\'ed R\'enyi is discussed. The R\'enyi entropy is studied from the perspective of the geometry of the Lebesgue and generalised, exotic…

Data Analysis, Statistics and Probability · Physics 2014-02-25 Giorgio Sonnino , György Steinbrecher , Alberto Sonnino

R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…

Statistical Mechanics · Physics 2022-08-04 Bruno Bertini , Katja Klobas , Vincenzo Alba , Gianluca Lagnese , Pasquale Calabrese

Subword tokenization is a key part of many NLP pipelines. However, little is known about why some tokenizer and hyperparameter combinations lead to better downstream model performance than others. We propose that good tokenizers lead to…

Computation and Language · Computer Science 2023-06-30 Vilém Zouhar , Clara Meister , Juan Luis Gastaldi , Li Du , Mrinmaya Sachan , Ryan Cotterell

We revisit the problem of asymmetric binary hypothesis testing against a composite alternative hypothesis. We introduce a general framework to treat such problems when the alternative hypothesis adheres to certain axioms. In this case we…

Information Theory · Computer Science 2017-12-12 Marco Tomamichel , Masahito Hayashi

The asymptotic restriction problem for tensors can be reduced to finding all parameters that are normalized, monotone under restrictions, additive under direct sums and multiplicative under tensor products, the simplest of which are the…

Mathematical Physics · Physics 2023-02-13 Dávid Bugár , Péter Vrana

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

Machine Learning · Computer Science 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

The R\'enyi-Shannon entropy associated to critical quantum spins chain with central charge $c=1$ is shown to have a phase transition at some value $n_c$ of the R\'enyi parameter $n$ which depends on the Luttinger parameter (or…

Strongly Correlated Electrons · Physics 2011-11-30 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

This paper introduces "swiveled Renyi entropies" as an alternative to the Renyi entropic quantities put forward in [Berta et al., Phys. Rev. A 91, 022333 (2015)]. What distinguishes the swiveled Renyi entropies from the prior proposal of…

Quantum Physics · Physics 2016-03-22 Frédéric Dupuis , Mark M. Wilde