English
Related papers

Related papers: R\'{e}nyi Cross-Entropy Measures for Common Distri…

200 papers

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

Cross-entropy is a widely used loss function in applications. It coincides with the logistic loss applied to the outputs of a neural network, when the softmax is used. But, what guarantees can we rely on when using cross-entropy as a…

Machine Learning · Computer Science 2023-06-21 Anqi Mao , Mehryar Mohri , Yutao Zhong

Nearly all practical neural models for classification are trained using cross-entropy loss. Yet this ubiquitous choice is supported by little theoretical or empirical evidence. Recent work (Hui & Belkin, 2020) suggests that training using…

Machine Learning · Computer Science 2023-02-09 Like Hui , Mikhail Belkin , Stephen Wright

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

Tsallis and R\'{e}nyi entropies, which are monotone transformations of each other, are deformations of the celebrated Shannon entropy. Maximization of these deformed entropies, under suitable constraints, leads to the $q$-exponential family…

Probability · Mathematics 2022-01-14 Ting-Kam Leonard Wong , Jun Zhang

Due to their flexibility and predictive performance, machine-learning based regression methods have become an important tool for predictive modeling and forecasting. However, most methods focus on estimating the conditional mean or specific…

Machine Learning · Statistics 2019-03-15 Rui Li , Howard D. Bondell , Brian J. Reich

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

Quantum Physics · Physics 2014-01-28 Martin Müller-Lennert , Frédéric Dupuis , Oleg Szehr , Serge Fehr , Marco Tomamichel

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

Minimizing cross-entropy is a widely used method for training artificial neural networks. Many training procedures based on backpropagation use cross-entropy directly as their loss function. Instead, this theoretical essay investigates a…

Machine Learning · Computer Science 2021-04-28 Stefan Jaeger

R\'enyi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In…

Statistics Theory · Mathematics 2025-10-28 Salah H. Abid , Uday J. Quaez , Javier E. Contreras-Reyescor

In computer vision, it is often observed that formulating regression problems as a classification task often yields better performance. We investigate this curious phenomenon and provide a derivation to show that classification, with the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shihao Zhang , Linlin Yang , Michael Bi Mi , Xiaoxu Zheng , Angela Yao

This paper gives improved R\'{e}nyi entropy power inequalities (R-EPIs). Consider a sum $S_n = \sum_{k=1}^n X_k$ of $n$ independent continuous random vectors taking values on $\mathbb{R}^d$, and let $\alpha \in [1, \infty]$. An R-EPI…

Information Theory · Computer Science 2016-07-21 Eshed Ram , Igal Sason

Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend…

Statistics Theory · Mathematics 2019-01-31 Salah H. Abid , Uday J. Quaez

Shannon entropy is widely used to measure the complexity of DNA sequences but suffers from saturation effects that limit its discriminative power for long uniform segments. We introduce a novel metric, the entropy rank ratio R, which…

Information Theory · Computer Science 2025-11-10 Emmanuel Pio Pastore , Giuseppe Passarino , Peppino Sapia , Francesco De Rango

R\'enyi entropy is a one-parameter generalization of Shannon entropy, which has been used in various fields of physics. Despite its wide applicability, the physical interpretations of the R\'enyi entropy are not widely known. In this paper,…

Statistical Mechanics · Physics 2024-08-29 Misaki Ozawa , Nina Javerzat

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

Estimation of Shannon and R\'enyi entropies of unknown discrete distributions is a fundamental problem in statistical property testing and an active research topic in both theoretical computer science and information theory. Tight bounds on…

Quantum Physics · Physics 2023-07-19 Tongyang Li , Xiaodi Wu

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

Shannon entropy is the shortest average codeword length a lossless compressor can achieve by encoding i.i.d. symbols. However, there are cases in which the objective is to minimize the \textit{exponential} average codeword length, i.e. when…

Information Theory · Computer Science 2024-06-10 Andrea Somazzi , Paolo Ferragina , Diego Garlaschelli