English
Related papers

Related papers: Generalized R\'enyi statistics

200 papers

This work deals with the estimation of the extreme value index and extreme quantiles for heavy tailed data,randomly right truncated by another heavy tailed variable. Under mild assumptions and the condition thatthe truncated variable is…

Statistics Theory · Mathematics 2015-07-16 Julien Worms , Rym Worms

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

We derive exponential bounds for tail of distribution for natural, i.e. under ordinary logarithm, normalized sums of arrays of random variables, not necessarily independent.

We present a general non-parametric statistical inference theory for integrals of quantiles without assuming any specific sampling design or dependence structure. Technical considerations are accompanied by examples and discussions,…

Statistics Theory · Mathematics 2026-01-19 Nadezhda Gribkova , Mengqi Wang , Ričardas Zitikis

Across the sciences, the statistical analysis of networks is central to the production of knowledge on relational phenomena. Because of their ability to model the structural generation of networks, exponential random graph models are a…

Data Analysis, Statistics and Probability · Physics 2015-05-27 Bruce A. Desmarais , Skyler J. Cranmer

An important part of the legacy of Evarist Gin\'e is his fundamental contributions to our understanding of $U$-statistics and $U$-processes. In this paper we discuss the estimation of the mean of multivariate functions in case of possibly…

Statistics Theory · Mathematics 2015-04-20 Emilien Joly , Gábor Lugosi

Let $X_{1},X_{2},...$ be a sequence of independent copies (s.i.c) of a real random variable (r.v.) $X\geq 1$, with distribution function $df$ $F(x)=\mathbb{P}% (X\leq x)$ and let $X_{1,n}\leq X_{2,n} \leq ... \leq X_{n,n}$ be the order…

Methodology · Statistics 2011-11-22 Gane Samb Lo , El Hadji Deme , Aliou Diop

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

We find the value of constants related to constraints in characterization of some known statistical distributions and then we proceed to use the idea behind maximum entropy principle to derive generalized version of this distributions using…

Statistical Mechanics · Physics 2007-05-23 Oscar Sotolongo-Costa , Alejandro Gonzalez Gonzalez , Francois Brouers

Two R\'{e}nyi-type generalizations of the Shannon cross-entropy, the R\'{e}nyi cross-entropy and the Natural R\'{e}nyi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial…

Information Theory · Computer Science 2022-10-06 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

In this correspondence, we correct an erroneous result on the achievability part of the R\'enyi common information with order $1+s\in(1,2]$ in [1]. The new achievability result (upper bound) of the R\'enyi common information no longer…

Information Theory · Computer Science 2020-02-18 Lei Yu , Vincent Y. F. Tan

We study the isotonic regression estimator over a general countable pre-ordered set. We obtain the limiting distribution of the estimator and study its properties. It is proved that, under some general assumptions, the limiting distribution…

Statistics Theory · Mathematics 2018-11-06 Dragi Anevski , Vladimir Pastukhov

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2018-08-24 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Zhi-Hua Zhou

In this paper we are concerned with the analysis of heavy-tailed data when a portion of the extreme values is unavailable. This research was motivated by an analysis of the degree distributions in a large social network. The degree…

Statistics Theory · Mathematics 2018-12-20 Jingjing Zou , Richard A. Davis , Gennady Samorodnitsky

The conventional approach to data-driven inversion framework is based on Gaussian statistics that presents serious difficulties, especially in the presence of outliers in the measurements. In this work, we present maximum likelihood…

We consider a sequence of complex rational maps (f_n) of a fixed degree d at least 2. Building on the seminal work of Kiwi, we introduce the notion of generalized rescaling limits. These are rational maps possibly defined over a…

Dynamical Systems · Mathematics 2026-05-12 Charles Favre , Chen Gong

We introduce a general class of algorithms and supply a number of general results useful for analysing these algorithms when applied to regular graphs of large girth. As a result, we can transfer a number of results proved for random…

Combinatorics · Mathematics 2017-03-06 Carlos Hoppen , Nicholas Wormald

Let $X_{1,n}\le\cdots\le X_{n,n}$ be the order statistics of $n$ independent random variables with a common distribution function $F$ having right heavy tail with tail index $\gamma$. Given known constants $d_{i,n}$, $1\le i\le n$, consider…

Probability · Mathematics 2021-04-13 Lillian Achola Oluoch , László Viharos

Preferential attachment is widely used to model power-law behavior of degree distributions in both directed and undirected networks. Practical analyses on the tail exponent of the power-law degree distribution use the Hill estimator as one…

Probability · Mathematics 2017-11-17 Tiandong Wang , Sidney Resnick