English
Related papers

Related papers: Varentropy Estimation via Nearest Neighbor Graphs

200 papers

Irregularly sampling a spatially stationary random field does not yield a graph stationary signal in general. Based on this observation, we build a definition of graph stationarity based on intrinsic stationarity, a less restrictive…

Signal Processing · Electrical Eng. & Systems 2018-09-26 Alexander Serrano , Benjamin Girault , Antonio Ortega

We use the $f-divergence$ also called relative entropy as a measure of diversity between probability densities and review its basic properties. In the sequence we define a few objects which capture relevant information from the sample of a…

Statistics Theory · Mathematics 2012-06-20 A. R. Baigorri , C. R. Goncalves , P. A. A. Resende

The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of…

Information Theory · Computer Science 2020-04-22 Conor Finn , Joseph T. Lizier

In many statistical studies, the measure of uncertainties like entropy, extropy, varentropy and varextropy of a distribution function is of prime interest. This paper proposes estimators of extropy and varextropy. Proposed estimators are…

Statistics Theory · Mathematics 2024-01-25 Santosh Kumar Chaudhary , Nitin Gupta

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

A natural representation of random graphs is the random measure. The collection of product random measures, their transformations, and non-negative test functions forms a general representation of the collection of non-negative weighted…

Probability · Mathematics 2022-04-21 Caleb Bastian , Herschel Rabitz

Stimulated by the need of describing useful notions related to information measures, we introduce the `pdf-related distributions'. These are defined in terms of transformation of absolutely continuous random variables through their own…

Probability · Mathematics 2024-05-02 Antonio Di Crescenzo , Luca Paolillo , Alfonso Suarez-Llorens

Recent advances in Neural Variational Inference allowed for a renaissance in latent variable models in a variety of domains involving high-dimensional data. While traditional variational methods derive an analytical approximation for the…

Machine Learning · Computer Science 2019-08-20 Alexander I. Cowen-Rivers , Pasquale Minervini , Tim Rocktaschel , Matko Bosnjak , Sebastian Riedel , Jun Wang

Asymptotic equivalence results for nonparametric regression experiments have always assumed that the variances of the observations are known. In practice, however the variance of each observation is generally considered to be an unknown…

Statistics Theory · Mathematics 2007-11-06 Andrew V. Carter

A random intersection graph is constructed by independently assigning a subset of a given set of objects $W,$ to each vertex of the vertex set $V$ of a simple graph $G.$ There is an edge between two vertices of $V,$ iff their respective…

Probability · Mathematics 2008-09-09 Bhupendra Gupta

A random graph evolution based on the interactions of N vertices is studied. During the evolution both the preferential attachment method and the uniform choice of vertices are allowed. The weight of a vertex means the number of its…

Probability · Mathematics 2014-05-07 István Fazekas , Bettina Porvázsnyik

We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…

Methodology · Statistics 2014-08-29 Jhan Rodríguez , András Bárdossy

The von Neumann entropy of a graph is a spectral complexity measure that has recently found applications in complex networks analysis and pattern recognition. Two variants of the von Neumann entropy exist based on the graph Laplacian and…

Quantum Physics · Physics 2019-01-30 Giorgia Minello , Luca Rossi , Andrea Torsello

The variance of the concentration in a sample can be estimated using knowledge of the particle masses, concentrations and the parameter for the dependent selection of particles. A number of variance estimators are constructed including a…

Applications · Statistics 2010-05-18 B. Geelhoed

Nonresponse is a common problem in survey sampling. Appropriate treatment can be challenging, especially when dealing with detailed breakdowns of totals. Often, the nearest neighbor imputation method is used to handle such incomplete…

Methodology · Statistics 2023-02-24 Chenyin Gao , Katherine Jenny Thompson , Shu Yang , Jae Kwang Kim

Quantifying the complexity of large graphs requires measures that extend beyond predefined structural features and scale efficiently with graph size. This work adopts a generative perspective, modeling large networks as exchangeable graphs…

Information Theory · Computer Science 2025-03-14 Anda Skeja , Sofia C. Olhede

In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated…

Statistics Theory · Mathematics 2024-04-11 François Portier

Node regression consists in predicting the value of a graph label at a node, given observations at the other nodes. To gain some insight into the performance of various estimators for this task, we perform a theoretical study in a context…

Machine Learning · Statistics 2024-10-30 Martin Gjorgjevski , Nicolas Keriven , Simon Barthelmé , Yohann De Castro

In this paper, a new measurement to compare two large-scale graphs based on the theory of quantum probability is proposed. An explicit form for the spectral distribution of the corresponding adjacency matrix of a graph is established. Our…

Discrete Mathematics · Computer Science 2018-07-03 Hayoung Choi , Hosoo Lee , Yifei Shen , Yuanming Shi

A problem of improving the accuracy of nonparametric entropy estimation for a stationary ergodic process is considered. New weak metrics are introduced and relations between metrics, measures, and entropy are discussed. Based on weak…

Information Theory · Computer Science 2024-11-04 Evgeniy Timofeev , Alexei Kaltchenko