English
Related papers

Related papers: Varentropy Estimation via Nearest Neighbor Graphs

200 papers

Connectedness measures the degree at which a time-series variable spills over volatility to other variables compared to the rate that it is receiving. The idea is based on the percentage of variance decomposition from one variable to the…

Econometrics · Economics 2024-05-07 Abdulnasser Hatemi-J

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Let $G_n$ be a random geometric graph with vertex set $[n]$ based on $n$ i.i.d.\ random vectors $X_1,\ldots,X_n$ drawn from an unknown density $f$ on $\R^d$. An edge $(i,j)$ is present when $\|X_i -X_j\| \le r_n$, for a given threshold…

Machine Learning · Statistics 2023-11-23 Caelan Atamanchuk , Luc Devroye , Gabor Lugosi

For complex latent variable models, the likelihood function is not available in closed form. In this context, a popular method to perform parameter estimation is Importance Weighted Variational Inference. It essentially maximizes the…

Statistics Theory · Mathematics 2025-01-16 Badr-Eddine Cherief-Abdellatif , Randal Douc , Arnaud Doucet , Hugo Marival

This paper presents a novel application of graph neural networks for modeling and estimating network heterogeneity. Network heterogeneity is characterized by variations in unit's decisions or outcomes that depend not only on its own…

Econometrics · Economics 2024-01-30 Yike Wang , Chris Gu , Taisuke Otsu

This paper introduces a simple measure of a concordance pattern among observed outcomes along a network, i.e., the pattern in which adjacent outcomes tend to be more strongly correlated than non-adjacent outcomes. The graph concordance…

Methodology · Statistics 2017-09-04 Kyungchul Song

Estimation of model uncertainty can help improve the explainability of Graph Convolutional Networks and the accuracy of the models at the same time. Uncertainty can also be used in critical applications to verify the results of the model by…

Machine Learning · Computer Science 2025-07-03 Illia Oleksiienko , Juho Kanniainen , Alexandros Iosifidis

Data represented by probability measures arise as empirical distributions, posterior distributions, and feature-based representations of complex objects. We study heterogeneity in a population of probability measures through the expected…

Methodology · Statistics 2026-03-17 Kisung You

The causal (belief) network is a well-known graphical structure for representing independencies in a joint probability distribution. The exact methods and the approximation methods, which perform probabilistic inference in causal networks,…

Artificial Intelligence · Computer Science 2013-04-05 Richard E. Neapolitan , James Kenevan

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

Machine learning on graph-structured data has attracted high research interest due to the emergence of Graph Neural Networks (GNNs). Most of the proposed GNNs are based on the node homophily, i.e neighboring nodes share similar…

Machine Learning · Computer Science 2021-02-18 George Dasoulas , Giannis Nikolentzos , Kevin Scaman , Aladin Virmaux , Michalis Vazirgiannis

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

Statistics Theory · Mathematics 2021-06-02 Mehmet Siddik Cadirci , Dafydd Evans , Nikolai Leonenko , Oleg Seleznjev

The relationship between three probability distributions and their maximizable entropy forms is discussed without postulating entropy property. For this purpose, the entropy I is defined as a measure of uncertainty of the probability…

Statistical Mechanics · Physics 2020-10-28 Qiuping A. Wang

Consider a weighted or unweighted k-nearest neighbor graph that has been built on n data points drawn randomly according to some density p on R^d. We study the convergence of the shortest path distance in such graphs as the sample size…

Machine Learning · Computer Science 2012-07-10 Morteza Alamgir , Ulrike von Luxburg

Assortativity measures the tendency of a vertex in a network being connected by other vertexes with respect to some vertex-specific features. Classical assortativity coefficients are defined for unweighted and undirected networks with…

Applications · Statistics 2021-01-15 Yelie Yuan , Jun Yan , Panpan Zhang

We study random graphs with latent geometric structure, where the probability of each edge depends on the underlying random positions corresponding to the two endpoints. We focus on the setting where this conditional probability is a…

Probability · Mathematics 2021-11-01 Suqi Liu , Miklos Z. Racz

This paper develops a novel approach to density estimation on a network. We formulate nonparametric density estimation on a network as a nonparametric regression problem by binning. Nonparametric regression using local polynomial…

Methodology · Statistics 2020-08-06 Yang Liu , David Ruppert

Random graphs with a given degree sequence are often constructed using the configuration model, which yields a random multigraph. We may adjust this multigraph by a sequence of switchings, eventually yielding a simple graph. We show that,…

Probability · Mathematics 2019-02-01 Svante Janson

In this note, we study the relationship between the variational gap and the variance of the (log) likelihood ratio. We show that the gap can be upper bounded by some form of dispersion measure of the likelihood ratio, which suggests the…

Machine Learning · Computer Science 2019-06-11 Chin-Wei Huang , Aaron Courville

A variational Bayesian inference for measured wave intensity, such as X-ray intensity, is proposed in this paper. The data is popular to obtain information about unobservable features of an object, such as a material sample and the…

Machine Learning · Computer Science 2024-11-12 Akinori Asahara , Yoshihiro Osakabe , Yamamoto Mitsuya , Hidekazu Morita