English
Related papers

Related papers: Ensemble estimators for multivariate entropy estim…

200 papers

The problem of accurate nonparametric estimation of distributional functionals (integral functionals of one or more probability distributions) has received recent interest due to their wide applicability in signal processing, information…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

f-divergence estimation is an important problem in the fields of information theory, machine learning, and statistics. While several divergence estimators exist, relatively few of their convergence rates are known. We derive the MSE…

Information Theory · Computer Science 2015-03-16 Kevin R. Moon , Alfred O. Hero

We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived…

Machine Learning · Statistics 2025-03-11 Gilles Blanchard , Jean-Baptiste Fermanian , Hannah Marienwald

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

This paper introduces a class of k-nearest neighbor ($k$-NN) estimators called bipartite plug-in (BPI) estimators for estimating integrals of non-linear functions of a probability density, such as Shannon entropy and R\'enyi entropy. The…

Statistics Theory · Mathematics 2012-02-28 Kumar Sricharan , Raviv Raich , Alfred O. Hero

In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or…

Machine Learning · Statistics 2007-10-16 Yen-Jen Oyang , Darby Tien-Hao Chang , Yu-Yen Ou , Hao-Geng Hung , Chih-Peng Wu , Chien-Yu Chen

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

Efficient probability density estimation is a core challenge in statistical machine learning. Tensor-based probabilistic graph methods address interpretability and stability concerns encountered in neural network approaches. However, a…

Machine Learning · Computer Science 2023-12-14 Ruituo Wu , Jiani Liu , Ce Zhu , Anh-Huy Phan , Ivan V. Oseledets , Yipeng Liu

Motivated by applications in statistics and machine learning, we consider a problem of unmixing convex combinations of nonparametric densities. Suppose we observe $n$ groups of samples, where the $i$th group consists of $N_i$ independent…

Statistics Theory · Mathematics 2026-03-31 Jianqing Fan , Zheng Tracy Ke , Zhaoyang Shi

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

In the this paper, the authors propose to estimate the density of a targeted population with a weighted kernel density estimator (wKDE) based on a weighted sample. Bandwidth selection for wKDE is discussed. Three mean integrated squared…

Methodology · Statistics 2011-11-28 Bin Wang , Xiaofeng Wang

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

Expected values weighted by the inverse of a multivariate density or, equivalently, Lebesgue integrals of regression functions with multivariate regressors occur in various areas of applications, including estimating average treatment…

Statistics Theory · Mathematics 2025-02-17 Hajo Holzmann , Alexander Meister

Mutual information is a measure of the dependence between random variables that has been used successfully in myriad applications in many fields. Generalized mutual information measures that go beyond classical Shannon mutual information…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

Many statistical procedures, including goodness-of-fit tests and methods for independent component analysis, rely critically on the estimation of the entropy of a distribution. In this paper, we seek entropy estimators that are efficient…

Statistics Theory · Mathematics 2017-06-23 Thomas B. Berrett , Richard J. Samworth , Ming Yuan

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

Methodology · Statistics 2017-02-09 Hongmei Liu , J. Sunil Rao

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David H. Wolpert , David R. Wolf

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

This paper studies the problem of estimating the differential entropy $h(S+Z)$, where $S$ and $Z$ are independent $d$-dimensional random variables with $Z\sim\mathcal{N}(0,\sigma^2 \mathrm{I}_d)$. The distribution of $S$ is unknown, but $n$…

Statistics Theory · Mathematics 2019-06-04 Ziv Goldfeld , Kristjan Greenewald , Yury Polyanskiy
‹ Prev 1 2 3 10 Next ›