English
Related papers

Related papers: Estimation of Shannon differential entropy: An ext…

200 papers

Statistical distances (SDs), which quantify the dissimilarity between probability distributions, are central to machine learning and statistics. A modern method for estimating such distances from data relies on parametrizing a variational…

Statistics Theory · Mathematics 2021-03-18 Sreejith Sreekumar , Zhengxin Zhang , Ziv Goldfeld

We study the problem of overcoming exponential sample complexity in differential entropy estimation under Gaussian convolutions. Specifically, we consider the estimation of the differential entropy $h(X+Z)$ via $n$ independently and…

Information Theory · Computer Science 2023-05-12 Kristjan Greenewald , Brian Kingsbury , Yuancheng Yu

Model estimates obtained from traditional subspace identification methods may be subject to significant variance. This elevated variance is aggravated in the cases of large models or of a limited sample size. Common solutions to reduce the…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Alexandre Rodrigues Mesquita

Kernel Density Estimation (KDE) is a cornerstone of nonparametric statistics, yet it remains sensitive to bandwidth choice, boundary bias, and computational inefficiency. This study revisits KDE through a principled convolutional framework,…

Methodology · Statistics 2025-10-24 Nicholas Tenkorang , Kwesi Appau Ohene-Obeng , Xiaogang Su

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed. The popular density power divergence (DPD) class of estimators is a sub-class of Bregman divergences. We propose and study a new…

Statistics Theory · Mathematics 2020-08-18 Soumik Purkayastha , Ayanendranath Basu

Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data…

Statistical Mechanics · Physics 2024-01-18 Juan De Gregorio , David Sanchez , Raul Toral

Safety and reliability are critical for deploying visual question answering (VQA) systems in surgery, where incorrect or ambiguous responses can cause patient harm. A key limitation of existing uncertainty estimation methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Luca Carlini , Dennis Pierantozzi , Mauro Orazio Drago , Chiara Lena , Cesare Hassan , Elena De Momi , Danail Stoyanov , Sophia Bano , Mobarak I. Hoque

Imbalanced data occurs in a wide range of scenarios. The skewed distribution of the target variable elicits bias in machine learning algorithms. One of the popular methods to combat imbalanced data is to artificially balance the data…

Machine Learning · Computer Science 2021-10-26 Firuz Kamalov , Ashraf Elnagar

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

We propose and investigate a new estimation method for the parameters of models consisting of smooth density functions on the positive half axis. The procedure is based on a recently introduced characterization result for the respective…

Statistics Theory · Mathematics 2021-06-16 Steffen Betsch , Bruno Ebner , Bernhard Klar

We provide finite-sample analysis of a general framework for using k-nearest neighbor statistics to estimate functionals of a nonparametric continuous probability density, including entropies and divergences. Rather than plugging a…

Statistics Theory · Mathematics 2016-08-23 Shashank Singh , Barnabás Póczos

The difference equations $\xi_{k}=af(\xi_{k-1})+\epsilon_{k}$, where $(\epsilon_k)$ is a square integrable difference martingale, and the differential equation ${\rm d}\xi=-af(\xi){\rm d}t+{\rm d}\eta$, where $\eta$ is a square integrable…

Statistics Theory · Mathematics 2007-07-11 Dmytro Ivanenko

This paper investigates the large sample properties of local regression distribution estimators, which include a class of boundary adaptive density estimators as a prime example. First, we establish a pointwise Gaussian large sample…

Econometrics · Economics 2021-01-29 Matias D. Cattaneo , Michael Jansson , Xinwei Ma

Entropic measures of complexity are able to quantify the information encoded in complex network structures. Several entropic measures have been proposed in this respect. Here we study the relation between the Shannon entropy and the Von…

Disordered Systems and Neural Networks · Physics 2011-09-30 Kartik Anand , Ginestra Bianconi , Simone Severini

We study the problem of space and time efficient evaluation of a nonparametric estimator that approximates an unknown density. In the regime where consistent estimation is possible, we use a piecewise multivariate polynomial interpolation…

Statistics Theory · Mathematics 2020-11-11 Paxton Turner , Jingbo Liu , Philippe Rigollet

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We aim at estimating in a non-parametric way the density $\pi$ of the stationary distribution of a $d$-dimensional stochastic differential equation $(X_t)_{t \in [0, T]}$, for $d \ge 2$, from the discrete observations of a finite sample…

Statistics Theory · Mathematics 2022-12-29 Chiara Amorino , Arnaud Gloter

We study the computational complexity and variance of multilevel best linear unbiased estimators introduced in [D. Schaden and E. Ullmann, SIAM/ASA J. Uncert. Quantif., (2020)]. We specialize the results in this work to PDE-based models…

Statistics Theory · Mathematics 2020-12-11 Daniel Schaden , Elisabeth Ullmann

In this work, we draw connections between the classical Shannon interpolation of bandlimited deterministic signals and the literature on estimating continuous-time random processes from their samples (known in various communities under…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Justin P. Haldar