English
Related papers

Related papers: Empirical estimation of entropy functionals with c…

200 papers

We propose two least-squares estimators of a discrete probability under the constraint of k-monotony and study their statistical properties. We give a characterization of these estimators based on the decomposition on a spline basis of…

Statistics Theory · Mathematics 2017-08-30 Jade Giguelay

We introduce unbiased estimators for the Shannon entropy and the class number, in the situation that we are able to take sequences of independent samples of arbitrary length.

Statistics Theory · Mathematics 2014-10-21 Stephen Montgomery-Smith , T. Schürmann

The computation of integrals is a fundamental task in the analysis of functional data, which are typically considered as random elements in a space of squared integrable functions. Borrowing ideas from recent advances in the Monte Carlo…

Methodology · Statistics 2025-01-16 Valentin Patilea , Sunny G. W. Wang

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Since the work of \cite{Storey2004}, it is well-known that the performance of the Benjamini-Hochberg (BH) procedure can be improved by incorporating estimators of the number (or proportion) of null hypotheses, yielding an adaptive BH…

Methodology · Statistics 2023-07-26 Sebastian Döhler , Iqraa Meah

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Maximum likelihood estimators are proposed for the parameters and the densities in a semiparametric density ratio model in which the nonparametric baseline density is approximated by the Bernstein polynomial model. The EM algorithm is used…

Methodology · Statistics 2021-03-02 Zhong Guan

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

The estimation of mutual information (MI) or conditional mutual information (CMI) from a set of samples is a long-standing problem. A recent line of work in this area has leveraged the approximation power of artificial neural networks and…

Information Theory · Computer Science 2021-10-27 Sina Molavipour , Germán Bassi , Mikael Skoglund

The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…

Statistics Theory · Mathematics 2018-04-25 Alexander Bulinski , Alexey Kozhevin

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

The traditional k nearest neighbor (kNN) approach uses a distance formula within a spherical region to determine the k closest training observations to a test sample point. However, this approach may not work well when test point is located…

Machine Learning · Statistics 2024-02-19 Amjad Ali , Zardad Khan , Dost Muhammad Khan , Saeed Aldahmani

Motivated by recent work involving the analysis of leveraging spatial correlations in sparsified mean estimation, we present a novel procedure for constructing covariance estimator. The proposed Random-knots (Random-knots-Spatial) and…

Methodology · Statistics 2025-11-25 Sijie Zheng , Fandong Meng , Jie Zhou

The theory of Local Intrinsic Dimensionality (LID) has become a valuable tool for characterizing local complexity within and across data manifolds, supporting a range of data mining and machine learning tasks. Accurate LID estimation…

Machine Learning · Computer Science 2026-03-26 Kristóf Péter , Ricardo J. G. B. Campello , James Bailey , Michael E. Houle

Nearest neighbor imputation is popular for handling item nonresponse in survey sampling. In this article, we study the asymptotic properties of the nearest neighbor imputation estimator for general population parameters, including…

Methodology · Statistics 2017-07-05 Shu Yang , Jae Kwang Kim

We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…

Strongly Correlated Electrons · Physics 2010-11-02 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

We revisit the well-studied problem of estimating the Shannon entropy of a probability distribution, now given access to a probability-revealing conditional sampling oracle. In this model, the oracle takes as input the representation of a…

Cryptography and Security · Computer Science 2022-06-03 Priyanka Golia , Brendan Juba , Kuldeep S. Meel

Semicontinuous outcomes occur frequently in health services, insurance, and cost studies. Standard nonparametric density estimators are not well suited to such data because they do not naturally accommodate the mixed structure, the…

Methodology · Statistics 2026-05-06 Guanjie Lyu , Frédéric Ouimet , Cindy Feng

Estimators of doubly robust functionals typically rely on estimating two complex nuisance functions, such as the propensity score and conditional outcome mean for the average treatment effect functional. We consider the problem of how to…

Statistics Theory · Mathematics 2026-03-10 Sean McGrath , Rajarshi Mukherjee

This paper addresses the challenging computational problem of estimating intractable expectations over discrete domains. Existing approaches, including Monte Carlo and Russian Roulette estimators, are consistent but often require a large…

Machine Learning · Statistics 2025-12-19 Sophia Seulkee Kang , François-Xavier Briol , Toni Karvonen , Zonghao Chen
‹ Prev 1 8 9 10 Next ›