English
Related papers

Related papers: Concentration Bounds for the Collision Estimator

200 papers

We consider models for which it is important, early in processing, to estimate some variables with high precision, but perhaps at relatively low rates of recall. If some variables can be identified with near certainty, then they can be…

Computer Vision and Pattern Recognition · Computer Science 2009-07-03 Andrew Kae , Gary B. Huang , Erik Learned-Miller

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

A common problem in astrophysics is determining how bright a source could be and still not be detected. Despite the simplicity with which the problem can be stated, the solution involves complex statistical issues that require careful…

Instrumentation and Methods for Astrophysics · Physics 2016-02-19 Vinay L. Kashyap , David A. van Dyk , Alanna Connors , Peter Freeman , Aneta Siemiginowska , Jin Xu , Andreas Zezas

We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…

Statistics Theory · Mathematics 2021-09-21 Alankrita Bhatt , Ankit Pensia

We study the problem of estimating the barycenter of a distribution given i.i.d. data in a geodesic space. Assuming an upper curvature bound in Alexandrov's sense and a support condition ensuring the strong geodesic convexity of the…

Statistics Theory · Mathematics 2025-02-25 Victor-Emmanuel Brunel , Jordan Serres

We consider a finite or countable collection of one-dimensional Brownian particles whose dynamics at any point in time is determined by their rank in the entire particle system. Using Transportation Cost Inequalities for stochastic…

Probability · Mathematics 2010-11-11 Soumik Pal , Mykhaylo Shkolnikov

Conformance checking techniques allow us to quantify the correspondence of a process's execution, captured in event data, w.r.t., a reference process model. In this context, alignments have proven to be useful for calculating conformance…

Software Engineering · Computer Science 2021-03-25 Mohammadreza Fani Sani , Martin Kabierski , Sebastiaan J. van Zelst , Wil M. P. van der Aalst

In one-dimensional density estimation on i.i.d. observations we suggest an adaptive cross-validation technique for the selection of a kernel estimator. This estimator is both asymptotic MISE-efficient with respect to the monotone oracle,…

Statistics Theory · Mathematics 2007-06-13 Clementine Dalelane

Estimation of the complete distribution of a random variable is a useful primitive for both manual and automated decision making. This problem has received extensive attention in the i.i.d. setting, but the arbitrary data dependent setting…

Machine Learning · Statistics 2023-03-01 Paul Mineiro , Steven R. Howard

We present two new estimators for estimating the entropy of absolutely continuous random variables. Some properties of them are considered, specifically consistency of the first is proved. The introduced estimators are compared with the…

Statistics Theory · Mathematics 2014-05-05 A. Kohansal , S. Rezakhah

We present deviation bounds for self-normalized averages and applications to estimation with a random number of observations. The results rely on a peeling argument in exponential martingale techniques that represents an alternative to the…

Statistics Theory · Mathematics 2016-11-17 Aurélien Garivier

The entropy production in medium energy heavy-ion collisions is analyzed in terms of ratio of deuteronlike to protonlike clusters ($d_{like}/p_{like}$) using \emph{quantum molecular dynamics} (QMD) model. The yield ratios of…

Nuclear Theory · Physics 2014-11-21 Yogesh K. Vermani , Rajeev K. Puri

As predictive algorithms grow in popularity, using the same dataset to both train and test a new model has become routine across research, policy, and industry. Sample-splitting attains valid inference on model properties by using separate…

Econometrics · Economics 2025-11-27 Bruno Fava

In this work, we construct a risk estimator for hard thresholding which can be used as a basis to solve the difficult task of automatically selecting the threshold. As hard thresholding is not even continuous, Stein's lemma cannot be used…

Statistics Theory · Mathematics 2013-01-25 Charles-Alban Deledalle , Gabriel Peyré , Jalal Fadili

We define the local empirical process, based on $n$ i.i.d. random vectors in dimension $d$, in the neighborhood of the boundary of a fixed set. Under natural conditions on the shrinking neighborhood, we show that, for these local empirical…

Statistics Theory · Mathematics 2011-04-22 John H. J. Einmahl , Estáte V. Khmaladze

Estimating the unknown number of classes in a population has numerous important applications. In a Poisson mixture model, the problem is reduced to estimating the odds that a class is undetected in a sample. The discontinuity of the odds…

Statistics Theory · Mathematics 2007-08-22 Chang Xuan Mao , Bruce G. Lindsay

A fundamental tool in network information theory is the covering lemma, which lower bounds the probability that there exists a pair of random variables, among a give number of independently generated candidates, falling within a given set.…

Information Theory · Computer Science 2019-04-18 Jingbo Liu , Mohammad H. Yassaee , Sergio Verdú

We develop a practical and novel method for inference on intersection bounds, namely bounds defined by either the infimum or supremum of a parametric or nonparametric function, or equivalently, the value of a linear programming problem with…

Statistics Theory · Mathematics 2013-05-06 Victor Chernozhukov , Sokbae Lee , Adam M. Rosen