English
Related papers

Related papers: Near-optimal estimation of the unseen under regula…

200 papers

Estimating the number of unseen species is an important problem in many scientific endeavors. Its most popular formulation, introduced by Fisher, uses $n$ samples to predict the number $U$ of hitherto unseen species that would be observed…

Statistics Theory · Mathematics 2016-03-04 Alon Orlitsky , Ananda Theertha Suresh , Yihong Wu

Given $n$ i.i.d. samples from an unknown discrete distribution over an unknown set, the unseen species problem is to predict how many new outcomes would be observed in $m$ additional samples. For small $m$ we show that the Good-Toulmin…

Statistics Theory · Mathematics 2026-05-08 Edward Eriksson

Consider a random sample in the max-domain of attraction of a multivariate extreme value distribution such that the dependence structure of the attractor belongs to a parametric model. A new estimator for the unknown parameter is defined as…

Statistics Theory · Mathematics 2012-10-05 John H. J. Einmahl , Andrea Krajina , Johan Segers

A notoriously difficult challenge in extreme value theory is the choice of the number $k\ll n$, where $n$ is the total sample size, of extreme data points to consider for inference of tail quantities. Existing theoretical guarantees for…

Other Statistics · Statistics 2025-05-30 Johannes Lederer , Anne Sabourin , Mahsa Taheri

This article introduces a non-parametric information-theoretic approach to inference about the tail of a continuous or a discrete distribution. Leveraging a new concept named tail profile -- a set of information-theoretic quantities…

Applications · Statistics 2025-03-19 Jialin Zhang , Zhiyi Zhang

We deduce in this paper the sufficient conditions for weak convergence of centered and normed deviation of the u-statistics with values in the space of the real valued continuous function defined on some compact metric space. We obtain also…

Statistics Theory · Mathematics 2016-08-12 E. Ostrovsky , L. Sirota

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of…

Data Analysis, Statistics and Probability · Physics 2019-06-24 Pablo Lopez Rios , Gareth J. Conduit

Extreme U-statistics arise when the kernel of a U-statistic has a high degree but depends only on its arguments through a small number of top order statistics. As the kernel degree of the U-statistic grows to infinity with the sample size,…

Statistics Theory · Mathematics 2023-01-09 Jochem Oorschot , Johan Segers , Chen Zhou

Given samples from a distribution, how many new elements should we expect to find if we continue sampling this distribution? This is an important and actively studied problem, with many applications ranging from unseen species estimation to…

Machine Learning · Computer Science 2017-07-14 Aditi Raghunathan , Greg Valiant , James Zou

A theoretical expression is derived for the mean squared error of a nonparametric estimator of the tail dependence coefficient, depending on a threshold that defines which rank delimits the tails of a distribution. We propose a new method…

Methodology · Statistics 2023-07-25 Matthieu Garcin , Maxime L. D. Nicolas

In the world of multivariate extremes, estimation of the dependence structure still presents a challenge and an interesting problem. A procedure for the bivariate case is presented that opens the road to a similar way of handling the…

Statistics Theory · Mathematics 2008-11-14 John H. J. Einmahl , Andrea Krajina , Johan Segers

We obtain an uniform tail estimates for natural normed sums of independent random variables (r.v.) with regular varying tails of distributions. We give also many examples on order to show the exactness of offered estimates and discuss some…

Probability · Mathematics 2012-06-22 E. Ostrovsky , L. Sirota

We develop an unsupervised mixture model for non-negative, skewed and heavy-tailed data, such as losses in actuarial and risk management applications. The mixture has a lognormal component, which is usually appropriate for the body of the…

Methodology · Statistics 2025-05-29 Marco Bee , Flavio Santi

A common bottleneck in evaluating extremal performance measures is that, due to their very nature, tail data are often very limited. The conventional approach selects the best probability distribution from tail data using parametric…

Computation · Statistics 2018-01-03 Henry Lam , Clementine Mottet

In this paper, we introduce reduced-bias estimators for the estimation of the tail index of a Pareto-type distribution. This is achieved through the use of a regularised weighted least squares with an exponential regression model for…

Methodology · Statistics 2022-04-19 E. Ocran , R. Minkah , G. Kallah-Dagadu , K. Doku-Amponsah

Anomaly detection methods are widely used but often rely on ad hoc rules or strong assumptions, and they often focus on tail events, missing ``inlier'' anomalies that occur in low-density gaps between modes. We propose a unified framework…

Methodology · Statistics 2026-03-11 Rob J Hyndman , David T. Frazier

We introduce a new type of estimator for the spectral tail process of a regularly varying time series. The approach is based on a characterizing invariance property of the spectral tail process, which is incorporated into the new estimator…

Statistics Theory · Mathematics 2021-03-16 Holger Drees , Anja Janßen , Sebastian Neblung

Empirical distributions have their in-sample maxima as natural censoring. We look at the "hidden tail", that is, the part of the distribution in excess of the maximum for a sample size of $n$. Using extreme value theory, we examine the…

Statistical Finance · Quantitative Finance 2020-04-14 Nassim Nicholas Taleb

It was shown that when one disposes of a parametric information of the truncation distribution, the semiparametric estimator of the distribution function for truncated data (Wang, 1989) is more efficient than the nonparametric one. On the…

Statistics Theory · Mathematics 2021-06-03 Saida Mancer , Abdelhakim Necir , Souad Benchaira
‹ Prev 1 2 3 10 Next ›