English
Related papers

Related papers: Measuring wage inequality under right censoring

200 papers

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

Survival analysis is a statistical technique used to estimate the time until an event occurs. Although it is applied across a wide range of fields, adjusting for reporting delays under practical constraints remains a significant challenge…

Machine Learning · Statistics 2025-10-27 Yuta Shikuri , Hironori Fujisawa

We investigate a way of comparing and classifying tails of random variables. Our approach extends the notion of classical indices, such as exponential and moment indices, which are widely used measuring heaviness of tail functions. A…

Probability · Mathematics 2013-10-07 Jaakko Lehtomaa

The well-known "Janson's inequality" gives Poisson-like upper bounds for the lower tail probability \Pr(X \le (1-\eps)\E X) when X is the sum of dependent indicator random variables of a special form. We show that, for large deviations,…

Probability · Mathematics 2017-12-12 Svante Janson , Lutz Warnke

Designing randomized online algorithms that perform reliably not only in expectation but also under unfavorable realizations of randomness is a fundamental challenge in online decision-making. In this paper, we study this challenge in…

Computer Science and Game Theory · Computer Science 2026-05-13 Hossein Nekouyan , Bo Sun , Raouf Boutaba , Xiaoqi Tan

Given a finite collection of stochastic alternatives, we study the problem of sequentially allocating a fixed sampling budget to identify the optimal alternative with a high probability, where the optimal alternative is defined as the one…

Methodology · Statistics 2025-03-11 Dohyun Ahn , Taeho Kim

Modeling and predicting extreme movements in GDP is notoriously difficult and the selection of appropriate covariates and/or possible forms of nonlinearities are key in obtaining precise forecasts. In this paper, our focus is on using large…

Econometrics · Economics 2023-09-25 Jan Prüser , Florian Huber

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

In this paper, a novel approach to the problem of estimating the heavy-tail exponent alpha>0 of a distribution is proposed. It is based on the fact that block-maxima of size m of the independent and identically distributed data scale at a…

Statistics Theory · Mathematics 2007-06-13 Stilian A. Stoev , George Michailidis , Murad S. Taqqu

The prominent inequality of wealth and income is a huge concern especially in the United States. The likelihood of diminishing poverty is one valid reason to reduce the world's surging level of economic inequality. The principle of…

Machine Learning · Computer Science 2018-10-25 Navoneel Chakrabarty , Sanket Biswas

We study the empirical version of halfspace depths with the objective of establishing a connection between the rates of convergence and the tail behaviour of the corresponding underlying distributions. The intricate interplay between the…

Statistics Theory · Mathematics 2025-06-03 Sibsankar Singha , Marie Kratz , Sreekar Vadlamani

We present a novel procedure for scaling relatively high frequency tail probability and quantile estimates for the conditional distribution of returns.

Risk Management · Quantitative Finance 2011-03-31 John Cotter

There is given a method for estimation of a probability distribution tail in terms of characteristic function. Key words: characteristic function; tail of a distribution.

Probability · Mathematics 2016-07-12 Lev B. Klebanov , Andrea Karlova

Bias reduction in tail estimation has received considerable interest in extreme value analysis. Estimation methods that minimize the bias while keeping the mean squared error (MSE) under control, are especially useful when applying…

Statistics Theory · Mathematics 2016-06-21 Gaonyalelwe Maribe , Andréhette Verster , Jan Beirlant

By the modified directed likelihood, higher order accurate confidence limits for a scalar parameter are obtained from the likelihood. They are conveniently described in terms of a confidence distribution, that is a sample dependent…

Statistics Theory · Mathematics 2016-07-19 Pierpaolo De Blasi , Tore Schweder

Heavy tailed phenomena are naturally analyzed by extreme value statistics. A crucial step in such an analysis is the estimation of the extreme value index, which describes the tail heaviness of the underlying probability distribution. We…

Statistics Theory · Mathematics 2018-07-18 Hanan Ahmed , John H. J. Einmahl

We use bias-reduced estimators of high quantiles, of heavy-tailed distributions, to introduce a new estimator of the mean in the case of infinite second moment. The asymptotic normality of the proposed estimator is established and checked,…

Methodology · Statistics 2014-05-09 Brahim Brahimi , Djamel Meraghni , Abdelhakim Necir , Djabrane Yahia

Economists disagree about the factors driving the substantial increase in residual wage inequality in the US over the past few decades. To identify changes in the returns to unobserved skills, we make a novel assumption about the dynamics…

General Economics · Economics 2025-01-20 Lance Lochner , Youngmin Park , Youngki Shin

Statistical analysis of extremes can be used to predict the probability of future extreme events, such as large rainfalls or devastating windstorms. The quality of these forecasts can be measured through scoring rules. Locally scale…

Methodology · Statistics 2024-02-22 Helga Kristin Olafsdottir , Holger Rootzén , David Bolin

When data are right-censored, i.e. some outcomes are missing due to a limited period of observation, survival analysis can compute the "time to event". Multiple classes of outcomes lead to a classification variant: predicting the most…

Artificial Intelligence · Computer Science 2024-06-21 Julie Alberge , Vincent Maladière , Olivier Grisel , Judith Abécassis , Gaël Varoquaux