English
Related papers

Related papers: $\ell_1$-regression with Heavy-tailed Distribution…

200 papers

We establish a statistical learning theoretical framework aimed at extrapolation, or out-of-domain generalization, on the unobserved tails of covariates in continuous regression problems. Our strategy involves performing statistical…

Machine Learning · Statistics 2025-09-15 Stephan Clémençon , Nathan Huet , Anne Sabourin

In risk analysis, a global fit that appropriately captures the body and the tail of the distribution of losses is essential. Modelling the whole range of the losses using a standard distribution is usually very hard and often impossible due…

Methodology · Statistics 2017-09-19 Tom Reynkens , Roel Verbelen , Jan Beirlant , Katrien Antonio

A random variable $\xi$ has a {\it light-tailed} distribution (for short: is light-tailed) if it possesses a finite exponential moment, $\E \exp (\lambda \xi) <\infty$ for some $\lambda >0$, and has a {\it heavy-tailed} distribution (is…

Probability · Mathematics 2025-09-09 Sergey Foss , Anton Tarasenko , Georgiy Krivtsov

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

Machine Learning · Computer Science 2025-01-27 Bolian Li , Ruqi Zhang

We introduce the \textsc{Tailed-Uniform} proposal distribution for generating training simulations in simulation-based inference. Instead of sampling parameters uniformly within bounded regions, we extend the distribution beyond prior…

Instrumentation and Methods for Astrophysics · Physics 2026-01-27 Chaipat Tirapongprasert , Matthew Ho

This paper attempts to provide a decision-theoretic foundation for the measurement of economic tail risk, which is not only closely related to utility theory but also relevant to statistical model uncertainty. The main result is that the…

Risk Management · Quantitative Finance 2015-08-18 Steven Kou , Xianhua Peng

``Localization'' has proven to be a valuable tool in the Statistical Learning literature as it allows sharp risk bounds in terms of the problem geometry. Localized bounds seem to be much less exploited in the Stochastic Optimization…

Optimization and Control · Mathematics 2023-03-30 Roberto I. Oliveira , Philip Thompson

Language models are increasingly capable and are being rapidly deployed on a population-level scale. As a result, the safety of these models is increasingly high-stakes. Fortunately, advances in alignment have significantly reduced the…

Machine Learning · Computer Science 2026-04-27 Rico Angell , Raghav Singhal , Zachary Horvitz , Zhou Yu , Rajesh Ranganath , Kathleen McKeown , He He

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

We consider a generic class of chance-constrained optimization problems with heavy-tailed (i.e., power-law type) risk factors. In this setting, we use the scenario approach to obtain a constant approximation to the optimal solution with a…

Optimization and Control · Mathematics 2023-05-09 Jose Blanchet , Fan Zhang , Bert Zwart

Truncated linear regression is a classical challenge in Statistics, wherein a label, $y = w^T x + \varepsilon$, and its corresponding feature vector, $x \in \mathbb{R}^k$, are only observed if the label falls in some subset $S \subseteq…

Methodology · Statistics 2022-08-26 Constantinos Daskalakis , Patroklos Stefanou , Rui Yao , Manolis Zampetakis

In this paper, according to a certain criterion, we divide the exponential distribution class into three subclasses. One of them is closely related to the regular-variation-tailed distribution class, so it is called the…

Probability · Mathematics 2018-05-30 Zhaolei Cui , Edward Omey , Wenyuan Wang , Yuebao Wang

Expected Shortfall (ES) is a coherent measure of tail risk that captures the average loss beyond a quantile threshold. Despite the growing literature on ES regression conditional on covariates, no existing work considers ES modeling in…

Methodology · Statistics 2026-04-15 Yujie Hou , Xinbing Kong , Yalin Wang , Bin Wu

Expectiles define the only law-invariant, coherent and elicitable risk measure apart from the expectation. The popularity of expectile-based risk measures is steadily growing and their properties have been studied for independent data, but…

Methodology · Statistics 2021-10-13 Anthony C. Davison , Simone A. Padoan , Gilles Stupfler

The central limit theorem introduced by Stute [The central limit theorem under random censorship. Ann. Statist. 1995; 23: 422-439] does not hold for some class of heavy-tailed distributions. In this paper, we make use of the extreme value…

Statistics Theory · Mathematics 2015-07-19 Louiza Soltane , Djamel Meraghni , Abdelhakim Necir

This paper considers an empirical risk minimization problem under heavy-tailed settings, where data does not have finite variance, but only has $p$-th moment with $p \in (1,2)$. Instead of using estimation procedure based on truncated…

Machine Learning · Statistics 2023-09-08 Guanhua Fang , Ping Li , Gennady Samorodnitsky

We characterize the complex, heavy-tailed probability distribution functions (pdf) describing the response and its local extrema for structural systems subjected to random forcing that includes extreme events. Our approach is based on the…

Chaotic Dynamics · Physics 2017-06-02 Han Kyul Joo , Mustafa A. Mohamad , Themistoklis P. Sapsis

Many management decisions involve accumulated random realizations for which only the first and second moments of their distribution are available. The sharp Chebyshev-type bound for the tail probability and Scarf bound for the expected loss…

Econometrics · Economics 2025-05-15 Zhaolin Li , Artem Prokhorov

In this paper, we introduce reduced-bias estimators for the estimation of the tail index of a Pareto-type distribution. This is achieved through the use of a regularised weighted least squares with an exponential regression model for…

Methodology · Statistics 2022-04-19 E. Ocran , R. Minkah , G. Kallah-Dagadu , K. Doku-Amponsah

We discretize a risk-neutral optimal control problem governed by a linear elliptic partial differential equation with random inputs using a Monte Carlo sample-based approximation and a finite element discretization, yielding finite…

Optimization and Control · Mathematics 2023-11-10 Johannes Milz