English
Related papers

Related papers: Weak Signals and Heavy Tails: Learning Theory meet…

200 papers

Extreme value theory provides rigorous theory and statistical tools for extrapolation in machine learning, particularly in settings where traditional methods struggle due to data scarcity in the tails. A broad range of tasks benefit from…

Machine Learning · Statistics 2026-05-05 Sebastian Engelke , Nicola Gnecco , Anne Sabourin

We establish a statistical learning theoretical framework aimed at extrapolation, or out-of-domain generalization, on the unobserved tails of covariates in continuous regression problems. Our strategy involves performing statistical…

Machine Learning · Statistics 2025-09-15 Stephan Clémençon , Nathan Huet , Anne Sabourin

We introduce a novel regression model for the conditional left and right tail of a possibly heavy-tailed response. The proposed model can be used to learn the effect of covariates on an extreme value setting via a Lasso-type specification…

Methodology · Statistics 2021-08-11 Miguel de Carvalho , Soraia Pereira , Paula Pereira , Patrícia de Zea Bermudez

In this paper we are concerned with the analysis of heavy-tailed data when a portion of the extreme values is unavailable. This research was motivated by an analysis of the degree distributions in a large social network. The degree…

Statistics Theory · Mathematics 2018-12-20 Jingjing Zou , Richard A. Davis , Gennady Samorodnitsky

Modern statistical analyses often encounter datasets with massive sizes and heavy-tailed distributions. For datasets with massive sizes, traditional estimation methods can hardly be used to estimate the extreme value index directly. To…

Methodology · Statistics 2022-07-26 Yongxin Li , Liujun Chen , Deyuan Li , Hansheng Wang

For measuring tail risk with scarce extreme events, extreme value analysis is often invoked as the statistical tool to extrapolate to the tail of a distribution. The presence of large datasets benefits tail risk analysis by providing more…

Methodology · Statistics 2023-12-18 Liujun Chen , Deyuan Li , Chen Zhou

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method…

Extreme value statistics provides accurate estimates for the small occurrence probabilities of rare events. While theory and statistical tools for univariate extremes are well-developed, methods for high-dimensional and complex data sets…

Methodology · Statistics 2021-01-06 Sebastian Engelke , Jevgenijs Ivanovs

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modeling highly rare risk…

Machine Learning · Computer Science 2023-08-30 Karthik Somayaji NS , Yu Wang , Malachi Schram , Jan Drgona , Mahantesh Halappanavar , Frank Liu , Peng Li

The use of expectiles in risk management has recently gathered remarkable momentum due to their excellent axiomatic and probabilistic properties. In particular, the class of elicitable law-invariant coherent risk measures only consists of…

Statistics Theory · Mathematics 2023-03-21 Abdelaati Daouia , Simone A. Padoan , Gilles Stupfler

The classical multivariate extreme-value theory concerns the modeling of extremes in a multivariate random sample, suggesting the use of max-stable distributions. In this work, the classical theory is extended to the case where aggregated…

Methodology · Statistics 2020-03-12 Enkelejd Hashorva , Simone A. Padoan , Stefano Rizzelli

We study learning algorithms that seek to minimize the conditional value-at-risk (CVaR), when all the learner knows is that the losses incurred may be heavy-tailed. We begin by studying a general-purpose estimator of CVaR for potentially…

Machine Learning · Statistics 2020-06-04 Matthew J. Holland , El Mehdi Haress

Modeling heterogeneity on heavy-tailed distributions under a regression framework is challenging, and classical statistical methodologies usually place conditions on the distribution models to facilitate the learning procedure. However,…

Methodology · Statistics 2024-10-29 Jiaxi Wang , Yanxi Hou , Xingchi Li , Tiandong Wang

Extremile regression, as a least squares analog of quantile regression, is potentially useful tool for modeling and understanding the extreme tails of a distribution. However, existing extremile regression methods, as nonparametric…

Methodology · Statistics 2025-07-03 Rong Jiang , Keming Yu , Jiangfeng Wang

Existing theory for multivariate extreme values focuses upon characterizations of the distributional tails when all components of a random vector, standardized to identical margins, grow at the same rate. In this paper, we consider the…

Statistics Theory · Mathematics 2013-12-20 J. L. Wadsworth , J. A. Tawn

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

The relationship between a response variable and its covariates can vary significantly, especially in scenarios where covariates take on extremely high or low values. This paper introduces a max-linear tail regression model specifically…

Methodology · Statistics 2025-02-24 Liujun Chen , Deyuan Li , Zhengjun Zhang

Extremes play a special role in Anomaly Detection. Beyond inference and simulation purposes, probabilistic tools borrowed from Extreme Value Theory (EVT), such as the angular measure, can also be used to design novel statistical learning…

Machine Learning · Statistics 2016-04-01 Nicolas Goix , Anne Sabourin , Stéphan Clémençon

The estimation of conditional quantiles at extreme tails is of great interest in numerous applications. Various methods that integrate regression analysis with an extrapolation strategy derived from extreme value theory have been proposed…

Methodology · Statistics 2024-11-22 Yiwei Tang , Judy Huixia Wang , Deyuan Li

This paper presents a novel semiparametric method to study the effects of extreme events on binary outcomes and subsequently forecast future outcomes. Our approach, based on Bayes' theorem and regularly varying (RV) functions, facilitates a…

Econometrics · Economics 2025-02-25 Laura Liu , Yulong Wang
‹ Prev 1 2 3 10 Next ›