English
Related papers

Related papers: Empirical risk minimization for heavy-tailed losse…

200 papers

The generalization ability of minimizers of the empirical risk in the context of binary classification has been investigated under a wide variety of complexity assumptions for the collection of classifiers over which optimization is…

Statistics Theory · Mathematics 2019-01-21 Clémençon Stephan , Patrice Bertail , Guillaume Papa

We consider (robust) inference in the context of a factor model for tensor-valued sequences. We study the consistency of the estimated common factors and loadings space when using estimators based on minimising quadratic loss functions.…

Methodology · Statistics 2023-08-29 Matteo Barigozzi , Yong He , Lingxiao Li , Lorenzo Trapani

In this paper, we introduce reduced-bias estimators for the estimation of the tail index of a Pareto-type distribution. This is achieved through the use of a regularised weighted least squares with an exponential regression model for…

Methodology · Statistics 2022-04-19 E. Ocran , R. Minkah , G. Kallah-Dagadu , K. Doku-Amponsah

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

Estimation of tail quantities, such as expected shortfall or Value at Risk, is a difficult problem. We show how the theory of nonlinear expectations, in particular the Data-robust expectation introduced in [5], can assist in the…

Statistics Theory · Mathematics 2018-02-15 Samuel N. Cohen

Different questions related with analysis of extreme values and outliers arise frequently in practice. To exclude extremal observations and outliers is not a good decision because they contain important information about the observed…

Methodology · Statistics 2018-01-17 Pavlina K. Jordanova , Monika P. Petkova

Obtaining guarantees on the convergence of the minimizers of empirical risks to the ones of the true risk is a fundamental matter in statistical learning. Instead of deriving guarantees on the usual estimation error, the goal of this paper…

Statistics Theory · Mathematics 2024-09-12 Paul Escande

We study robust estimators of the mean of a probability measure $P$, called robust empirical mean estimators. This elementary construction is then used to revisit a problem of aggregation and a problem of estimator selection, extending…

Statistics Theory · Mathematics 2021-07-05 M. Lerasle , R. I. Oliveira

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

We consider the estimation of small probabilities or other risk quantities associated with rare but catastrophic events. In the model-based literature, much of the focus has been devoted to efficient Monte Carlo computation or analytical…

Statistics Theory · Mathematics 2024-01-02 Zhiyuan Huang , Henry Lam , Zhenyuan Liu

We establish weak limits for the empirical entropy regularized optimal transport cost, the expectation of the empirical plan and the conditional expectation. Our results require only uniform boundedness of the cost function and no…

Statistics Theory · Mathematics 2023-05-18 Alberto González-Sanz , Shayan Hundrieser

The analysis of extremal dependence in high dimensions has recently attracted considerable interest. Existing methodology primarily focuses on modeling and estimation of extremal dependence structures, often supported by concentration…

Statistics Theory · Mathematics 2026-04-02 Axel Bücher , Yeonjoon Choi , Katharina Effertz , Stanislav Volgushev

This paper attempts to provide a decision-theoretic foundation for the measurement of economic tail risk, which is not only closely related to utility theory but also relevant to statistical model uncertainty. The main result is that the…

Risk Management · Quantitative Finance 2015-08-18 Steven Kou , Xianhua Peng

In this paper we develop a novel inferential approach based on geometric records for estimating the tail index of heavy-tailed distributions. We construct a maximum likelihood estimator for the Pareto model and establish its strong…

Statistics Theory · Mathematics 2026-04-30 Martín Alcalde , Raúl Gouet , Miguel Lafuente , F. Javier López , Gerardo Sanz

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

Machine Learning · Statistics 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

We present new estimators of the mean of a real valued random variable, based on PAC-Bayesian iterative truncation. We analyze the non-asymptotic minimax properties of the deviations of estimators for distributions having either a bounded…

Statistics Theory · Mathematics 2009-09-30 Olivier Catoni

In this work, we study the weighted empirical risk minimization (weighted ERM) schema, in which an additional data-dependent weight function is incorporated when the empirical risk function is being minimized. We show that under a general…

Machine Learning · Computer Science 2025-01-07 Yikai Zhang , Jiahe Lin , Fengpei Li , Songzhu Zheng , Anant Raj , Anderson Schneider , Yuriy Nevmyvaka

The contribution of this paper is to introduce change of measure based techniques for the rare-event analysis of heavy-tailed stochastic processes. Our changes-of-measure are parameterized by a family of distributions admitting a mixture…

Probability · Mathematics 2010-06-15 Jose Blanchet , Jingchen Liu

Starting from the requirement that risk measures of financial portfolios should be based on their losses, not their gains, we define the notion of loss-based risk measure and study the properties of this class of risk measures. We…

Risk Management · Quantitative Finance 2014-03-26 Rama Cont , Romain Deguest , Xuedong He

We introduce a statistical model for operational losses based on heavy-tailed distributions and bipartite graphs, which captures the event type and business line structure of operational risk data. The model explicitly takes into account…

Risk Management · Quantitative Finance 2019-02-11 Oliver Kley , Claudia Klüppelberg , Sandra Paterlini