English
Related papers

Related papers: Robust estimation and inference for heavy tailed G…

200 papers

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

This article introduces a new estimator of average treatment effects under unobserved confounding in modern data-rich environments featuring large numbers of units and outcomes. The proposed estimator is doubly robust, combining outcome…

Econometrics · Economics 2024-10-30 Alberto Abadie , Anish Agarwal , Raaz Dwivedi , Abhin Shah

In many statistical signal processing applications, the estimation of nuisance parameters and parameters of interest is strongly linked to the resulting performance. Generally, these applications deal with complex data. This paper focuses…

Applications · Statistics 2016-08-24 Melanie Mahot , Philippe Forster , Frederic Pascal , Jean-Philippe Ovarlez

A theoretical expression is derived for the mean squared error of a nonparametric estimator of the tail dependence coefficient, depending on a threshold that defines which rank delimits the tails of a distribution. We propose a new method…

Methodology · Statistics 2023-07-25 Matthieu Garcin , Maxime L. D. Nicolas

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

Multivariate GARCH models are important tools to describe the dynamics of multivariate times series of financial returns. Nevertheless, these models have been much less used in practice due to the lack of reliable software. This paper…

Computation · Statistics 2014-12-10 Jose A. Fioruci , Ricardo S. Ehlers , Francisco Louzada

In the real-world setting, data often follows a long-tailed distribution, where head classes contain significantly more training samples than tail classes. Consequently, models trained on such data tend to be biased toward head classes. The…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fan Zhang , Wei Qin , Weijieying Ren , Lei Wang , Zetong Chen , Richang Hong

Tensor regression is an important tool for tensor data analysis, but existing works have not considered the impact of outliers, making them potentially sensitive to such data points. This paper proposes a low tubal rank robust regression…

Methodology · Statistics 2026-05-11 Zihao Song , Jicai Liu , Heng Lian , Weihua Zhao

Average calibration of the (variance-based) prediction uncertainties of machine learning regression tasks can be tested in two ways: one is to estimate the calibration error (CE) as the difference between the mean absolute error (MSE) and…

Machine Learning · Statistics 2024-08-20 Pascal Pernot

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

In this paper, we develop connections between two seemingly disparate, but central, models in robust statistics: Huber's epsilon-contamination model and the heavy-tailed noise model. We provide conditions under which this connection…

Machine Learning · Statistics 2019-07-03 Adarsh Prasad , Sivaraman Balakrishnan , Pradeep Ravikumar

In this paper, we study the properties of robust nonparametric estimation using deep neural networks for regression models with heavy tailed error distributions. We establish the non-asymptotic error bounds for a class of robust…

Statistics Theory · Mathematics 2021-07-23 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Jian Huang

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

We consider the problem of robust estimation involving filtering and smoothing for nonlinear state space models which are disturbed by heavy-tailed impulsive noises. To deal with heavy-tailed noises and improve the robustness of the…

Applications · Statistics 2020-12-01 Hongwei Wang , Hongbin Li , Junyi Zuo , Wei Zhang , Heping Wang

The paper considers the problem of robust estimating a periodic function in a continuous time regression model with dependent disturbances given by a general square integrable semimartingale with unknown distribution. An example of such a…

Statistics Theory · Mathematics 2010-10-20 Victor Konev , Serguei Pergamenchtchikov

We consider unregularized robust M-estimators for linear models under Gaussian design and heavy-tailed noise, in the proportional asymptotics regime where the sample size n and the number of features p are both increasing such that $p/n \to…

Statistics Theory · Mathematics 2025-01-29 Pierre C. Bellec , Takuya Koriyama

Numerous robust estimators exist as alternatives to the maximum likelihood estimator (MLE) when a completely observed ground-up loss severity sample dataset is available. However, the options for robust alternatives to MLE become…

Methodology · Statistics 2024-02-22 Chudamani Poudyal

In this paper we develop a novel inferential approach based on geometric records for estimating the tail index of heavy-tailed distributions. We construct a maximum likelihood estimator for the Pareto model and establish its strong…

Statistics Theory · Mathematics 2026-04-30 Martín Alcalde , Raúl Gouet , Miguel Lafuente , F. Javier López , Gerardo Sanz