English
Related papers

Related papers: Efficient and Robust Estimation of Linear Regressi…

200 papers

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic…

Statistics Theory · Mathematics 2015-10-28 David Morales-Jimenez , Romain Couillet , Matthew R. McKay

This paper studies estimation of linear panel regression models with heterogeneous coefficients, when both the regressors and the residual contain a possibly common, latent, factor structure. Our theory is (nearly) efficient, because based…

Econometrics · Economics 2019-03-01 Marco Avarucci , Paolo Zaffaroni

Nonlinear regression analysis is a popular and important tool for scientists and engineers. In this article, we introduce theories and methods of nonlinear regression and its statistical inferences using the frequentist and Bayesian…

Methodology · Statistics 2024-02-09 Hsin-Hsiung Huang , Qing He

The problems of outliers detection and robust regression in a high-dimensional setting are fundamental in statistics, and have numerous applications. Following a recent set of works providing methods for simultaneous robust regression and…

Machine Learning · Statistics 2017-12-08 Alain Virouleau , Agathe Guilloux , Stéphane Gaïffas , Malgorzata Bogdan

Robust regression models in the presence of outliers have significant practical relevance in areas such as signal processing, financial econometrics, and energy management. Many existing robust regression methods, either grounded in…

Signal Processing · Electrical Eng. & Systems 2025-06-30 Pengyang Song , Jue Wang

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg

Beta regression models are widely used for modeling continuous data limited to the unit interval, such as proportions, fractions, and rates. The inference for the parameters of beta regression models is commonly based on maximum likelihood…

Methodology · Statistics 2022-05-25 Terezinha K. A. Ribeiro , Silvia L. P. Ferrari

We consider outlier-robust and sparse estimation of linear regression coefficients, when the covariates and the noises are contaminated by adversarial outliers and noises are sampled from a heavy-tailed distribution. Our results present…

Statistics Theory · Mathematics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

In a classical regression model, it is usually assumed that the explanatory variables are independent of each other and error terms are normally distributed. But when these assumptions are not met, situations like the error terms are not…

Statistics Theory · Mathematics 2017-09-08 Bahadır Yüzbaşı , Yasin Asar , Ahmet Demiralp , M. Şamil Şık

Robust estimators of large covariance matrices are considered, comprising regularized (linear shrinkage) modifications of Maronna's classical M-estimators. These estimators provide robustness to outliers, while simultaneously being…

Statistics Theory · Mathematics 2018-07-04 Nicolas Auguin , David Morales-Jimenez , Matthew R. McKay , Romain Couillet

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

Machine Learning · Statistics 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

In a mixture of linear regression model, the regression coefficients are treated as random vectors that may follow either a continuous or discrete distribution. We propose two Expectation-Maximization (EM) algorithms to estimate this prior…

Methodology · Statistics 2025-10-17 Andrew Welbaum , Wanli Qiao

National statistical institutes in many countries are now mandated to produce reliable statistics for important variables such as population, income, unemployment, health outcomes, etc. for small areas, defined by geography and/or…

Methodology · Statistics 2018-10-29 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal

In numerous instances, the generalized exponential distribution can be used as an alternative to the most widely used non-regular family of distributions: Weibull, gamma, lognormal with three-parameters when analyzing lifetime or any skewed…

Methodology · Statistics 2026-03-03 Kiran Prajapat , Sharmishtha Mitra , Debasis Kundu

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

The scalar-on-function regression model has become a popular analysis tool to explore the relationship between a scalar response and multiple functional predictors. Most of the existing approaches to estimate this model are based on the…

Methodology · Statistics 2022-03-11 Ufuk Beyaztas , Han Lin Shang

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

Methodology · Statistics 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

This paper deals with robust marginal estimation under a general regression model when missing data occur in the response and also in some of covariates. The target is a marginal location parameter which is given through an $M-$functional.…