English
Related papers

Related papers: Robust Estimation for Linear Panel Data Models

200 papers

National statistical institutes in many countries are now mandated to produce reliable statistics for important variables such as population, income, unemployment, health outcomes, etc. for small areas, defined by geography and/or…

Methodology · Statistics 2018-10-29 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

This paper introduces and analyzes a framework that accommodates general heterogeneity in regression modeling. It demonstrates that regression models with fixed or time-varying parameters can be estimated using the OLS and time-varying OLS…

Econometrics · Economics 2025-11-11 Liudas Giraitis , George Kapetanios , Yufei Li , Alexia Ventouri

Additive models belong to the class of structured nonparametric regression models that do not suffer from the curse of dimensionality. Finding the additive components that are nonzero when the true model is assumed to be sparse is an…

Methodology · Statistics 2025-05-08 Suneel Babu Chatla , Abhijit Mandal

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

Statistics Theory · Mathematics 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

We prove that the ordinary least-squares (OLS) estimator attains nearly minimax optimal performance for the identification of linear dynamical systems from a single observed trajectory. Our upper bound relies on a generalization of…

Machine Learning · Computer Science 2018-05-25 Max Simchowitz , Horia Mania , Stephen Tu , Michael I. Jordan , Benjamin Recht

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

This paper proposes an adaptive penalized weighted mean regression for outlier detection of high-dimensional data. In comparison to existing approaches based on the mean shift model, the proposed estimators demonstrate robustness against…

Statistics Theory · Mathematics 2023-06-27 Jiaqi Li , Linglong Kong , Bei Jiang , Wei Tu

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Machine Learning · Computer Science 2024-10-31 Philipp Röchner , Henrique O. Marques , Ricardo J. G. B. Campello , Arthur Zimek , Franz Rothlauf

Regression analysis is an important instrument to determine the effect of the explanatory variables on response variables. When outliers and bias errors are present, the standard weighted least squares estimator may perform poorly. For this…

Computation · Statistics 2025-02-11 Justo Puerto , Alberto Torrejon

The presence of units with extreme values in the dependent and/or independent variables (i.e., vertical outliers, leveraged data) has the potential to severely bias regression coefficients and/or standard errors. This is common with short…

Econometrics · Economics 2023-12-12 Annalivia Polselli

This paper considers the problem of inference in a linear regression model with outliers where the number of outliers can grow with sample size but their proportion goes to 0. We apply the square-root lasso estimator penalizing the l1-norm…

Statistics Theory · Mathematics 2019-06-05 Jad Beyhum

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

The autocovariance least squares (ALS) method is a computationally efficient approach for estimating noise covariances in Kalman filters without requiring specific noise models. However, conventional ALS and its variants rely on the classic…

Optimization and Control · Mathematics 2026-03-10 Jiahong Li , Fang Deng

This article deals with asimple issue: if we have grouped data with a binary dependent variable and want to include fixed effects (group specific intercepts) in the specification, is Ordinary Least Squares (OLS) in any way superior to a…

Econometrics · Economics 2018-09-19 Nathaniel Beck

This paper addresses the robust estimation of linear regression models in the presence of potentially endogenous outliers. Through Monte Carlo simulations, we demonstrate that existing $L_1$-regularized estimation methods, including the…

Econometrics · Economics 2024-08-08 Zhan Gao , Hyungsik Roger Moon

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

Ordinary least squares (OLS) is the default method for fitting linear models, but is not applicable for problems with dimensionality larger than the sample size. For these problems, we advocate the use of a generalized version of OLS…

Methodology · Statistics 2016-06-17 Xiangyu Wang , David Dunson , Chenlei Leng

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari