English
Related papers

Related papers: The Raise Regression: Justification, properties an…

200 papers

Standard estimators of the global average treatment effect can be biased in the presence of interference. This paper proposes regression adjustment estimators for removing bias due to interference in Bernoulli randomized experiments. We use…

Methodology · Statistics 2019-03-06 Alex Chin

Separation in logistic regression is a common problem causing failure of the iterative estimation process when finding maximum likelihood estimates. Firth's correction (FC) was proposed as a solution, providing estimates also in presence of…

Methodology · Statistics 2020-12-01 Hana Šinkovec , Angelika Geroldinger , Georg Heinze , Rok Blagus

Least squares linear regression is one of the oldest and widely used data analysis tools. Although the theoretical analysis of the ordinary least squares (OLS) estimator is as old, several fundamental questions are yet to be answered.…

Statistics Theory · Mathematics 2019-10-16 Arun K. Kuchibhotla , Lawrence D. Brown , Andreas Buja , Junhui Cai

In this paper we propose a principal component Liu-type logistic estimator by combining the principal component logistic regression estimator and Liu-type logistic estimator to overcome the multicollinearity problem. The superiority of the…

Methodology · Statistics 2017-07-25 Jibo Wu , Yasin Asar

Functional quadratic regression models postulate a polynomial relationship between a scalar response rather than a linear one. As in functional linear regression, vertical and specially high-leverage outliers may affect the classical…

Methodology · Statistics 2023-05-30 Graciela Boente , Daniela Parada

This paper analyzes the classical linear regression model with measurement errors in all the variables. First, we provide necessary and sufficient conditions for identification of the coefficients. We show that the coefficients are not…

Methodology · Statistics 2023-06-22 Dan Ben-Moshe

Machine learning models can capture and amplify biases present in data, leading to disparate test performance across social groups. To better understand, evaluate, and mitigate these biases, a deeper theoretical understanding of how model…

Machine Learning · Computer Science 2025-03-19 Arjun Subramonian , Samuel J. Bell , Levent Sagun , Elvis Dohmatob

To take sample biases and skewness in the observations into account, practitioners frequently weight their observations according to some marginal distribution. The present paper demonstrates that such weighting can indeed improve the…

Methodology · Statistics 2018-11-05 Tobias Niebuhr , Mathias Trabs

In this study, we explore the effects of including noise predictors and noise observations when fitting linear regression models. We present empirical and theoretical results that show that double descent occurs in both cases, albeit with…

Statistics Theory · Mathematics 2024-08-16 Insha Ullah , A. H. Welsh

We develop estimation and inference methods for a stylized macroeconomic model with potentially multiple behavioural equilibria, where agents form expectations using a constant-gain learning rule. We first show geometric ergodicity of the…

Econometrics · Economics 2026-03-10 Alexander Mayer , Davide Raggi

Regularized linear regression is a promising approach for binary classification problems in which the training set has noisy labels since the regularization term can help to avoid interpolating the mislabeled data points. In this paper we…

Machine Learning · Computer Science 2023-11-07 Danil Akhtiamov , Reza Ghane , Babak Hassibi

Combining matching and regression for causal inference provides double-robustness in removing treatment effect estimation bias due to confounding variables. In most real-world applications, however, treatment and control populations are not…

Methodology · Statistics 2015-07-14 Alireza S. Mahani , Mansour T. A. Sharabiani

We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then performs an ordinary…

Machine Learning · Statistics 2013-06-03 Paramveer S. Dhillon , Dean P. Foster , Sham M. Kakade , Lyle H. Ungar

Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high…

Methodology · Statistics 2018-07-30 Gen Li , Xiaokang Liu , Kun Chen

Whereas confidence intervals are used to assess uncertainty due to unmeasured individuals, confounding intervals can be used to assess uncertainty due to unmeasured attributes. Previously, we have introduced a methodology for computing…

Methodology · Statistics 2025-08-13 Brian Knaeble , R Mitchell Hughes

The multi-index model is a simple yet powerful high-dimensional regression model which circumvents the curse of dimensionality assuming $ \mathbb{E} [ Y | X ] = g(A^\top X) $ for some unknown index space $A$ and link function $g$. In this…

Statistics Theory · Mathematics 2020-06-04 Timo Klock , Alessandro Lanteri , Stefano Vigogna

We develop a general variational inference method that preserves dependency among the latent variables. Our method uses copulas to augment the families of distributions used in mean-field and structured approximations. Copulas model the…

Machine Learning · Statistics 2015-11-03 Dustin Tran , David M. Blei , Edoardo M. Airoldi

Starting from a linear fractional representation of a linear system affected by constant parametric uncertainties, we demonstrate how to enhance standard robust analysis tests by taking available (noisy) input-output data of the uncertain…

Optimization and Control · Mathematics 2023-03-27 Tobias Holicki , Carsten W. Scherer

The multivariate regression model basically offers the analysis of a single dataset with multiple responses. However, such a single-dataset analysis often leads to unsatisfactory results. Integrative analysis is an effective method to pool…

Methodology · Statistics 2023-04-18 Shuichi Kawano , Toshikazu Fukushima , Junichi Nakagawa , Mamoru Oshiki

Subsampling is a popular approach to alleviating the computational burden for analyzing massive datasets. Recent efforts have been devoted to various statistical models without explicit regularization. In this paper, we develop an efficient…

Methodology · Statistics 2022-04-12 Yunlu Chen , Nan Zhang