English
Related papers

Related papers: Regression with strongly correlated data

200 papers

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

Machine Learning · Computer Science 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

The properties of the normal distribution under linear transformation, as well the easy way to compute the covariance matrix of marginals and conditionals, offer a unique opportunity to get an insight about several aspects of uncertainties…

Data Analysis, Statistics and Probability · Physics 2018-02-12 Giulio D'Agostini

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We introduce a flexible parametric mixed effects model for correlated binary data, with parameters that can be directly interpreted as marginal odds ratios. This leads to a robust estimation equation with an optimal weighting matrix being…

Methodology · Statistics 2014-04-01 Rui Zhang , Kwun Chuen Gary Chan

A prediction of the steady-state reconnection electric field in asymmetric reconnection is obtained by maximizing the reconnection rate as a function of the opening angle made by the upstream magnetic field on the weak magnetic field…

Plasma Physics · Physics 2018-06-13 Yi-Hsin Liu , M. Hesse , P. A. Cassak , M. A. Shay , S. Wang , L. -J. Chen

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

Linear regression is a fundamental modeling tool in statistics and related fields. In this paper, we study an important variant of linear regression in which the predictor-response pairs are partially mismatched. We use an optimization…

Optimization and Control · Mathematics 2022-11-01 Rahul Mazumder , Haoyue Wang

In this paper, we present an algorithm for learning time-correlated measurement covariances for application in batch state estimation. We parameterize the inverse measurement covariance matrix to be block-banded, which conveniently…

Robotics · Computer Science 2023-03-14 David J. Yoon , Timothy D. Barfoot

We consider the problem of efficient statistical inference for comparing two regression curves estimated from two samples of dependent measurements. Based on a representation of the best pair of linear unbiased estimators in continuous time…

Methodology · Statistics 2016-01-29 Holger Dette , Kirsten Schorning , Maria Konstantinou

Linearly constrained multiple time series may be encountered in many practical contexts, such as the National Accounts (e.g., GDP disaggregated by Income, Expenditure and Output), and multilevel frameworks where the variables are organized…

Methodology · Statistics 2024-12-05 Daniele Girolimetto , Tommaso Di Fonzo

Covariance matrix estimation concerns the problem of estimating the covariance matrix from a collection of samples, which is of extreme importance in many applications. Classical results have shown that $O(n)$ samples are sufficient to…

Information Theory · Computer Science 2019-03-19 Wei Cui , Xu Zhang , Yulong Liu

Spatial data exhibits the property that nearby points are correlated. This also holds for learnt representations across layers, but not for commonly used weight initialization methods. Our theoretical analysis quantifies the learning…

Machine Learning · Computer Science 2023-02-03 Johannes Schneider

The relationship between a response variable and its covariates can vary significantly, especially in scenarios where covariates take on extremely high or low values. This paper introduces a max-linear tail regression model specifically…

Methodology · Statistics 2025-02-24 Liujun Chen , Deyuan Li , Zhengjun Zhang

We consider so-called univariate unlinked (sometimes ``decoupled,'' or ``shuffled'') regression when the unknown regression curve is monotone. In standard monotone regression, one observes a pair $(X,Y)$ where a response $Y$ is linked to a…

Methodology · Statistics 2021-07-30 Fadoua Balabdaoui , Charles R. Doss , Cécile Durot

The success of large-scale models in recent years has increased the importance of statistical models with numerous parameters. Several studies have analyzed over-parameterized linear models with high-dimensional data, which may not be…

Statistics Theory · Mathematics 2025-03-14 Shogo Nakakita , Masaaki Imaizumi

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

We consider the estimation of large covariance and precision matrices from high-dimensional sub-Gaussian or heavier-tailed observations with slowly decaying temporal dependence. The temporal dependence is allowed to be long-range so with…

Statistics Theory · Mathematics 2019-12-23 Hai Shu , Bin Nan

Machine learning often needs to model density from a multidimensional data sample, including correlations between coordinates. Additionally, we often have missing data case: that data points can miss values for some of coordinates. This…

Machine Learning · Computer Science 2018-05-29 Jarek Duda