English
Related papers

Related papers: A Structural Approach to Coordinate-Free Statistic…

200 papers

In this paper we study the asymptotics of linear regression in settings with non-Gaussian covariates where the covariates exhibit a linear dependency structure, departing from the standard assumption of independence. We model the covariates…

Machine Learning · Statistics 2024-12-10 Behrad Moniri , Hamed Hassani

Under the Neyman causal model, it is well-known that OLS with treatment-by-covariate interactions cannot harm asymptotic precision of estimated treatment effects in completely randomized experiments. But do such guarantees extend to…

Statistics Theory · Mathematics 2018-03-19 Joel A. Middleton

This paper deals with a homoskedastic errors-in-variables linear regression model and properties of the total least squares (TLS) estimator. We partly revise the consistency results for the TLS estimator previously obtained by the author…

Probability · Mathematics 2018-10-24 Sergiy Shklyar

We consider statistical inference for network-linked regression problems, where covariates may include network summary statistics computed for each node. In settings involving network data, it is often natural to posit that latent variables…

Methodology · Statistics 2025-10-02 Wei Li , Nilanjan Chakraborty , Robert Lunde

Deep learning research has uncovered the phenomenon of benign overfitting for overparameterized statistical models, which has drawn significant theoretical interest in recent years. Given its simplicity and practicality, the ordinary least…

Statistics Theory · Mathematics 2024-05-31 Dennis Shen , Dogyoon Song , Peng Ding , Jasjeet S. Sekhon

We present statistical convergence results for the learning of (possibly) non-linear mappings in infinite-dimensional spaces. Specifically, given a map $G_0:\mathcal X\to\mathcal Y$ between two separable Hilbert spaces, we analyze the…

Statistics Theory · Mathematics 2024-12-24 Niklas Reinhardt , Sven Wang , Jakob Zech

Analysis of geospatial data has traditionally been model-based, with a mean model, customarily specified as a linear regression on the covariates, and a covariance model, encoding the spatial dependence. We relax the strong assumption of…

Machine Learning · Statistics 2024-05-28 Wentao Zhan , Abhirup Datta

Linear Vector AutoRegressive (VAR) models where the innovations could be unconditionally heteroscedastic and serially dependent are considered. The volatility structure is deterministic and quite general, including breaks or trending…

Methodology · Statistics 2010-07-09 Valentin Patilea , Hamdi Raïssi

We consider a linear regression model with a spatially correlated error term on a lattice. When estimating coefficients in the linear regression model, the generalized least squares estimator (GLSE) is used if the covariance structures are…

Methodology · Statistics 2014-10-07 Toshihiro Hirano

Stochastic models share many characteristics with generic parametric models. In some ways they can be regarded as a special case. But for stochastic models there is a notion of weak distribution or generalised random variable, and the same…

Numerical Analysis · Mathematics 2018-09-05 Hermann G. Matthies

In this paper, we construct an estimator of an errors-in-variables linear regression model. The regression model leads to a constrained total least squares problems with row and column constraints. Although this problem can be numerically…

Numerical Analysis · Mathematics 2026-02-11 Kensuke Aishima

This study investigated the problem posed by using ordinary least squares (OLS) to estimate parameters of simple linear regression under a specific context of special relativity, where an independent variable is restricted to an open…

Other Statistics · Statistics 2020-06-01 Si Hyung Joo

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn…

Machine Learning · Computer Science 2010-11-02 Katya Scheinberg , Shiqian Ma , Donald Goldfarb

Goemans showed that any $n$ points $x_1, \dotsc x_n$ in $d$-dimensions satisfying $\ell_2^2$ triangle inequalities can be embedded into $\ell_{1}$, with worst-case distortion at most $\sqrt{d}$. We extend this to the case when the points…

Data Structures and Algorithms · Computer Science 2015-12-15 Amit Deshpande , Prahladh Harsha , Rakesh Venkat

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

A discriminative structured analysis dictionary is proposed for the classification task. A structure of the union of subspaces (UoS) is integrated into the conventional analysis dictionary learning to enhance the capability of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Wen Tang , Ashkan Panahi , Hamid Krim , Liyi Dai

This article presents maximum likelihood estimators (MLEs) and log-likelihood ratio (LLR) tests for the eigenvalues and eigenvectors of Gaussian random symmetric matrices of arbitrary dimension, where the observations are independent…

Statistics Theory · Mathematics 2009-01-22 Armin Schwartzman , Walter F. Mascarenhas , Jonathan E. Taylor

This study proposes sparse estimation methods for the generalized linear models, which run one of least angle regression (LARS) and least absolute shrinkage and selection operator (LASSO) in the tangent space of the manifold of the…

Machine Learning · Statistics 2020-07-20 Yoshihiro Hirose

We study structure learning for linear Gaussian SEMs in the presence of latent confounding. Existing continuous methods excel when errors are independent, while deconfounding-first pipelines rely on pervasive factor structure or…

Machine Learning · Computer Science 2025-10-03 Samhita Pal , James O'quinn , Kaveh Aryan , Heather Pua , James P. Long , Amir Asiaee

A novel IV estimation method, that we term Locally Trimmed LS (LTLS), is developed which yields estimators with (mixed) Gaussian limit distributions in situations where the data may be weakly or strongly persistent. In particular, we allow…

Econometrics · Economics 2020-06-24 Zhishui Hu , Ioannis Kasparis , Qiying Wang