English
Related papers

Related papers: Principal components in linear mixed models with g…

200 papers

This paper studies the inference of the regression coefficient matrix under multivariate response linear regressions in the presence of hidden variables. A novel procedure for constructing confidence intervals of entries of the coefficient…

Methodology · Statistics 2022-01-21 Xin Bing , Wei Cheng , Huijie Feng , Yang Ning

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

Traditional methods for covariate adjustment of treatment means in designed experiments are inherently conditional on the observed covariate values. In order to develop a coherent general methodology for analysis of covariance, we propose a…

Methodology · Statistics 2010-01-19 James G. Booth , Walter T. Federer , Martin T. Wells , Russell D. Wolfinger

We consider three problems in high-dimensional Gaussian linear mixed models. Without any assumptions on the design for the fixed effects, we construct an asymptotic $F$-statistic for testing whether a collection of random effects is zero,…

Statistics Theory · Mathematics 2019-07-30 Michael Law , Ya'acov Ritov

This paper concerns the development of an inferential framework for high-dimensional linear mixed effect models. These are suitable models, for instance, when we have $n$ repeated measurements for $M$ subjects. We consider a scenario where…

Methodology · Statistics 2019-12-17 Lina Lin , Mathias Drton , Ali Shojaie

We study sparse principal component analysis for high dimensional vector autoregressive time series under a doubly asymptotic framework, which allows the dimension $d$ to scale with the series length $T$. We treat the transition matrix of…

Machine Learning · Statistics 2013-07-02 Zhaoran Wang , Fang Han , Han Liu

A number of settings arise in which it is of interest to predict Principal Component (PC) scores for new observations using data from an initial sample. In this paper, we demonstrate that naive approaches to PC score prediction can be…

Statistics Theory · Mathematics 2012-11-14 Seunggeun Lee , Fei Zou , Fred A. Wright

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

Computation · Statistics 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

Modelling longitudinal data is an important yet challenging task. These datasets can be high-dimensional, contain non-linear effects and time-varying covariates. Gaussian process (GP) prior-based variational autoencoders (VAEs) have emerged…

Machine Learning · Computer Science 2024-09-18 Priscilla Ong , Manuel Haußmann , Otto Lönnroth , Harri Lähdesmäki

This article presents maximum likelihood estimators (MLEs) and log-likelihood ratio (LLR) tests for the eigenvalues and eigenvectors of Gaussian random symmetric matrices of arbitrary dimension, where the observations are independent…

Statistics Theory · Mathematics 2009-01-22 Armin Schwartzman , Walter F. Mascarenhas , Jonathan E. Taylor

We provide a unified approach to S-estimation in balanced linear models with structured covariance matrices. Of main interest are S-estimators for linear mixed effects models, but our approach also includes S-estimators in several other…

Statistics Theory · Mathematics 2022-08-04 Hendrik Paul Lopuhaä , Valerie Gares , Anne Ruiz-Gazen

We study estimation and prediction in linear models where the response and the regressor variable both take values in some Hilbert space. Our main objective is to obtain consistency of a principal components based estimator for the…

Statistics Theory · Mathematics 2014-04-17 Siegfried Hörmann , Łukasz Kidziński

This chapter presents key concepts and theoretical results for analyzing estimation and inference in high-dimensional models. High-dimensional models are characterized by having a number of unknown parameters that is not vanishingly small…

Statistics Theory · Mathematics 2018-06-12 Alexandre Belloni , Victor Chernozhukov , Denis Chetverikov , Christian Hansen , Kengo Kato

This paper proposes a debiased estimator for causal effects in high-dimensional generalized linear models with binary outcomes and general link functions. The estimator augments a regularized regression plug-in with weights computed from a…

Econometrics · Economics 2025-10-21 Jing Kong

In this paper, we study the convergent limits and rates of the eigenvalues and eigenvectors for spiked sample covariance matrices whose spectrum can have multiple bulk components. Our model is an extension of Johnstone's spiked covariance…

Probability · Mathematics 2020-01-01 Xiucai Ding

In latent variable models the parameter estimation can be implemented by using the joint or the marginal likelihood, based on independence or conditional independence assumptions. The same dilemma occurs within the Bayesian framework with…

Computation · Statistics 2014-09-18 Silia Vitoratou , Ioannis Ntzoufras , Irini Moustaki

Quantile regression is a powerful tool for detecting exposure-outcome associations given covariates across different parts of the outcome's distribution, but has two major limitations when the aim is to infer the effect of an exposure.…

We consider unsupervised classification by means of a latent multinomial variable which categorizes a scalar response into one of L components of a mixture model. This process can be thought as a hierarchical model with first level…

A common feature of high-dimensional data is that the data dimension is high, however, the sample size is relatively low. We call such data HDLSS data. In this paper, we study asymptotic properties of the first principal component in the…

Statistics Theory · Mathematics 2015-03-26 Aki Ishii , Kazuyoshi Yata , Makoto Aoshima