English
Related papers

Related papers: PCA-based estimation for functional linear regress…

200 papers

Tensor robust principal component analysis (TRPCA) is a fundamental model in machine learning and computer vision. Recently, tensor train (TT) decomposition has been verified effective to capture the global low-rank correlation for tensor…

Machine Learning · Computer Science 2022-03-14 Yuning Qiu , Guoxu Zhou , Zhenhao Huang , Qibin Zhao , Shengli Xie

A functional (lagged) time series regression model involves the regression of scalar response time series on a time series of regressors that consists of a sequence of random functions. In practice, the underlying regressor curve time…

Methodology · Statistics 2020-07-28 Tomáš Rubín , Victor M. Panaretos

Many statistical estimands can expressed as continuous linear functionals of a conditional expectation function. This includes the average treatment effect under unconfoundedness and generalizations for continuous-valued and personalized…

Methodology · Statistics 2020-11-23 David A. Hirshberg , Stefan Wager

This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the $M$-estimator of Fan et al. (Ann Stat 49(3):1239--1266,…

Statistics Theory · Mathematics 2022-09-08 Kangqiang Li , Songqiao Tang , Lixin Zhang

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

For a data-generating process for random variables that can be described with a linear structural equation model, we consider a situation in which (i) a set of covariates satisfying the back-door criterion cannot be observed or (ii) such a…

Methodology · Statistics 2025-03-06 Hisayoshi Nanmo , Manabu Kuroki

This paper establishes bounds on the predictive performance of empirical risk minimization for principal component regression. Our analysis is nonparametric, in the sense that the relation between the prediction target and the predictors is…

Econometrics · Economics 2024-09-18 Christian Brownlees , Guðmundur Stefán Guðmundsson , Yaping Wang

We study estimation and prediction in linear models where the response and the regressor variable both take values in some Hilbert space. Our main objective is to obtain consistency of a principal components based estimator for the…

Statistics Theory · Mathematics 2014-04-17 Siegfried Hörmann , Łukasz Kidziński

Functional data typically contains amplitude and phase variation. In many data situations, phase variation is treated as a nuisance effect and is removed during preprocessing, although it may contain valuable information. In this note, we…

Methodology · Statistics 2021-01-01 Clara Happ , Fabian Scheipl , Alice-Agnes Gabriel , Sonja Greven

This paper studies the principal component (PC) method-based estimation of weak factor models with sparse loadings. We uncover an intrinsic near-sparsity preservation property for the PC estimators of loadings, which comes from the…

Econometrics · Economics 2024-11-08 Jie Wei , Yonghui Zhang

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Optimization and Control · Mathematics 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

Tensor regression has attracted significant attention in statistical research. This study tackles the challenge of handling covariates with smooth varying structures. We introduce a novel framework, termed functional tensor regression,…

Methodology · Statistics 2025-06-12 Tongyu Li , Fang Yao , Anru R. Zhang

It is well-known that the approximate factor models have the rotation indeterminacy. It has been considered that the principal component (PC) estimators estimate some rotations of the true factors and factor loadings, but the rotation…

Statistics Theory · Mathematics 2023-11-02 Peiyun Jiang , Yoshimasa Uematsu , Takashi Yamagata

Probabilistic principal component analysis (PCA) and its Bayesian variant (BPCA) are widely used for dimension reduction in machine learning and statistics. The main advantage of probabilistic PCA over the traditional formulation is…

Machine Learning · Statistics 2025-05-23 Arghya Datta , Philippe Gagnon , Florian Maire

We study additive function-on-function regression where the mean response at a particular time point depends on the time point itself as well as the entire covariate trajectory. We develop a computationally efficient estimation methodology…

Methodology · Statistics 2016-12-15 Janet S. Kim , Ana-Maria Staicu , Arnab Maity , Raymond J. Carroll , David Ruppert

Principal Component Analysis (PCA) is the workhorse tool for dimensionality reduction in this era of big data. While often overlooked, the purpose of PCA is not only to reduce data dimensionality, but also to yield features that are…

Machine Learning · Computer Science 2021-11-30 Arpita Gang , Waheed U. Bajwa

Classical multivariate principal component analysis has been extended to functional data and termed functional principal component analysis (FPCA). Most existing FPCA approaches do not accommodate covariate information, and it is the goal…

Statistics Theory · Mathematics 2010-03-02 Ci-Ren Jiang , Jane-Ling Wang

We propose generalized conditional functional principal components analysis (GC-FPCA) for the joint modeling of the fixed and random effects of non-Gaussian functional outcomes. The method scales up to very large functional data sets by…

Methodology · Statistics 2024-11-18 Yu Lu , Xinkai Zhou , Erjia Cui , Dustin Rogers , Ciprian M. Crainiceanu , Julia Wrobel , Andrew Leroux

When observations are curves over some natural time interval, the field of functional data analysis comes into play. Functional linear processes account for temporal dependence in the data. The prediction problem for functional linear…

Methodology · Statistics 2023-12-12 Johannes Klepsch , Claudia Klüppelberg

This paper develops a point impact linear regression model in which the trajectory of a continuous stochastic process, when evaluated at a sensitive time point, is associated with a scalar response. The proposed model complements and is…

Statistics Theory · Mathematics 2010-10-22 Ian W. McKeague , Bodhisattva Sen