English
Related papers

Related papers: Estimation of a Factor-Augmented Linear Model with…

200 papers

The accurate specification of the number of factors is critical to the validity of factor models and the topic almost occupies the central position in factor analysis. Plenty of estimators are available under the restrictive condition that…

Methodology · Statistics 2019-08-15 Long Yu , Yong He , Xinsheng Zhang

Given a learning problem with real-world tradeoffs, which cost function should the model be trained to optimize? This is the metric selection problem in machine learning. Despite its practical interest, there is limited formal guidance on…

Machine Learning · Statistics 2022-08-22 Gaurush Hiranandani

In this paper, we propose a novel factor-augmented forecasting regression model with a binary response variable. We develop a maximum likelihood estimation method for the regression parameters and establish the asymptotic properties of the…

Econometrics · Economics 2025-07-23 Tingting Cheng , Jiachen Cong , Fei Liu , Xuanbin Yang

This paper studies the problem of learning with augmented classes (LAC), where augmented classes unobserved in the training data might emerge in the testing phase. Previous studies generally attempt to discover augmented classes by…

Machine Learning · Computer Science 2020-11-30 Yu-Jie Zhang , Peng Zhao , Zhi-Hua Zhou

Bi-factor analysis is a form of confirmatory factor analysis widely used in psychological and educational measurement. The use of a bi-factor model requires the specification of an explicit bi-factor structure on the relationship between…

Methodology · Statistics 2025-05-21 Jiawei Qiao , Yunxiao Chen , Zhiliang Ying

Factor analysis aims to describe high dimensional random vectors by means of a small number of unknown common factors. In mathematical terms, it is required to decompose the covariance matrix $\Sigma$ of the random vector as the sum of a…

Optimization and Control · Mathematics 2017-08-02 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

In this paper, we introduce a novel high-dimensional Factor-Adjusted sparse Partially Linear regression Model (FAPLM), to integrate the linear effects of high-dimensional latent factors with the nonparametric effects of low-dimensional…

Methodology · Statistics 2025-01-14 Yanmei Shi , Meiling Hao , Yanlin Tang , Xu Guo

We develop an estimator for applications where the variable of interest is endogenous and researchers have access to aggregate instruments. Our method addresses the critical identification challenge -- unobserved confounding, which renders…

Econometrics · Economics 2024-03-19 Dmitry Arkhangelsky , Vasily Korovkin

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

Economists are blessed with a wealth of data for analysis, but more often than not, values in some entries of the data matrix are missing. Various methods have been proposed to handle missing observations in a few variables. We exploit the…

Econometrics · Economics 2022-02-02 Ercument Cahan , Jushan Bai , Serena Ng

Estimating causal effects from observational data informs us about which factors are important in an autonomous system, and enables us to take better decisions. This is important because it has applications in selecting a treatment in…

Machine Learning · Computer Science 2021-10-29 Plabon Shaha , Talha Islam Zadid , Ismat Rahman , Md. Mosaddek Khan

In the linear random effects model, when distributional assumptions such as normality of the error variables cannot be justified, moments may serve as alternatives to describe relevant distributions in neighborhoods of their means.…

Statistics Theory · Mathematics 2012-03-05 Ping Wu , Winfried Stute , Li-Xing Zhu

Linear mixture models have proven very useful in a plethora of applications, e.g., topic modeling, clustering, and source separation. As a critical aspect of the linear mixture models, identifiability of the model parameters is…

Machine Learning · Computer Science 2021-02-24 Bo Yang , Xiao Fu , Nicholas D. Sidiropoulos , Kejun Huang

We propose a two-step estimating procedure for generalized additive partially linear models with clustered data using estimating equations. Our proposed method applies to the case that the number of observations per cluster is allowed to…

Statistics Theory · Mathematics 2013-02-20 Shujie Ma

Value-added models have been widely used to assess the contributions of individual teachers and schools to students' academic growth based on longitudinal student achievement outcomes. There is concern, however, that ignoring the presence…

Methodology · Statistics 2017-10-06 Andrew T. Karl , Yan Yang , Sharon L. Lohr

It is today accepted that matrix factorization models allow a high quality of rating prediction in recommender systems. However, a major drawback of matrix factorization is its static nature that results in a progressive declining of the…

Machine Learning · Computer Science 2012-12-05 Modou Gueye , Talel Abdessalem , Hubert Naacke

We study the problem of estimating a manifold from random samples. In particular, we consider piecewise constant and piecewise linear estimators induced by k-means and k-flats, and analyze their performance. We extend previous results for…

Machine Learning · Computer Science 2015-03-20 Guillermo D. Canas , Tomaso Poggio , Lorenzo Rosasco

We propose modeling raw functional data as a mixture of a smooth function and a high-dimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2022-04-13 Yuan Gao , Han Lin Shang , Yanrong Yang

While many methods purport to explain predictions by highlighting salient features, what aims these explanations serve and how they ought to be evaluated often go unstated. In this work, we introduce a framework to quantify the value of…

We consider the estimation of a sparse factor model where the factor loading matrix is assumed sparse. The estimation problem is reformulated as a penalized M-estimation criterion, while the restrictions for identifying the factor loading…

Statistics Theory · Mathematics 2025-01-23 Benjamin Poignard , Yoshikazu Terada