English
Related papers

Related papers: A low-rank based estimation-testing procedure for …

200 papers

We study the long-standing problem of determining the number of principal components in econometric applications from a selective inference perspective. We consider i.i.d. observations from a $p$-dimensional random vector with $p<n$ and…

Econometrics · Economics 2025-12-12 Yasuyuki Matsumura , Chisato Tachibana

High-dimensional tests are applied to find relevant sets of variables and relevant models. If variables are selected by analyzing the sums of products matrices and a corresponding mean-value test is performed, there is the danger that the…

Methodology · Statistics 2012-02-10 Juergen Laeuter , Maciej Rosolowski , Ekkehard Glimm

Analysis of low-degree polynomial algorithms is a powerful, newly-popular method for predicting computational thresholds in hypothesis testing problems. One limitation of current techniques for this analysis is their restriction to…

Statistics Theory · Mathematics 2020-11-10 Dmitriy Kunisky

Covariance matrix estimation, a classical statistical topic, poses significant challenges when the sample size is comparable to or smaller than the number of features. In this paper, we frame covariance matrix estimation as a compound…

Methodology · Statistics 2025-03-04 Huqin Xin , Sihai Dave Zhao

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

The estimation of causal treatment effects from observational data is a fundamental problem in causal inference. To avoid bias, the effect estimator must control for all confounders. Hence practitioners often collect data for as many…

Machine Learning · Statistics 2020-11-05 Kristjan Greenewald , Dmitriy Katz-Rogozhnikov , Karthik Shanmugam

A daunting challenge faced by modern biological sciences is finding an efficient and computationally feasible approach to deal with the curse of high dimensionality. The problem becomes even more severe when the research focus is on…

Methodology · Statistics 2013-04-16 Hung Hung , Yu-Tin Lin , Pengwen Chen , Chen-Chien Wang , Su-Yun Huang , Jung-Ying Tzeng

The growing number of dimensionality reduction methods available for data visualization has recently inspired the development of quality assessment measures, in order to evaluate the resulting low-dimensional representation independently…

Machine Learning · Computer Science 2011-10-19 Wouter Lueks , Bassam Mokbel , Michael Biehl , Barbara Hammer

We consider parameter estimation, hypothesis testing and variable selection for partially time-varying coefficient models. Our asymptotic theory has the useful feature that it can allow dependent, nonstationary error and covariate…

Statistics Theory · Mathematics 2012-08-20 Ting Zhang , Wei Biao Wu

We consider the problem of variable selection in Bayesian multivariate linear regression models, involving multiple response and predictor variables, under multivariate normal errors. In the absence of a known covariance structure,…

Methodology · Statistics 2025-07-25 Joyee Ghosh , Xun Li

The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In…

Machine Learning · Statistics 2015-04-14 Gregory Darnell , Stoyan Georgiev , Sayan Mukherjee , Barbara E Engelhardt

The current Poisson factor models often assume that the factors are unknown, which overlooks the explanatory potential of certain observable covariates. This study focuses on high dimensional settings, where the number of the count response…

Methodology · Statistics 2024-02-26 Wei Liu , Qingzhi Zhong

There is increasing interest in modeling high-dimensional longitudinal outcomes in applications such as developmental neuroimaging research. Growth curve model offers a useful tool to capture both the mean growth pattern across individuals,…

Methodology · Statistics 2023-05-26 Lu Wang , Xiang Lyu , Zhengwu Zhang , Lexin Li

This study examines the varying coefficient model in tail index regression. The varying coefficient model is an efficient semiparametric model that avoids the curse of dimensionality when including large covariates in the model. In fact,…

Statistics Theory · Mathematics 2023-12-12 Koki Momoki , Takuma Yoshida

Cryo-electron microscopy (cryo-EM) has emerged as a powerful technique for resolving the three-dimensional structures of macromolecules. A key challenge in cryo-EM is characterizing continuous heterogeneity, where molecules adopt a…

Machine Learning · Statistics 2026-02-20 Roey Yadgar , Roy R. Lederman , Yoel Shkolnisky

High-dimensional time series data exist in numerous areas such as finance, genomics, healthcare, and neuroscience. An unavoidable aspect of all such datasets is missing data, and dealing with this issue has been an important focus in…

Machine Learning · Statistics 2018-02-27 Amin Jalali , Rebecca Willett

Estimating a policy that maps states to actions is a central problem in reinforcement learning. Traditionally, policies are inferred from the so called value functions (VFs), but exact VF computation suffers from the curse of…

Machine Learning · Computer Science 2024-05-29 Sergio Rozada , Antonio G. Marques

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Accurate and precise covariance matrices will be important in enabling planned cosmological surveys to detect new physics. Standard methods imply either the need for many N-body simulations in order to obtain an accurate estimate, or a…

Cosmology and Nongalactic Astrophysics · Physics 2018-12-13 Alex Hall , Andy Taylor

This paper addresses patient heterogeneity associated with prediction problems in biomedical applications. We propose a systematic hypothesis testing approach to determine the existence of patient subgroup structure and the number of…

Methodology · Statistics 2021-01-08 Xu Gao , Weining Shen , Jing Ning , Ziding Feng , Jianhua Hu