中文
相关论文

相关论文: On Statistical Inference with High Dimensional Spa…

200 篇论文

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

机器学习 · 计算机科学 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

Motivation: Biomedical studies increasingly produce multi-view high-dimensional datasets (e.g., multi-omics) that demand integrative analysis. Existing canonical correlation analysis (CCA) and generalized CCA methods address at most two of…

机器学习 · 统计学 2025-02-27 Rong Wu , Ziqi Chen , Gen Li , Hai Shu

In high-dimensional linear models, the sparsity assumption is typically made, stating that most of the parameters are equal to zero. Under the sparsity assumption, estimation and, recently, inference have been well studied. However, in…

统计方法学 · 统计学 2019-07-09 Yinchu Zhu , Jelena Bradic

The problem of statistical inference for regression coefficients in a high-dimensional single-index model is considered. Under elliptical symmetry, the single index model can be reformulated as a proxy linear model whose regression…

统计理论 · 数学 2021-03-02 Hamid Eftekhari , Moulinath Banerjee , Ya'acov Ritov

It is clear that conventional statistical inference protocols need to be revised to deal correctly with the high-dimensional data that are now common. Most recent studies aimed at achieving this revision rely on powerful approximation…

Sparse coding has been incorporated in models of the visual cortex for its computational advantages and connection to biology. But how the level of sparsity contributes to performance on visual tasks is not well understood. In this work,…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Joshua Bowren , Luis Sanchez-Giraldo , Odelia Schwartz

We study the dynamics of an online algorithm for learning a sparse leading eigenvector from samples generated from a spiked covariance model. This algorithm combines the classical Oja's method for online PCA with an element-wise…

信息论 · 计算机科学 2016-09-09 Chuang Wang , Yue M. Lu

We consider a high-dimensional linear regression problem. Unlike many papers on the topic, we do not require sparsity of the regression coefficients; instead, our main structural assumption is a decay of eigenvalues of the covariance matrix…

统计理论 · 数学 2021-10-01 Igor Silin , Jianqing Fan

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

统计理论 · 数学 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

Canonical correlation analysis (CCA) is a technique to find statistical dependencies between a pair of multivariate data. However, its application to high dimensional data is limited due to the resulting time complexity. While the…

机器学习 · 计算机科学 2020-12-29 Naoko Koide-Majima , Kei Majima

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

最优化与控制 · 数学 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

定量方法 · 定量生物学 2014-01-24 Samuel M. Gross , Robert Tibshirani

It can be challenging to perform an integrative statistical analysis of multi-view high-dimensional data acquired from different experiments on each subject who participated in a joint study. Canonical Correlation Analysis (CCA) is a…

统计方法学 · 统计学 2023-10-31 Siddhesh Kulkarni , Subhadip Pal , Jeremy T. Gaskins

Reaction Coordinates (RCs) are indicators of hidden, low-dimensional mechanisms that govern the long-term behavior of high-dimensional stochastic processes. We present a novel and general variational characterization of optimal RCs and…

动力系统 · 数学 2021-09-23 Andreas Bittracher , Mattes Mollenhauer , Péter Koltai , Christof Schütte

Canonical correlation analysis (CCA for short) describes the relationship between two sets of variables by finding some linear combinations of these variables that maximizing the correlation coefficient. However, in high-dimensional…

最优化与控制 · 数学 2020-03-23 Kangkang Deng , Zheng Peng

We introduce a new methodology 'charcoal' for estimating the location of sparse changes in high-dimensional linear regression coefficients, without assuming that those coefficients are individually sparse. The procedure works by…

统计理论 · 数学 2023-05-23 Fengnan Gao , Tengyao Wang

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

统计方法学 · 统计学 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

In high-dimensional principal component analysis, important inferential targets include both leading spikes and the associated principal eigenspaces. Such problems arise naturally in high-dimensional factor models, where leading principal…

统计理论 · 数学 2026-03-26 Yanqing Yin , Wang Zhou

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

统计理论 · 数学 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

Hilbert-Schmidt Independence Criterion (HSIC) has recently been used in the field of single-index models to estimate the directions. Compared with some other well-established methods, it requires relatively weaker conditions. However, its…

统计方法学 · 统计学 2021-05-19 Runxiong Wu , Chang Deng , Xin Chen