English
Related papers

Related papers: Sparse and Integrative Principal Component Analysi…

200 papers

In this paper, we consider the classic measurement error regression scenario in which our independent, or design, variables are observed with several sources of additive noise. We will show that our motivating example's replicated…

Applications · Statistics 2012-07-10 David J. Biagioni , Ryan Elmore , Wesley Jones

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

In this manuscript, we study quantile regression in partial functional linear model where response is scalar and predictors include both scalars and multiple functions. Wavelet basis are adopted to better approximate functional slopes while…

Statistics Theory · Mathematics 2017-12-05 Dengdeng Yu , Li Zhang , Ivan Mizera , Bei Jiang , Linglong Kong

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

A wide range of systems exhibit high dimensional incomplete data. Accurate estimation of the missing data is often desired, and is crucial for many downstream analyses. Many state-of-the-art recovery methods involve supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Adrian V. Dalca , John Guttag , Mert R. Sabuncu

Dimension of the encoder output (i.e., the code layer) in an autoencoder is a key hyper-parameter for representing the input data in a proper space. This dimension must be carefully selected in order to guarantee the desired reconstruction…

Machine Learning · Computer Science 2021-02-02 Pedram Fekri , Ali Akbar Safavi , Mehrdad Hosseini Zadeh , Peyman Setoodeh

Multi-view high-dimensional data become increasingly popular in the big data era. Feature selection is a useful technique for alleviating the curse of dimensionality in multi-view learning. In this paper, we study unsupervised feature…

Machine Learning · Computer Science 2017-05-03 Xiaokai Wei , Bokai Cao , Philip S. Yu

For a learning task, data can usually be collected from different sources or be represented from multiple views. For example, laboratory results from different medical examinations are available for disease diagnosis, and each of them can…

Machine Learning · Computer Science 2018-03-28 Bokai Cao , Hucheng Zhou , Guoqiang Li , Philip S. Yu

For multivariate nonparametric regression, doubly penalized ANOVA modeling (DPAM) has recently been proposed, using hierarchical total variations (HTVs) and empirical norms as penalties on the component functions such as main effects and…

Computation · Statistics 2022-10-21 Penghui Fu , Zhiqiang Tan

Correspondence analysis, multiple correspondence analysis and their discriminant counterparts (i.e., discriminant simple correspondence analysis and discriminant multiple correspondence analysis) are methods of choice for analyzing…

The prevalence of data collected on the same set of samples from multiple sources (i.e., multi-view data) has prompted significant development of data integration methods based on low-rank matrix factorizations. These methods decompose…

Methodology · Statistics 2022-06-28 Sangyoon Yi , Raymond K. W. Wong , Irina Gaynanova

Multi-view clustering is an important approach to analyze multi-view data in an unsupervised way. Among various methods, the multi-view subspace clustering approach has gained increasing attention due to its encouraging performance.…

Machine Learning · Computer Science 2019-12-04 Juncheng Lv , Zhao Kang , Boyu Wang , Luping Ji , Zenglin Xu

Dimension reduction for high-dimensional compositional data plays an important role in many fields, where the principal component analysis of the basis covariance matrix is of scientific interest. In practice, however, the basis variables…

Methodology · Statistics 2021-09-13 Jingru Zhang , Wei Lin

In this paper we propose a computationally efficient algorithm for on-line variable selection in multivariate regression problems involving high dimensional data streams. The algorithm recursively extracts all the latent factors of a…

Machine Learning · Statistics 2009-02-10 Brian McWilliams , Giovanni Montana

With the popularity of multimedia technology, information is always represented or transmitted from multiple views. Most of the existing algorithms are graph-based ones to learn the complex structures within multiview data but overlooked…

Machine Learning · Computer Science 2020-10-19 Huibing Wang , Yang Wang , Zhao Zhang , Xianping Fu , Zhuo Li , Mingliang Xu , Meng Wang

In many geoscientific applications, multiple noisy observations of different origin need to be combined to improve the reconstruction of a common underlying quantity. This naturally leads to multi-parameter models for which adequate…

Numerical Analysis · Mathematics 2015-07-09 C. Gerhards , S. Pereverzyev , P. Tkachenko

This paper considers a noisy data structure recovery problem. The goal is to investigate the following question: Given a noisy observation of a permuted data set, according to which permutation was the original data sorted? The focus is on…

Information Theory · Computer Science 2020-11-24 Minoh Jeong , Alex Dytso , Martina Cardone , H. Vincent Poor

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

Machine Learning · Statistics 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as…

Machine Learning · Statistics 2013-11-07 Stoyan Georgiev , Sayan Mukherjee

In recent years, sparse principal component analysis has emerged as an extremely popular dimension reduction technique for high-dimensional data. The theoretical challenge, in the simplest case, is to estimate the leading eigenvector of a…

Statistics Theory · Mathematics 2016-09-29 Tengyao Wang , Quentin Berthet , Richard J. Samworth