English
Related papers

Related papers: Semi-Supervised Kernel PCA

200 papers

We introduce Adaptive Subspace PCA (AS-PCA), a framework for principal component analysis of random elements in a general separable Hilbert space. AS-PCA projects the covariance operator onto a data-adaptive finite-dimensional subspace…

Statistics Theory · Mathematics 2026-03-24 Xinyi Li , Margaret Hoch , Michael R. Kosorok

The heavy-tailed distributions of corrupted outliers and singular values of all channels in low-level vision have proven effective priors for many applications such as background modeling, photometric stereo and image alignment. And they…

Machine Learning · Computer Science 2018-10-15 Fanhua Shang , James Cheng , Yuanyuan Liu , Zhi-Quan Luo , Zhouchen Lin

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison

Principal Component Analysis (PCA) is one of the most commonly used statistical methods for data exploration, and for dimensionality reduction wherein the first few principal components account for an appreciable proportion of the…

Methodology · Statistics 2024-01-11 Caren Marzban , Ulvi Yurtsever , Michael Richman

Principal component analysis (PCA) is often used to reduce the dimension of data by selecting a few orthonormal vectors that explain most of the variance structure of the data. L1 PCA uses the L1 norm to measure error, whereas the…

Machine Learning · Statistics 2020-09-04 Young Woong Park , Diego Klabjan

Unsupervised text segmentation is crucial because boundary labels are expensive, subjective, and often fail to transfer across domains and granularity choices. We propose Embed-KCPD, a training-free method that represents sentences as…

Computation and Language · Computer Science 2026-01-27 Mumin Jia , Jairo Diaz-Rodriguez

Principal component analysis (PCA) is one of the most widely used dimensionality reduction methods in scientific data analysis. In many applications, for additional interpretability, it is desirable for the factor loadings to be sparse,…

Optimization and Control · Mathematics 2017-12-05 Santanu S. Dey , Rahul Mazumder , Marco Molinaro , Guanyi Wang

Principal component analysis (PCA) is arguably the most popular tool in multivariate exploratory data analysis. In this paper, we consider the question of how to handle heterogeneous variables that include continuous, binary, and ordinal.…

Machine Learning · Statistics 2018-08-24 Clifford Anderson-Bergman , Tamara G. Kolda , Kina Kincher-Winoto

Robust Principal Component Analysis (RPCA) via rank minimization is a powerful tool for recovering underlying low-rank structure of clean data corrupted with sparse noise/outliers. In many low-level vision problems, not only it is known…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Tae-Hyun Oh , Yu-Wing Tai , Jean-Charles Bazin , Hyeongwoo Kim , In So Kweon

Multilabel representation learning is recognized as a challenging problem that can be associated with either label dependencies between object categories or data-related issues such as the inherent imbalance of positive/negative samples.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Ahmad Sajedi , Samir Khaki , Konstantinos N. Plataniotis , Mahdi S. Hosseini

Principal Component Analysis (PCA) is a powerful tool in statistics and machine learning. While existing study of PCA focuses on the recovery of principal components and their associated eigenvalues, there are few precise characterizations…

Statistics Theory · Mathematics 2022-04-12 Emmanuel Abbe , Jianqing Fan , Kaizheng Wang

Over the years, Principal Component Analysis (PCA) has served as the baseline approach for dimensionality reduction in gene expression data analysis. It primary objective is to identify a subset of disease-causing genes from a vast pool of…

Algebraic Topology · Mathematics 2023-06-13 Sean Cottrell , Rui Wang , Guowei Wei

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She

Principal component analysis (PCA) has been widely applied to dimensionality reduction and data pre-processing for different applications in engineering, biology and social science. Classical PCA and its variants seek for linear projections…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Feiping Nie , Yi Yang , Heng Huang

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

Multivariate Functional Principal Component Analysis (MFPCA) is a valuable tool for exploring relationships and identifying shared patterns of variation in multivariate functional data. However, controlling the roughness of the extracted…

Methodology · Statistics 2023-06-27 Hossein Haghbin , Yue Zhao , Mehdi Maadooliat

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

This paper presents new algorithms to solve the feature-sparsity constrained PCA problem (FSPCA), which performs feature selection and PCA simultaneously. Existing optimization methods for FSPCA require data distribution assumptions and are…

Machine Learning · Computer Science 2019-05-28 Lai Tian , Feiping Nie , Xuelong Li

Principal Component Analysis (PCA) is a transform for finding the principal components (PCs) that represent features of random data. PCA also provides a reconstruction of the PCs to the original data. We consider an extension of PCA which…

Methodology · Statistics 2021-11-05 Pablo Soto-Quiros , Anatoli Torokhti