English
Related papers

Related papers: Supervised Kernel PCA For Longitudinal Data

200 papers

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

In this paper, we tackle a significant challenge in PCA: heterogeneity. When data are collected from different sources with heterogeneous trends while still sharing some congruency, it is critical to extract shared knowledge while retaining…

Machine Learning · Computer Science 2025-08-25 Naichen Shi , Raed Al Kontar

Kernel principal component analysis (KPCA) is a well-recognized nonlinear dimensionality reduction method that has been widely used in nonlinear fault detection tasks. As a kernel trick-based method, KPCA inherits two major problems. First,…

Machine Learning · Computer Science 2024-10-28 Zelin Ren , Xuebing Yang , Yuchen Jiang , Wensheng Zhang

Frozen pretrained image representations are widely used for transfer learning: a backbone is kept fixed, feature vectors are extracted, and a lightweight classifier is trained on top. This pipeline usually feeds the full feature vector to…

Machine Learning · Computer Science 2026-05-12 Indar Kumar , Girish Karhana , Sai Krishna Jasti , Ankit Hemant Lade

Principal Component Analysis (PCA) is a commonly used tool for dimension reduction in analyzing high dimensional data; Multilinear Principal Component Analysis (MPCA) has the potential to serve the similar function for analyzing tensor…

Statistics Theory · Mathematics 2011-04-29 Hung Hung , Pei-Shien Wu , I-Ping Tu , Su-Yun Huang

Data visualization and dimension reduction for regression between a general metric space-valued response and Euclidean predictors is proposed. Current Fr\'ech\'et dimension reduction methods require that the response metric space be…

Methodology · Statistics 2024-05-28 Abdul-Nasah Soale , Yuexiao Dong

Over the years, Principal Component Analysis (PCA) has served as the baseline approach for dimensionality reduction in gene expression data analysis. It primary objective is to identify a subset of disease-causing genes from a vast pool of…

Algebraic Topology · Mathematics 2023-06-13 Sean Cottrell , Rui Wang , Guowei Wei

Supervised dimension reduction (SDR) has been a topic of growing interest in data science, as it enables the reduction of high-dimensional covariates while preserving the functional relation with certain response variables of interest.…

Machine Learning · Statistics 2023-05-23 Sam Hawke , Hengrui Luo , Didong Li

Even with the rise in popularity of over-parameterized models, simple dimensionality reduction and clustering methods, such as PCA and k-means, are still routinely used in an amazing variety of settings. A primary reason is the combination…

Methodology · Statistics 2020-09-08 Debolina Paul , Saptarshi Chakraborty , Didong Li , David Dunson

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

Methodology · Statistics 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

An improved version of the sparse multiway kernel spectral clustering (KSC) is presented in this brief. The original algorithm is derived from weighted kernel principal component (KPCA) analysis formulated within the primal-dual…

Machine Learning · Computer Science 2023-10-23 Mihaly Novak , Rocco Langone , Carlos Alzate , Johan Suykens

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Principal component analysis (PCA) is a commonly used pattern analysis method that maps high-dimensional data into a lower-dimensional space maximizing the data variance, that results in the promotion of separability of data. Inspired by…

Signal Processing · Electrical Eng. & Systems 2022-06-20 Xiaoqiang Hua , Yusuke Ono , Linyu Peng , Yuting Xu

Fully supervised deep models have shown promising performance for many medical segmentation tasks. Still, the deployment of these tools in clinics is limited by the very timeconsuming collection of manually expert-annotated data. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Robin Trombetta , Olivier Rouvière , Carole Lartizien

Kernel Principal Component Analysis (KPCA) is a key machine learning algorithm for extracting nonlinear features from data. In the presence of a large volume of high dimensional data collected in a distributed fashion, it becomes very…

Machine Learning · Computer Science 2016-02-16 Maria-Florina Balcan , Yingyu Liang , Le Song , David Woodruff , Bo Xie

Principal Component Analysis (PCA) is one of the most important unsupervised methods to handle high-dimensional data. However, due to the high computational complexity of its eigen decomposition solution, it hard to apply PCA to the…

Machine Learning · Computer Science 2016-03-29 Feiping Nie , Heng Huang

A particularly challenging context for dimensionality reduction is multivariate circular data, i.e., data supported on a torus. Such kind of data appears, e.g., in the analysis of various phenomena in ecology and astronomy, as well as in…

Methodology · Statistics 2021-10-12 Pavlos Zoubouloglou , Eduardo García-Portugués , J. S. Marron

Dimensionality reduction is a critical preprocessing step for clustering high-dimensional data, yet comprehensive evaluation of its impact across diverse methods and data types remains limited. In this study, we systematically assess the…

Machine Learning · Computer Science 2026-05-13 Ousmane Assani-Amate , Mohammadreza Bakhtyari , Émilie Roy , Vladimir Makarenkov

We address the problem of detecting a change in the distribution of a high-dimensional multivariate normal time series. Assuming that the post-change parameters are unknown and estimated using a window of historical data, we extend the…

Signal Processing · Electrical Eng. & Systems 2025-02-12 Robert Malinas , Dogyoon Song , Benjamin D. Robinson , Alfred O. Hero

Our aim is to evaluate fundamental parameters from the analysis of the electromagnetic spectra of stars. We may use $10^3$-$10^5$ spectra; each spectrum being a vector with $10^2$-$10^4$ coordinates. We thus face the so-called "curse of…

Instrumentation and Methods for Astrophysics · Physics 2017-06-08 V. Watson , JF. Trouilhet , F. Paletou , S. Girard