中文
相关论文

相关论文: How to reduce dimension with PCA and random projec…

200 篇论文

Principal component analysis (PCA) is a classical and ubiquitous method for reducing data dimensionality, but it is suboptimal for heterogeneous data that are increasingly common in modern applications. PCA treats all samples uniformly so…

统计理论 · 数学 2021-12-02 David Hong , Kyle Gilman , Laura Balzano , Jeffrey A. Fessler

Most linear dimension reduction methods proposed in the literature can be formulated using an appropriate pair of scatter matrices, see e.g. Ye and Weiss (2003), Tyler et al. (2009), Bura and Yang (2011), Liski et al. (2014) and Luo and Li…

统计方法学 · 统计学 2024-04-12 Klaus Nordhausen , Hannu Oja , David E. Tyler

Principal component analysis (PCA) is a widely used unsupervised dimensionality reduction technique in machine learning, applied across various fields such as bioinformatics, computer vision and finance. However, when the response variables…

应用统计 · 统计学 2025-06-25 Theodosios Papazoglou , Guosheng Yin

In large-scale statistical modeling, reducing data size through subsampling is essential for balancing computational efficiency and statistical accuracy. We propose a new method, Principal Component Analysis guided Quantile Sampling…

统计计算 · 统计学 2026-01-13 Foo Hui-Mean , Yuan-chin Ivan Chang

Dimensionality reduction is a critical preprocessing step for clustering high-dimensional data, yet comprehensive evaluation of its impact across diverse methods and data types remains limited. In this study, we systematically assess the…

机器学习 · 计算机科学 2026-05-13 Ousmane Assani-Amate , Mohammadreza Bakhtyari , Émilie Roy , Vladimir Makarenkov

Principal component analysis (PCA) is an important tool in exploring data. The conventional approach to PCA leads to a solution which favours the structures with large variances. This is sensitive to outliers and could obfuscate interesting…

统计方法学 · 统计学 2015-06-16 A. A. Akinduko , A. N. Gorban

Principal component analysis (PCA) is perhaps the most widely used method for data dimensionality reduction. A key question in PCA is deciding how many factors to retain. This manuscript describes a new approach to automatically selecting…

统计方法学 · 统计学 2026-02-10 Enes Makalic , Daniel F. Schmidt

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

信息论 · 计算机科学 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Big data is transforming our world, revolutionizing operations and analytics everywhere, from financial engineering to biomedical sciences. The complexity of big data often makes dimension reduction techniques necessary before conducting…

统计方法学 · 统计学 2018-01-08 Jianqing Fan , Qiang Sun , Wen-Xin Zhou , Ziwei Zhu

Principal component analysis (PCA) is a well-established method commonly used to explore and visualise data. A classical PCA model is the fixed effect model where data are generated as a fixed structure of low rank corrupted by noise. Under…

统计方法学 · 统计学 2013-05-13 Marie Verbanck , Julie Josse , François Husson

We investigate whether the standard dimensionality reduction technique of PCA inadvertently produces data representations with different fidelity for two different populations. We show on several real-world data sets, PCA has higher…

机器学习 · 计算机科学 2018-11-02 Samira Samadi , Uthaipon Tantipongpipat , Jamie Morgenstern , Mohit Singh , Santosh Vempala

Principal components analysis (PCA) is a widely used dimension reduction technique with an extensive range of applications. In this paper, an online distributed algorithm is proposed for recovering the principal eigenspaces. We further…

Principal component analysis (PCA), a ubiquitous dimensionality reduction technique in signal processing, searches for a projection matrix that minimizes the mean squared error between the reduced dataset and the original one. Since…

机器学习 · 计算机科学 2022-08-25 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte

In this paper, we present a fast and reliable method based on PCA to select the number of dimensions for word embeddings. First, we train one embedding with a generous upper bound (e.g. 1,000) of dimensions. Then we transform the embeddings…

计算与语言 · 计算机科学 2019-09-05 Yu Wang

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

最优化与控制 · 数学 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

最优化与控制 · 数学 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

How to solve high-dimensional linear programs (LPs) efficiently is a fundamental question. Recently, there has been a surge of interest in reducing LP sizes using random projections, which can accelerate solving LPs independently of…

机器学习 · 计算机科学 2024-05-22 Shinsaku Sakaue , Taihei Oki

Single-cell RNA sequencing (scRNA-seq) has revolutionized our ability to analyze gene expression at the cellular level. By providing data on gene expression for each individual cell, scRNA-seq generates large datasets with thousands of…

计算复杂性 · 计算机科学 2025-02-11 Md Romizul Islam , Swakkhar Shatabda

Mining useful clusters from high dimensional data has received significant attention of the computer vision and pattern recognition community in the recent years. Linear and non-linear dimensionality reduction has played an important role…

计算机视觉与模式识别 · 计算机科学 2016-05-25 Nauman Shahid , Nathanael Perraudin , Vassilis Kalofolias , Gilles Puy , Pierre Vandergheynst

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the…

机器学习 · 计算机科学 2024-08-23 Yingzhuo Deng , Ke Hu , Bo Li , Yao Zhang