English
Related papers

Related papers: Sufficient Component Analysis for Supervised Dimen…

200 papers

Sparse principal component analysis (SPCA) methods have proven to efficiently analyze high-dimensional data. Among them, threshold-based SPCA (TSPCA) is computationally more cost-effective than regularized SPCA, based on L1 penalties. We…

Methodology · Statistics 2023-05-29 Kazuyoshi Yata , Makoto Aoshima

Sufficient dimension reduction (SDR), which seeks a lower-dimensional subspace of the predictors containing regression or classification information has been popular in a machine learning community. In this work, we present a new R software…

Computation · Statistics 2024-09-06 Jungmin Shin , Seung Jun Shin , Andreas Artemiou

Factor-based forecasting using Principal Component Analysis (PCA) is an effective machine learning tool for dimension reduction with many applications in statistics, economics, and finance. This paper introduces a Supervised Screening and…

Econometrics · Economics 2025-02-24 Sihan Tu , Zhaoxing Gao

This study debuts a new spline dimensional decomposition (SDD) for uncertainty quantification analysis of high-dimensional functions, including those endowed with high nonlinearity and nonsmoothness, if they exist, in a proficient manner.…

Numerical Analysis · Mathematics 2021-11-29 Sharif Rahman , Ramin Jahanbin

Supervised dimension reduction (SDR) has been a topic of growing interest in data science, as it enables the reduction of high-dimensional covariates while preserving the functional relation with certain response variables of interest.…

Machine Learning · Statistics 2023-05-23 Sam Hawke , Hengrui Luo , Didong Li

Many machine learning applications deal with high dimensional data. To make computations feasible and learning more efficient, it is often desirable to reduce the dimensionality of the input variables by finding linear combinations of the…

Machine Learning · Computer Science 2025-01-30 Wenjing Yang , Yuhong Yang

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Estimating intrinsic dimensionality of data is a classic problem in pattern recognition and statistics. Principal Component Analysis (PCA) is a powerful tool in discovering dimensionality of data sets with a linear structure; it, however,…

Computer Vision and Pattern Recognition · Computer Science 2010-02-11 Mingyu Fan , Nannan Gu , Hong Qiao , Bo Zhang

Principal Component Analysis (PCA) has been widely used for dimensionality reduction and feature extraction. Robust PCA (RPCA), under different robust distance metrics, such as l1-norm and l2, p-norm, can deal with noise or outliers to some…

Machine Learning · Computer Science 2021-06-29 Zhao Kang , Hongfei Liu , Jiangxin Li , Xiaofeng Zhu , Ling Tian

Methodologies for multidimensionality reduction aim at discovering low-dimensional manifolds where data ranges. Principal Component Analysis (PCA) is very effective if data have linear structure. But fails in identifying a possible…

Numerical Analysis · Mathematics 2021-01-14 Alberto García-González , Antonio Huerta , Sergio Zlotnik , Pedro Díez

Sufficient dimension reduction [J. Amer. Statist. Assoc. 86 (1991) 316-342] has long been a prominent issue in multivariate nonparametric regression analysis. To uncover the central dimension reduction space, we propose in this paper an…

Statistics Theory · Mathematics 2014-08-15 Efang Kong , Yingcun Xia

Our research proposes a novel method for reducing the dimensionality of functional data, specifically for the case where the response is a scalar and the predictor is a random function. Our method utilizes distance covariance, and has…

Statistics Theory · Mathematics 2023-09-26 Xing Yang , Jianjun Xu

This paper introduces a method called Sequential and Simultaneous Distance-based Dimension Reduction ($S^2D^2R$) that performs simultaneous dimension reduction for a pair of random vectors based on Distance Covariance (dCov). Compared with…

Methodology · Statistics 2024-10-22 Yijin Ni , Chuanping Yu , Andy Ko , Xiaoming Huo

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as…

Machine Learning · Statistics 2009-09-29 Raviv Raich , Jose A. Costa , Steven B. Damelin , Alfred O. Hero

Dimensionality reduction is an important operation in information visualization, feature extraction, clustering, regression, and classification, especially for processing noisy high dimensional data. However, most existing approaches…

Machine Learning · Computer Science 2020-03-26 Zhenhua Shi , Dongrui Wu , Jian Huang , Yu-Kai Wang , Chin-Teng Lin

Dimensionality reduction is a fundamental technique in machine learning and data analysis, enabling efficient representation and visualization of high-dimensional data. This paper explores five key methods: Principal Component Analysis…

Other Statistics · Statistics 2025-02-19 Yuan-chin Ivan Chang

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

We present a technique to perform dimensionality reduction on data that is subject to uncertainty. Our method is a generalization of traditional principal component analysis (PCA) to multivariate probability distributions. In comparison to…

Machine Learning · Computer Science 2019-10-14 Jochen Görtler , Thilo Spinner , Dirk Streeb , Daniel Weiskopf , Oliver Deussen

We review sufficient dimension reduction (SDR) estimators with multivariate response in this paper. A wide range of SDR methods are characterized as inverse regression SDR estimators or forward regression SDR estimators. The inverse…

Methodology · Statistics 2022-02-03 Yuexiao Dong , Abdul-Nasah Soale , Michael D. Power
‹ Prev 1 3 4 5 6 7 10 Next ›