中文
相关论文

相关论文: Dimension Reduction for Large-Scale Federated Data…

200 篇论文

Despite enormous research interest and rapid application of federated learning (FL) to various areas, existing studies mostly focus on supervised federated learning under the horizontally partitioned local dataset setting. This paper will…

机器学习 · 计算机科学 2022-03-04 Yiu-ming Cheung , Juyong Jiang , Feng Yu , Jian Lou

Principal component analysis (PCA) is one of the most popular dimension reduction techniques in statistics and is especially powerful when a multivariate distribution is concentrated near a lower-dimensional subspace. Multivariate extreme…

统计方法学 · 统计学 2025-07-15 Felix Reinbott , Anja Janßen

Data augmentation (DA) algorithms are widely used for Bayesian inference due to their simplicity. In massive data settings, however, DA algorithms are prohibitively slow because they pass through the full data in any iteration, imposing…

统计计算 · 统计学 2021-09-21 Jiayuan Zhou , Kshitij Khare , Sanvesh Srivastava

The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In…

机器学习 · 统计学 2015-04-14 Gregory Darnell , Stoyan Georgiev , Sayan Mukherjee , Barbara E Engelhardt

The literature on high-dimensional functional data focuses on either the dependence over time or the correlation among functional variables. In this paper, we propose a factor-guided functional principal component analysis (FaFPCA) method…

统计方法学 · 统计学 2022-11-23 Shoudao Wen , Huazhen Lin

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

机器学习 · 统计学 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

Factor analysis and principal component analysis (PCA) are used in many application areas. The first step, choosing the number of components, remains a serious challenge. Our work proposes improved methods for this important problem. One of…

统计方法学 · 统计学 2019-09-17 Edgar Dobriban , Art B. Owen

Functional data analysis (FDA) methods have computational and theoretical appeals for some high dimensional data, but lack the scalability to modern large sample datasets. To tackle the challenge, we develop randomized algorithms for two…

统计计算 · 统计学 2022-04-11 Shiyuan He , Xiaomeng Yan

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

机器学习 · 统计学 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

Principal component analysis (PCA) is a statistical technique commonly used in multivariate data analysis. However, PCA can be difficult to interpret and explain since the principal components (PCs) are linear combinations of the original…

数学软件 · 计算机科学 2013-12-24 W. Liu , H. Zhang , D. Tao , Y. Wang , K. Lu

We propose a new fast generalized functional principal components analysis (fast-GFPCA) algorithm for dimension reduction of non-Gaussian functional data. The method consists of: (1) binning the data within the functional domain; (2)…

统计方法学 · 统计学 2023-06-06 Andrew Leroux , Ciprian Crainiceanu , Julia Wrobel

Dimensionality reduction represents a critical preprocessing step in order to increase the efficiency and the performance of many hyperspectral imaging algorithms. However, dimensionality reduction algorithms, such as the Principal…

机器学习 · 计算机科学 2024-03-28 E. Martel , R. Lazcano , J. Lopez , D. Madroñal , R. Salvador , S. Lopez , E. Juarez , R. Guerra , C. Sanz , R. Sarmiento

Principal component analysis (PCA) is a widely used technique for dimension reduction. As datasets continue to grow in size, distributed-PCA (DPCA) has become an active research area. A key challenge in DPCA lies in efficiently aggregating…

机器学习 · 统计学 2024-10-02 Zhi-Yu Jou , Su-Yun Huang , Hung Hung , Shinto Eguchi

Distributed computing offers a high degree of flexibility to accommodate modern learning constraints and the ever increasing size of datasets involved in massive data issues. Drawing inspiration from the theory of distributed computation…

统计理论 · 数学 2014-07-17 Gérard Biau , Ryad Zenine

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

机器学习 · 统计学 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

Understanding associations between paired high-dimensional longitudinal datasets is a fundamental yet challenging problem that arises across scientific domains, including longitudinal multi-omic studies. The difficulty stems from the…

统计方法学 · 统计学 2026-01-21 Jianbin Tan , Pixu Shi

Distributed Principal Component Analysis (PCA) has been studied to deal with the case when data are stored across multiple machines and communication cost or privacy concerns prohibit the computation of PCA in a central location. However,…

统计计算 · 统计学 2022-05-02 Yong He , Zichen Liu , Yalin Wang

Estimating intrinsic dimensionality of data is a classic problem in pattern recognition and statistics. Principal Component Analysis (PCA) is a powerful tool in discovering dimensionality of data sets with a linear structure; it, however,…

计算机视觉与模式识别 · 计算机科学 2010-02-11 Mingyu Fan , Nannan Gu , Hong Qiao , Bo Zhang

We present a technique to perform dimensionality reduction on data that is subject to uncertainty. Our method is a generalization of traditional principal component analysis (PCA) to multivariate probability distributions. In comparison to…

机器学习 · 计算机科学 2019-10-14 Jochen Görtler , Thilo Spinner , Dirk Streeb , Daniel Weiskopf , Oliver Deussen

We introduce a new spatial data structure for high dimensional data called the \emph{approximate principal direction tree} (APD tree) that adapts to the intrinsic dimension of the data. Our algorithm ensures vector-quantization accuracy…

机器学习 · 计算机科学 2012-06-22 Mark McCartin-Lim , Andrew McGregor , Rui Wang