中文
相关论文

相关论文: Dimension Reduction for Large-Scale Federated Data…

200 篇论文

Sparse PCA provides a linear combination of small number of features that maximizes variance across data. Although Sparse PCA has apparent advantages compared to PCA, such as better interpretability, it is generally thought to be…

机器学习 · 统计学 2012-10-29 Youwei Zhang , Laurent El Ghaoui

In artificial intelligence (AI), especially deep learning, data diversity and volume play a pivotal role in model development. However, training a robust deep learning model often faces challenges due to data privacy, regulations, and the…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Xiao Chen , Shunan Zhang , Eric Z. Chen , Yikang Liu , Lin Zhao , Terrence Chen , Shanhui Sun

In large-scale statistical modeling, reducing data size through subsampling is essential for balancing computational efficiency and statistical accuracy. We propose a new method, Principal Component Analysis guided Quantile Sampling…

统计计算 · 统计学 2026-01-13 Foo Hui-Mean , Yuan-chin Ivan Chang

Federated learning (FL) is an emerging paradigm that allows a central server to train machine learning models using remote users' data. Despite its growing popularity, FL faces challenges in preserving the privacy of local datasets, its…

密码学与安全 · 计算机科学 2025-05-09 Natalie Lang , Nir Shlezinger , Rafael G. L. D'Oliveira , Salim El Rouayheb

The statistical analysis of tree structured data is a new topic in statistics with wide application areas. Some Principal Component Analysis (PCA) ideas were previously developed for binary tree spaces. In this study, we extend these ideas…

统计方法学 · 统计学 2012-02-14 Carlos A. Alfaro , Burcu Aydın , Elizabeth Bullitt , Alim Ladha , Carlos E. Valencia

Federated learning is a distributed paradigm that allows multiple parties to collaboratively train deep models without exchanging the raw data. However, the data distribution among clients is naturally non-i.i.d., which leads to severe…

机器学习 · 计算机科学 2023-01-31 Tianfei Zhou , Ender Konukoglu

We study the canonical statistical task of computing the principal component from $n$ i.i.d.~data in $d$ dimensions under $(\varepsilon,\delta)$-differential privacy. Although extensively studied in literature, existing solutions fall short…

机器学习 · 计算机科学 2022-05-30 Xiyang Liu , Weihao Kong , Prateek Jain , Sewoong Oh

Compactly expressing large-scale datasets through Multivariate Functional Approximations (MFA) can be critically important for analysis and visualization to drive scientific discovery. Tackling such problems requires scalable data…

数值分析 · 数学 2022-10-14 Vijay S. Mahadevan , David Lenz , Iulian Grindeanu , Thomas Peterka

We propose a distributed method for simultaneous inference for datasets with sample size much larger than the number of covariates, i.e., N >> p, in the generalized linear models framework. When such datasets are too big to be analyzed…

统计方法学 · 统计学 2020-07-23 Lu Tang , Ling Zhou , Peter X. -K. Song

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

机器学习 · 统计学 2017-05-19 Xianghui Luo , Robert J. Durrant

Distributed privacy-preserving regression schemes have been developed and extended in various fields, where multiparty collaboratively and privately run optimization algorithms, e.g., Gradient Descent, to learn a set of optimal parameters.…

机器学习 · 计算机科学 2022-10-18 Xinlin Leng , Chenxu Li , Weifeng Xu , Yuyan Sun , Hongtao Wang

The numerical solution of large-scale PDEs, such as those occurring in data-driven applications, unavoidably require powerful parallel computers and tailored parallel algorithms to make the best possible use of them. In fact, considerations…

数值分析 · 数学 2017-05-11 Francisco Bernal , Gonçalo dos Reis , Greig Smith

We propose a distributed computing framework, based on a divide and conquer strategy and hierarchical modeling, to accelerate posterior inference for high-dimensional Bayesian factor models. Our approach distributes the task of…

统计方法学 · 统计学 2016-12-30 Gautam Sabnis , Debdeep Pati , Barbara Engelhardt , Natesh Pillai

The ongoing transition from a linear (produce-use-dispose) to a circular economy poses significant challenges to current state-of-the-art information and communication technologies. In particular, the derivation of integrated, high-level…

机器学习 · 统计学 2022-11-07 Du Nguyen Duy , David Gabauer , Ramin Nikzad-Langerodi

Principal component analysis (PCA) is one of the most widely used dimension reduction and multivariate statistical techniques. From a probabilistic perspective, PCA seeks a low-dimensional representation of data in the presence of…

机器学习 · 计算机科学 2021-01-06 Chihao Zhang , Kuo Gai , Shihua Zhang

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

机器学习 · 计算机科学 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

统计理论 · 数学 2009-08-26 Arash A. Amini , Martin J. Wainwright

Federated learning (FL) has enabled collaborative model training across decentralized data sources or clients. While adding new participants to a shared model does not pose great technical hurdles, the removal of a participant and their…

Hierarchical panel data models have recently garnered significant attention. This study contributes to the relevant literature by introducing a novel three-dimensional (3D) hierarchical panel data model, which integrates panel regression…

计量经济学 · 经济学 2024-09-13 Guohua Feng , Jiti Gao , Fei Liu , Bin Peng

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

机器学习 · 计算机科学 2013-10-25 Nikos Karampatziakis , Paul Mineiro