中文
相关论文

相关论文: Metric-Aware PCA as a Linear Instance of Geometric…

200 篇论文

Dimensionality reduction is a fundamental technique in machine learning and data analysis, enabling efficient representation and visualization of high-dimensional data. This paper explores five key methods: Principal Component Analysis…

其他统计学 · 统计学 2025-02-19 Yuan-chin Ivan Chang

Principal component analysis (PCA) is a widely used technique for dimension reduction. As datasets continue to grow in size, distributed-PCA (DPCA) has become an active research area. A key challenge in DPCA lies in efficiently aggregating…

机器学习 · 统计学 2024-10-02 Zhi-Yu Jou , Su-Yun Huang , Hung Hung , Shinto Eguchi

Spectral methods have been the mainstay in several domains such as machine learning and scientific computing. They involve finding a certain kind of spectral decomposition to obtain basis functions that can capture important structures for…

机器学习 · 计算机科学 2020-04-20 Majid Janzamin , Rong Ge , Jean Kossaifi , Anima Anandkumar

Clifford Group Equivariant Neural Networks (CGENNs) leverage Clifford algebras and multivectors as an alternative approach to incorporating group equivariance to ensure symmetry constraints in neural representations. In principle, this…

机器学习 · 计算机科学 2025-06-11 Riccardo Ali , Paulina Kulytė , Haitz Sáez de Ocáriz Borde , Pietro Liò

We present a new framework for multi-line analysis that combines kernel principal component analysis (Kernel PCA), an unsupervised machine-learning method, and Kernel SHapley Additive exPlanations (Kernel SHAP), an explainable artificial…

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input…

机器学习 · 统计学 2021-09-10 Shaojie Xu , Joel Vaughan , Jie Chen , Agus Sudjianto , Vijayan Nair

Despite a lack of theoretical understanding, deep neural networks have achieved unparalleled performance in a wide range of applications. On the other hand, shallow representation learning with component analysis is associated with rich…

机器学习 · 计算机科学 2018-03-20 Calvin Murdock , Ming-Fang Chang , Simon Lucey

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the…

机器学习 · 计算机科学 2024-08-23 Yingzhuo Deng , Ke Hu , Bo Li , Yao Zhang

Deep learning is the mainstream technique for many machine learning tasks, including image recognition, machine translation, speech recognition, and so on. It has outperformed conventional methods in various fields and achieved great…

机器学习 · 计算机科学 2018-06-01 Na Lei , Zhongxuan Luo , Shing-Tung Yau , David Xianfeng Gu

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

数据结构与算法 · 计算机科学 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Principal component analysis (PCA) is a fundamental technique for dimensionality reduction and denoising; however, its application to three-dimensional data with arbitrary orientations -- common in structural biology -- presents significant…

信号处理 · 电气工程与系统科学 2025-10-22 Michael Fraiman , Paulina Hoyos , Tamir Bendory , Joe Kileel , Oscar Mickelin , Nir Sharon , Amit Singer

In recent years, Artificial Intelligence techniques have proved to be very successful when applied to problems in physical sciences. Here we apply an unsupervised Machine Learning (ML) algorithm called Principal Component Analysis (PCA) as…

The first order behavior of multivariate heavy-tailed random vectors above large radial thresholds is ruled by a limit measure in a regular variation framework. For a high dimensional vector, a reasonable assumption is that the support of…

统计理论 · 数学 2019-06-27 Holger Drees , Anne Sabourin

Principal component analysis (PCA), a ubiquitous dimensionality reduction technique in signal processing, searches for a projection matrix that minimizes the mean squared error between the reduced dataset and the original one. Since…

机器学习 · 计算机科学 2022-08-25 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

计算机视觉与模式识别 · 计算机科学 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

A new look on the principal component analysis has been presented. Firstly, a geometric interpretation of determination coefficient was shown. In turn, the ability to represent the analyzed data and their interdependencies in the form of…

统计方法学 · 统计学 2017-11-29 Zenon Gniazdowski

A new low-dimensional parameterization based on principal component analysis (PCA) and convolutional neural networks (CNN) is developed to represent complex geological models. The CNN-PCA method is inspired by recent developments in…

机器学习 · 统计学 2018-07-11 Yimin Liu , Wenyue Sun , Louis J. Durlofsky

Principal Component Analysis (PCA) is a commonly used tool for dimension reduction in analyzing high dimensional data; Multilinear Principal Component Analysis (MPCA) has the potential to serve the similar function for analyzing tensor…

统计理论 · 数学 2011-04-29 Hung Hung , Pei-Shien Wu , I-Ping Tu , Su-Yun Huang

We study attention mechanisms through the lens of a canonical unsupervised problem: principal component analysis (PCA). We show that, when trained on Gaussian data, both softmax and linear attention layers learn parameters that align with…

最优化与控制 · 数学 2026-05-19 Rodrigo Maulen-Soto , Claire Boyer

Despite significant advances in the field of deep learning in ap-plications to various areas, an explanation of the learning pro-cess of neural network models remains an important open ques-tion. The purpose of this paper is a comprehensive…

机器学习 · 计算机科学 2023-06-07 German Magai