中文
相关论文

相关论文: Closed-Form, Provable, and Robust PCA via Leverage…

200 篇论文

We present an algorithm for L1-norm kernel PCA and provide a convergence analysis for it. While an optimal solution of L2-norm kernel PCA can be obtained through matrix decomposition, finding that of L1-norm kernel PCA is not trivial due to…

机器学习 · 统计学 2020-06-12 Cheolmin Kim , Diego Klabjan

We provide a new robust convergence analysis of the well-known power method for computing the dominant singular vectors of a matrix that we call the noisy power method. Our result characterizes the convergence behavior of the algorithm when…

数据结构与算法 · 计算机科学 2015-02-05 Moritz Hardt , Eric Price

Efficient representations of data are essential for processing, exploration, and human understanding, and Principal Component Analysis (PCA) is one of the most common dimensionality reduction techniques used for the analysis of large,…

统计计算 · 统计学 2023-11-06 Olga Dorabiala , Aleksandr Aravkin , J. Nathan Kutz

This work studies the recursive robust principal components' analysis(PCA) problem. Here, "robust" refers to robustness to both independent and correlated sparse outliers. If the outlier is the signal-of-interest, this problem can be…

信息论 · 计算机科学 2014-08-20 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

Principal component analysis (PCA) is a classical and widely used method for dimensionality reduction, with applications in data compression, computer vision, pattern recognition, and signal processing. However, PCA is designed for…

统计方法学 · 统计学 2025-10-01 Wenhui Wu , Changchun Shang , Jianhua Zhao , Xuan Ma , Yue Wang

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

机器学习 · 计算机科学 2020-09-22 Firuz Kamalov , Ho Hon Leung

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

机器学习 · 统计学 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

统计方法学 · 统计学 2017-08-07 Thomas Ortner , Peter Filzmoser , Maia Zaharieva , Sarka Brodinova , Christian Breiteneder

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the…

机器学习 · 计算机科学 2024-08-23 Yingzhuo Deng , Ke Hu , Bo Li , Yao Zhang

In this paper we propose a novel optimization framework to systematically solve robust PCA problem with rigorous theoretical guarantee, based on which we investigate very computationally economic updating algorithms.

机器学习 · 计算机科学 2021-11-25 Kai Liu , Yarui Cao

We derive a convex optimization problem for the task of segmenting sequential data, which explicitly treats presence of outliers. We describe two algorithms for solving this problem, one exact and one a top-down novel approach, and we…

机器学习 · 计算机科学 2014-11-19 Itamar Katz , Koby Crammer

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

统计方法学 · 统计学 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

机器学习 · 统计学 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and…

统计方法学 · 统计学 2021-06-23 Luca Insolia , Francesca Chiaromonte , Runze Li , Marco Riani

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

最优化与控制 · 数学 2009-07-14 Zhaosong Lu , Yong Zhang

In this paper, we propose an optimization-based method for robust phase retrieval problem where the goal is to estimate an unknown signal from a quadratic measurement corrupted by outliers. To enhance the robustness of existing optimization…

最优化与控制 · 数学 2026-04-17 Kumataro Yazawa , Keita Kume , Isao Yamada

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

计算机视觉与模式识别 · 计算机科学 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

Outlier detection is an important problem occurring in a wide range of areas. Outliers are the outcome of fraudulent behaviour, mechanical faults, human error, or simply natural deviations. Many data mining applications perform outlier…

机器学习 · 计算机科学 2025-10-28 Juan A. Lara , David Lizcano , Víctor Rampérez , Javier Soriano

Motivated by the recently shown connection between self-attention and (kernel) principal component analysis (PCA), we revisit the fundamentals of PCA. Using the difference-of-convex (DC) framework, we present several novel formulations and…

机器学习 · 计算机科学 2025-10-22 Jan Quan , Johan Suykens , Panagiotis Patrinos