English
Related papers

Related papers: PCA leverage: outlier detection for high-dimension…

200 papers

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

Machine Learning · Statistics 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

Reliable outlier detection in high-dimensional data is crucial in modern science, yet it remains a challenging task. Traditional methods often break down in these settings due to their reliance on asymptotic behaviors with respect to sample…

Methodology · Statistics 2025-11-05 Seong-ho Lee , Yongho Jeon

Surface, image and video data can be considered as functional data with a bivariate domain. To detect outlying surfaces or images, a new method is proposed based on the mean and the variability of the degree of outlyingness at each grid…

Methodology · Statistics 2016-02-01 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw , Pieter Segaert

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

Machine Learning · Statistics 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

PCA is widely used in health and care research to analyze complex HD datasets, such as patient health records, genetic data, and medical imaging. By reducing dimensionality, PCA helps identify key patterns and trends, which can aid in…

Methodology · Statistics 2025-04-01 Nuwan Weeraratne , Lyn Hunt , Jason Kurz

Recently, the robustification of principal component analysis has attracted lots of attention from statisticians, engineers and computer scientists. In this work we study the type of outliers that are not necessarily apparent in the…

Methodology · Statistics 2016-01-29 Yiyuan She , Shijie Li , Dapeng Wu

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

Machine learning (ML) methods have proved to be a very successful tool in physical sciences, especially when applied to experimental data analysis. Artificial intelligence is particularly good at recognizing patterns in high dimensional…

Materials Science · Physics 2022-08-19 T. Tula , G. Möller , J. Quintanilla , S. R. Giblin , A. D. Hillier , E. E. McCabe , S. Ramos , D. S. Barker , S. Gibson

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse…

Data Structures and Algorithms · Computer Science 2019-11-20 Ilias Diakonikolas , Sushrut Karmalkar , Daniel Kane , Eric Price , Alistair Stewart

Recent studies try to use hyperspectral imaging (HSI) to detect foreign matters in products because it enables to visualize the invisible wavelengths including ultraviolet and infrared. Considering the enormous image channels of the HSI,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Dongeon Kim , YeongHyeon Park

This article studies the robustness of the eigenvalue ordering, an important issue when estimating the leading eigen-subspace by principal component analysis (PCA). In Yata and Aoshima (2010), cross-data-matrix PCA (CDM-PCA) was proposed…

Methodology · Statistics 2025-03-24 Hung Hung , Su-Yun Huang

Astronomers are increasingly faced with a deluge of information, and finding worthwhile targets of study in the sea of data can be difficult. Outlier identification studies are a method that can be used to focus investigations by presenting…

High Energy Astrophysical Phenomena · Physics 2022-09-26 Dustin K. Swarm , Casey T. DeRoo , Yanan Liu , Samantha Watkins

Multivariate data are typically represented by a rectangular matrix (table) in which the rows are the objects (cases) and the columns are the variables (measurements). When there are many variables one often reduces the dimension by…

Methodology · Statistics 2021-01-13 Mia Hubert , Peter J. Rousseeuw , Wannes Van den Bossche

This study concerns the issue of high dimensional outliers which are challenging to distinguish from inliers due to the special structure of high dimensional space. We introduce a new notion of high dimensional outliers that embraces…

Statistics Theory · Mathematics 2019-09-06 Hyo Young Choi , J. S. Marron

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

Statistics Theory · Mathematics 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu

Traditional deep learning (DL) approaches based on supervised learning paradigms require large amounts of annotated data that are rarely available in the medical domain. Unsupervised Out-of-distribution (OOD) detection is an alternative…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Alvaro Fernandez-Quilez , Linas Vidziunas , Ørjan Kløvfjell Thoresen , Ketil Oppedal , Svein Reidar Kjosavik , Trygve Eftestøl

In many real-world applications, data come with corruptions, large errors or outliers. One popular approach is to use L1-norm function. However, the robustness of L1-norm function is not well understood so far. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Chris Ding , Bo Jiang

Semantic segmentation of functional magnetic resonance imaging (fMRI) makes great sense for pathology diagnosis and decision system of medical robots. The multi-channel fMRI provides more information of the pathological features. But the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 Lei Tai , Haoyang Ye , Qiong Ye , Ming Liu