中文
相关论文

相关论文: PCA leverage: outlier detection for high-dimension…

200 篇论文

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

机器学习 · 统计学 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

Reliable outlier detection in high-dimensional data is crucial in modern science, yet it remains a challenging task. Traditional methods often break down in these settings due to their reliance on asymptotic behaviors with respect to sample…

统计方法学 · 统计学 2025-11-05 Seong-ho Lee , Yongho Jeon

Surface, image and video data can be considered as functional data with a bivariate domain. To detect outlying surfaces or images, a new method is proposed based on the mean and the variability of the degree of outlyingness at each grid…

统计方法学 · 统计学 2016-02-01 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw , Pieter Segaert

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

机器学习 · 统计学 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

统计方法学 · 统计学 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

PCA is widely used in health and care research to analyze complex HD datasets, such as patient health records, genetic data, and medical imaging. By reducing dimensionality, PCA helps identify key patterns and trends, which can aid in…

统计方法学 · 统计学 2025-04-01 Nuwan Weeraratne , Lyn Hunt , Jason Kurz

Recently, the robustification of principal component analysis has attracted lots of attention from statisticians, engineers and computer scientists. In this work we study the type of outliers that are not necessarily apparent in the…

统计方法学 · 统计学 2016-01-29 Yiyuan She , Shijie Li , Dapeng Wu

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

机器学习 · 计算机科学 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

Machine learning (ML) methods have proved to be a very successful tool in physical sciences, especially when applied to experimental data analysis. Artificial intelligence is particularly good at recognizing patterns in high dimensional…

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse…

数据结构与算法 · 计算机科学 2019-11-20 Ilias Diakonikolas , Sushrut Karmalkar , Daniel Kane , Eric Price , Alistair Stewart

Recent studies try to use hyperspectral imaging (HSI) to detect foreign matters in products because it enables to visualize the invisible wavelengths including ultraviolet and infrared. Considering the enormous image channels of the HSI,…

计算机视觉与模式识别 · 计算机科学 2024-01-10 Dongeon Kim , YeongHyeon Park

This article studies the robustness of the eigenvalue ordering, an important issue when estimating the leading eigen-subspace by principal component analysis (PCA). In Yata and Aoshima (2010), cross-data-matrix PCA (CDM-PCA) was proposed…

统计方法学 · 统计学 2025-03-24 Hung Hung , Su-Yun Huang

Astronomers are increasingly faced with a deluge of information, and finding worthwhile targets of study in the sea of data can be difficult. Outlier identification studies are a method that can be used to focus investigations by presenting…

高能天体物理现象 · 物理学 2022-09-26 Dustin K. Swarm , Casey T. DeRoo , Yanan Liu , Samantha Watkins

Multivariate data are typically represented by a rectangular matrix (table) in which the rows are the objects (cases) and the columns are the variables (measurements). When there are many variables one often reduces the dimension by…

统计方法学 · 统计学 2021-01-13 Mia Hubert , Peter J. Rousseeuw , Wannes Van den Bossche

This study concerns the issue of high dimensional outliers which are challenging to distinguish from inliers due to the special structure of high dimensional space. We introduce a new notion of high dimensional outliers that embraces…

统计理论 · 数学 2019-09-06 Hyo Young Choi , J. S. Marron

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

统计理论 · 数学 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

机器学习 · 计算机科学 2020-11-24 Shenglan Liu , Yang Yu

Traditional deep learning (DL) approaches based on supervised learning paradigms require large amounts of annotated data that are rarely available in the medical domain. Unsupervised Out-of-distribution (OOD) detection is an alternative…

图像与视频处理 · 电气工程与系统科学 2023-08-15 Alvaro Fernandez-Quilez , Linas Vidziunas , Ørjan Kløvfjell Thoresen , Ketil Oppedal , Svein Reidar Kjosavik , Trygve Eftestøl

In many real-world applications, data come with corruptions, large errors or outliers. One popular approach is to use L1-norm function. However, the robustness of L1-norm function is not well understood so far. In this paper, we present a…

计算机视觉与模式识别 · 计算机科学 2017-05-30 Chris Ding , Bo Jiang

Semantic segmentation of functional magnetic resonance imaging (fMRI) makes great sense for pathology diagnosis and decision system of medical robots. The multi-channel fMRI provides more information of the pathological features. But the…

计算机视觉与模式识别 · 计算机科学 2017-07-12 Lei Tai , Haoyang Ye , Qiong Ye , Ming Liu