English
Related papers

Related papers: L1-norm Error Function Robustness and Outlier Regu…

200 papers

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse…

Data Structures and Algorithms · Computer Science 2019-11-20 Ilias Diakonikolas , Sushrut Karmalkar , Daniel Kane , Eric Price , Alistair Stewart

Outlier detection for high-dimensional (HD) data is a popular topic in modern statistical research. However, one source of HD data that has received relatively little attention is functional magnetic resonance images (fMRI), which consists…

Methodology · Statistics 2016-10-25 Amanda F. Mejia , Mary Beth Nebel , Ani Eloyan , Brian Caffo , Martin A. Lindquist

Principal component analysis (PCA) is a powerful tool for dimensionality reduction. Unfortunately, it is sensitive to outliers, so that various robust PCA variants were proposed in the literature. Among them the so-called rotational…

Numerical Analysis · Mathematics 2019-05-27 Sebastian Neumayer , Max Nimmer , Simon Setzer , Gabriele Steidl

The accumulation of time-series signals and the absence of labels make time-series Anomaly Detection (AD) a self-supervised task of deep learning. Methods based on normality assumptions face the following three limitations: (1) A single…

Machine Learning · Computer Science 2025-03-25 Xudong Mou , Rui Wang , Bo Li , Tianyu Wo , Jie Sun , Hui Wang , Xudong Liu

Principal component analysis (PCA) is one of the most fundamental tools in machine learning with broad use as a dimensionality reduction and denoising tool. In the later setting, while PCA is known to be effective at subspace recovery and…

Machine Learning · Computer Science 2024-04-23 Chandra Sekhar Mukherjee , Nikhil Doerkar , Jiapeng Zhang

In this paper, an outlier elimination algorithm for ellipse/ellipsoid fitting is proposed. This two-stage algorithm employs a proximity-based outlier detection algorithm (using the graph Laplacian), followed by a model-based outlier…

Methodology · Statistics 2009-10-27 Jieqi Yu , Haipeng Zheng , Sanjeev R. Kulkarni , H. Vincent Poor

The problem of localizing a set of nodes from relative pairwise measurements is at the core of many applications such as Structure from Motion (SfM), sensor networks, and Simultaneous Localization And Mapping (SLAM). In practical…

Computation · Statistics 2019-10-15 Mahroo Bahreinian , Roberto Tron

Robust estimators of large covariance matrices are considered, comprising regularized (linear shrinkage) modifications of Maronna's classical M-estimators. These estimators provide robustness to outliers, while simultaneously being…

Statistics Theory · Mathematics 2018-07-04 Nicolas Auguin , David Morales-Jimenez , Matthew R. McKay , Romain Couillet

Regularization plays an important role in solving ill-posed problems by adding extra information about the desired solution, such as sparsity. Many regularization terms usually involve some vector norm, e.g., $L_1$ and $L_2$ norms. In this…

Numerical Analysis · Mathematics 2021-03-10 Weihong Guo , Yifei Lou , Jing Qin , Ming Yan

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Machine Learning · Computer Science 2024-10-31 Philipp Röchner , Henrique O. Marques , Ricardo J. G. B. Campello , Arthur Zimek , Franz Rothlauf

This work studies the recursive robust principal components' analysis(PCA) problem. Here, "robust" refers to robustness to both independent and correlated sparse outliers. If the outlier is the signal-of-interest, this problem can be…

Information Theory · Computer Science 2014-08-20 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

In recent years, the usage of ensemble learning in applications has grown significantly due to increasing computational power allowing the training of large ensembles in reasonable time frames. Many applications, e.g., malware detection,…

Machine Learning · Computer Science 2021-11-18 Peter Domanski , Dirk Pflüger , Jochen Rivoir , Raphaël Latty

In this study, we tackle the challenge of outlier-robust predictive modeling using highly expressive neural networks. Our approach integrates two key components: (1) a transformed trimmed loss (TTL), a computationally efficient variant of…

Methodology · Statistics 2025-05-14 Akifumi Okuno , Shotaro Yagishita

Overparameterization in deep learning is powerful: Very large models fit the training data perfectly and yet often generalize well. This realization brought back the study of linear models for regression, including ordinary least squares…

Machine Learning · Statistics 2022-04-07 Ningyuan Huang , David W. Hogg , Soledad Villar

Principal Component Analysis (PCA) is widely used for dimensionality reduction and data analysis. However, PCA results are adversely affected by outliers often observed in real-world data. Existing robust PCA methods are often…

Computational Engineering, Finance, and Science · Computer Science 2025-06-23 Timbwaoga Aime Judicael Ouermi , Jixian Li , Chris R. Johnson

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

We consider the problem of principal component analysis (PCA) in the presence of outliers. Given a matrix $A$ ($d \times n$) and parameters $k, m$, the goal is to remove a set of at most $m$ columns of $A$ (known as outliers), so as to…

Data Structures and Algorithms · Computer Science 2018-05-14 Aditya Bhaskara , Srivatsan Kumar

Principal component analysis is commonly used for dimensionality reduction, feature extraction, denoising, and visualization. The most commonly used principal component analysis method is based upon optimization of the L2-norm, however, the…

Emerging Technologies · Computer Science 2025-01-28 Ian Tomeo , Panos P. Markopoulos , Andreas Savakis

In different fields of applications including, but not limited to, behavioral, environmental, medical sciences and econometrics, the use of panel data regression models has become increasingly popular as a general framework for making…

Methodology · Statistics 2020-05-15 Beste Hamiye Beyaztas , Soutir Bandyopadhyay

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen