English
Related papers

Related papers: Closed-Form, Provable, and Robust PCA via Leverage…

200 papers

Tensor Robust Principal Component Analysis (TRPCA) is a fundamental technique for decomposing multi-dimensional data into a low-rank tensor and an outlier tensor, yet existing methods relying on sparse outlier assumptions often fail under…

Numerical Analysis · Mathematics 2025-04-28 Yangyang Xu , Kexin Li , Li Yang , You-Wei Wen

Uncertainty estimation is crucial in safety-critical applications, where robust out-of-distribution (OOD) detection is essential. Traditional Bayesian methods, though effective, are often hindered by high computational demands. As an…

Machine Learning · Computer Science 2024-11-06 Maksim Zhdanov , Stanislav Dereka , Sergey Kolesnikov

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

Statistics Theory · Mathematics 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

Recent methods for learning a linear subspace from data corrupted by outliers are based on convex $\ell_1$ and nuclear norm optimization and require the dimension of the subspace and the number of outliers to be sufficiently small. In sharp…

Machine Learning · Computer Science 2018-12-27 Zhihui Zhu , Yifan Wang , Daniel P. Robinson , Daniel Q. Naiman , Rene Vidal , Manolis C. Tsakiris

Outlier detection can serve as an extremely important tool for researchers from a wide range of fields. From the sectors of banking and marketing to the social sciences and healthcare sectors, outlier detection techniques are very useful…

Methodology · Statistics 2023-12-12 Efthymios Costa , Ioanna Papatsouma

In the context of sparse principal component detection, we bring evidence towards the existence of a statistical price to pay for computational efficiency. We measure the performance of a test by the smallest signal strength that it can…

Statistics Theory · Mathematics 2013-04-29 Quentin Berthet , Philippe Rigollet

Model averaging is an alternative to model selection for dealing with model uncertainty, which is widely used and very valuable. However, most of the existing model averaging methods are proposed based on the least squares loss function,…

Methodology · Statistics 2019-10-29 Miaomiao Wang , Guohua Zou

Classical linear discriminant analysis (LDA) is based on squared Frobenious norm and hence is sensitive to outliers and noise. To improve the robustness of LDA, in this paper, we introduce capped l_{2,1}-norm of a matrix, which employs…

Machine Learning · Statistics 2020-11-05 Jiakou Liu , Xiong Xiong , Pei-Wei Ren , Da Zhao , Chun-Na Li , Yuan-Hai Shao

Robust Principal Component Analysis (PCA) has received massive attention in recent years. It aims to recover a low-rank matrix and a sparse matrix from their sum. This paper proposes a novel nonconvex Robust PCA algorithm, coined Riemannian…

Machine Learning · Statistics 2023-02-28 Keaton Hamm , Mohamed Meskini , HanQin Cai

Effective patent value assessment provides decision support for patent transection and promotes the practical application of patent technology. The limitations of previous research on patent value assessment were analyzed in this work, and…

Machine Learning · Computer Science 2020-01-24 Yihui Qiu , Chiyu Zhang

Fan et al. [$\mathit{Annals}$ $\mathit{of}$ $\mathit{Statistics}$ $\textbf{47}$(6) (2019) 3009-3031] constructed a distributed principal component analysis (PCA) algorithm to reduce the communication cost between multiple servers…

Statistics Theory · Mathematics 2021-10-07 Kangqiang Li , Han Bao , Lixin Zhang

We consider novelty detection in time series with unknown and nonparametric probability structures. A deep learning approach is proposed to causally extract an innovations sequence consisting of novelty samples statistically independent of…

Machine Learning · Computer Science 2022-10-25 Xinyi Wang , Mei-jen Lee , Qing Zhao , Lang Tong

Principal Component Analysis (PCA) has wide applications in machine learning, text mining and computer vision. Classical PCA based on a Gaussian noise model is fragile to noise of large magnitude. Laplace noise assumption based PCA methods…

Machine Learning · Computer Science 2014-12-22 Pengtao Xie , Eric Xing

We consider the problem of learning a linear factor model. We propose a regularized form of principal component analysis (PCA) and demonstrate through experiments with synthetic and real data the superiority of resulting estimates to those…

Machine Learning · Computer Science 2013-05-31 Yi-Hao Kao , Benjamin Van Roy

Modern machine learning applications should be able to address the intrinsic challenges arising over inference on massive real-world datasets, including scalability and robustness to outliers. Despite the multiple benefits of Bayesian…

Machine Learning · Computer Science 2020-11-10 Dionysis Manousakas , Cecilia Mascolo

Multivariate data are typically represented by a rectangular matrix (table) in which the rows are the objects (cases) and the columns are the variables (measurements). When there are many variables one often reduces the dimension by…

Methodology · Statistics 2021-01-13 Mia Hubert , Peter J. Rousseeuw , Wannes Van den Bossche

Recurrence equations have played a central role in static cost analysis, where they can be viewed as abstractions of programs and used to infer resource usage information without actually running the programs with concrete data. Such…

Programming Languages · Computer Science 2024-09-02 Louis Rustenholz , Pedro Lopez-Garcia , José F. Morales , Manuel V. Hermenegildo

We propose an inlier-based outlier detection method capable of both identifying the outliers and explaining why they are outliers, by identifying the outlier-specific features. Specifically, we employ an inlier-based outlier detection…

Machine Learning · Statistics 2017-02-22 Makoto Yamada , Song Liu , Samuel Kaski

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

Machine Learning · Computer Science 2013-10-25 Nikos Karampatziakis , Paul Mineiro

Principal component analysis (PCA), a ubiquitous dimensionality reduction technique in signal processing, searches for a projection matrix that minimizes the mean squared error between the reduced dataset and the original one. Since…

Machine Learning · Computer Science 2022-08-25 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte