English
Related papers

Related papers: Efficient Anomaly Detection via Matrix Sketching

200 papers

High dimensional data and systems with many degrees of freedom are often characterized by covariance matrices. In this paper, we consider the problem of simultaneously estimating the dimension of the principal (dominant) subspace of these…

Numerical Analysis · Computer Science 2018-10-10 Shashanka Ubaru , Abd-Krim Seghouane , Yousef Saad

Anomaly detection on time series is a fundamental task in monitoring the Key Performance Indicators (KPIs) of IT systems. Many of the existing approaches in the literature show good performance while requiring a lot of training resources.…

Machine Learning · Computer Science 2021-09-07 Shi-Ying Lan , Run-Qing Chen , Wan-Lei Zhao

Network anomaly detection is a very relevant research area nowadays, especially due to its multiple applications in the field of network security. The boost of new models based on variational autoencoders and generative adversarial networks…

Machine Learning · Statistics 2023-02-06 Fernando Pérez-Bueno , Luz García , Gabriel Maciá-Fernández , Rafael Molina

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

A large number of algorithms in machine learning, from principal component analysis (PCA), and its non-linear (kernel) extensions, to more recent spectral embedding and support estimation methods, rely on estimating a linear subspace from…

Machine Learning · Statistics 2014-08-22 Alessandro Rudi , Guille D. Canas , Lorenzo Rosasco

Linear sketching algorithms have been widely used for processing large-scale distributed and streaming datasets. Their popularity is largely due to the fact that linear sketches can be naturally composed in the distributed model and be…

Data Structures and Algorithms · Computer Science 2017-03-28 Jiecao Chen , Qin Zhang

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

Information Theory · Computer Science 2014-06-19 Andrea Montanari , Emile Richard

Zero-shot anomaly localization is a rising field in computer vision research, with important progress in recent years. This work focuses on the problem of detecting and localizing anomalies in textures, where anomalies can be defined as the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Andrei-Timotei Ardelean , Patrick Rückbeil , Tim Weyrich

In our "big data" age, the size and complexity of data is steadily increasing. Methods for dimension reduction are ever more popular and useful. Two distinct types of dimension reduction are "data-oblivious" methods such as random…

Statistics Theory · Mathematics 2021-03-30 Fan Yang , Sifan Liu , Edgar Dobriban , David P. Woodruff

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

The challenge of efficiently identifying anomalies in data sequences is an important statistical problem that now arises in many applications. Whilst there has been substantial work aimed at making statistical analyses robust to outliers,…

Machine Learning · Statistics 2019-04-12 Alexander T. M. Fisch , Idris A. Eckley , Paul Fearnhead

We consider the problem of identifying patterns in a data set that exhibit anomalous behavior, often referred to as anomaly detection. In most anomaly detection algorithms, the dissimilarity between data samples is calculated by a single…

Machine Learning · Computer Science 2013-01-08 Ko-Jen Hsiao , Kevin S. Xu , Jeff Calder , Alfred O. Hero

Deep learning models have become the dominant approach for multivariate time series anomaly detection (MTSAD), often reporting substantial performance improvements over classical statistical methods. However, these gains are frequently…

Machine Learning · Statistics 2026-03-20 Bruna Alves , Ana Martins , Armando J. Pinho , Sónia Gouveia

We propose a kernel-PCA based method to detect anomaly in chemical sensors. We use temporal signals produced by chemical sensors to form vectors to perform the Principal Component Analysis (PCA). We estimate the kernel-covariance matrix of…

Signal Processing · Electrical Eng. & Systems 2022-09-30 Hongyi Pan , Diaa Badawi , Ishaan Bassi , Sule Ozev , Ahmet Enis Cetin

Anomaly Detection is a relevant problem in numerous real-world applications, especially when dealing with images. However, little attention has been paid to the issue of changes over time in the input data distribution, which may cause a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Nikola Bugarin , Jovana Bugaric , Manuel Barusco , Davide Dalle Pezze , Gian Antonio Susto

Matrices arising in scientific applications frequently admit linear low-rank approximations due to smoothness in the physical and/or temporal domain of the problem. In large-scale problems, computing an optimal low-rank approximation can be…

Numerical Analysis · Mathematics 2021-05-05 Alec Michael Dunton , Alireza Doostan

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

Data Structures and Algorithms · Computer Science 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

Timely detection of abrupt anomalies is crucial for real-time monitoring and security of modern systems producing high-dimensional data. With this goal, we propose effective and scalable algorithms. Proposed algorithms are nonparametric as…

Machine Learning · Computer Science 2020-02-19 Mehmet Necip Kurt , Yasin Yilmaz , Xiaodong Wang

Anomaly detection in massive networks has numerous theoretical and computational challenges, especially as the behavior to be detected becomes small in comparison to the larger network. This presentation focuses on recent results in three…

Social and Information Networks · Computer Science 2014-12-16 Benjamin A. Miller , Nicholas Arcolano , Michael M. Wolf , Nadya T. Bliss

Dimension reduction is often an important step in the analysis of high-dimensional data. PCA is a popular technique to find the best low-dimensional approximation of high-dimensional data. However, classical PCA is very sensitive to…

Computation · Statistics 2019-01-14 Holger Cevallos-Valdiviezo , Stefan Van Aelst