English
Related papers

Related papers: Robust PCA for Anomaly Detection in Cyber Networks

200 papers

Robust principal component analysis (RPCA) is a well-studied problem with the goal of decomposing a matrix into the sum of low-rank and sparse components. In this paper, we propose a nonconvex feasibility reformulation of RPCA problem and…

Optimization and Control · Mathematics 2020-01-27 Aritra Dutta , Filip Hanzely , Peter Richtárik

Decision Support Systems (DSS) in complex installations play a crucial role in assisting operators in decision making during abnormal transients and process disturbances, by actively displaying the status of the system and recording events,…

Neural and Evolutionary Computing · Computer Science 2019-10-08 Abiodun Ayodeji , Yong-kuo Liu

The problem of detecting anomalies in time series from network measurements has been widely studied and is a topic of fundamental importance. Many anomaly detection methods are based on packet inspection collected at the network core…

Networking and Internet Architecture · Computer Science 2020-04-22 Ananda Streit , Gustavo H. A. Santos , Rosa Leão , Edmundo de Souza e Silva , Daniel Menasché , Don Towsley

A principal component analysis (PCA) of clean microcalorimeter pulse records can be a first step beyond statistically optimal linear filtering of pulses towards a fully non-linear analysis. For PCA to be practical on spectrometers with…

Data Analysis, Statistics and Probability · Physics 2020-01-08 J. W. Fowler , B. K. Alpert , Y. -I. Joe , G. C. O'Neil , D. S. Swetz , J. N. Ullom

Artificial neural networks that learn to perform Principal Component Analysis (PCA) and related tasks using strictly local learning rules have been previously derived based on the principle of similarity matching: similar pairs of inputs…

Computation · Statistics 2018-11-06 Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

With the widespread adoption of cloud services, especially the extensive deployment of plenty of Web applications, it is important and challenging to detect anomalies from the packet payload. For example, the anomalies in the packet payload…

Signal Processing · Electrical Eng. & Systems 2021-05-20 Jiaxin Liu , Xucheng Song , Yingjie Zhou , Xi Peng , Yanru Zhang , Pei Liu , Dapeng Wu

Cellular Automata are discrete dynamical systems that evolve following simple and local rules. Despite of its local simplicity, knowledge discovery in CA is a NP problem. This is the main motivation for using data mining techniques for CA…

Discrete Mathematics · Computer Science 2007-05-23 Gilson A. Giraldi , Antonio A. F. Oliveira , Leonardo Carvalho

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

Principal component analysis (PCA) is a statistical technique commonly used in multivariate data analysis. However, PCA can be difficult to interpret and explain since the principal components (PCs) are linear combinations of the original…

Mathematical Software · Computer Science 2013-12-24 W. Liu , H. Zhang , D. Tao , Y. Wang , K. Lu

In this paper we propose novel randomized subspace methods to detect anomalies in Internet Protocol networks. Given a data matrix containing information about network traffic, the proposed approaches perform a normal-plus-anomalous matrix…

Information Theory · Computer Science 2017-04-20 M. Kaloorazi , R. C. de Lamare

The network traffic matrix is widely used in network operation and management. It is therefore of crucial importance to analyze the components and the structure of the network traffic matrix, for which several mathematical approaches such…

Networking and Internet Architecture · Computer Science 2015-03-19 Zhe Wang , Kai Hu , Ke Xu , Baolin Yin , Xiaowen Dong

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

Due to the rapid growth of smart agents such as weakly connected computational nodes and sensors, developing decentralized algorithms that can perform computations on local agents becomes a major research direction. This paper considers the…

Machine Learning · Computer Science 2021-02-09 Haishan Ye , Tong Zhang

We propose a kernel-PCA based method to detect anomaly in chemical sensors. We use temporal signals produced by chemical sensors to form vectors to perform the Principal Component Analysis (PCA). We estimate the kernel-covariance matrix of…

Signal Processing · Electrical Eng. & Systems 2022-09-30 Hongyi Pan , Diaa Badawi , Ishaan Bassi , Sule Ozev , Ahmet Enis Cetin

We consider principal component analysis for contaminated data-set in the high dimensional regime, where the dimensionality of each observation is comparable or even more than the number of observations. We propose a deterministic…

Machine Learning · Computer Science 2012-06-22 Jiashi Feng , Huan Xu , Shuicheng Yan

We consider an online version of the robust Principle Component Analysis (PCA), which arises naturally in time-varying source separations such as video foreground-background separation. This paper proposes a compressive online robust PCA…

Information Theory · Computer Science 2017-05-30 Huynh Van Luong , Nikos Deligiannis , Jurgen Seiler , Soren Forchhammer , Andre Kaup

The growing cybersecurity threats make it essential to use high-quality data to train Machine Learning (ML) models for network traffic analysis, without noisy or missing data. By selecting the most relevant features for cyber-attack…

Cryptography and Security · Computer Science 2024-07-09 João Vitorino , Miguel Silva , Eva Maia , Isabel Praça

This work studies the recursive robust principal components analysis (PCA) problem. If the outlier is the signal-of-interest, this problem can be interpreted as one of recursively recovering a time sequence of sparse vectors, $S_t$, in the…

Information Theory · Computer Science 2014-03-28 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

Finding informative low-dimensional representations that can be computed efficiently in large datasets is an important problem in data analysis. Recently, contrastive Principal Component Analysis (cPCA) was proposed as a more informative…

Machine Learning · Statistics 2022-11-16 Siavash Golkar , David Lipshutz , Tiberiu Tesileanu , Dmitri B. Chklovskii

This study presents a scalable data-driven algorithm designed to efficiently address the challenging problem of reachability analysis. Analysis of cyber-physical systems (CPS) relies typically on parametric physical models of dynamical…

Robotics · Computer Science 2025-05-22 Navid Hashemi , Lars Lindemann , Jyotirmoy Deshmukh