English
Related papers

Related papers: Machine Learning-Based Anomaly Detection of Correl…

200 papers

The rapid growth of deep learning (DL) has spurred interest in enhancing log-based anomaly detection. This approach aims to extract meaning from log events (log message templates) and develop advanced DL models for anomaly detection.…

Machine Learning · Computer Science 2024-02-01 Lin Yang , Junjie Chen , Shutao Gao , Zhihao Gong , Hongyu Zhang , Yue Kang , Huaan Li

The Internet of Things (IoT) integrates more than billions of intelligent devices over the globe with the capability of communicating with other connected devices with little to no human intervention. IoT enables data aggregation and…

Machine Learning · Computer Science 2023-07-21 Tin Lai , Farnaz Farid , Abubakar Bello , Fariza Sabrina

Rotating machines like engines, pumps, or turbines are ubiquitous in modern day societies. Their mechanical parts such as electrical engines, rotors, or bearings are the major components and any failure in them may result in their total…

Machine Learning · Computer Science 2021-01-28 Sabtain Ahmad , Kevin Styp-Rekowski , Sasho Nedelkoski , Odej Kao

With the proliferation of the Internet of Things (IoT) and the rising interconnectedness of devices, network security faces significant challenges, especially from anomalous activities. While traditional machine learning-based intrusion…

Machine Learning · Computer Science 2024-07-11 Tung-Anh Nguyen , Long Tan Le , Tuan Dung Nguyen , Wei Bao , Suranga Seneviratne , Choong Seon Hong , Nguyen H. Tran

Cyberattacks on critical infrastructure, particularly water distribution systems, have increased due to rapid digitalization and the integration of IoT devices and industrial control systems (ICS). These cyber-physical systems (CPS)…

Cryptography and Security · Computer Science 2025-09-22 Michael Somma

Internet of things (IoT) networks face increasing security threats due to their distributed nature and resource constraints. Although federated learning (FL) has gained prominence as a privacy-preserving framework for distributed IoT…

Machine Learning · Computer Science 2026-02-16 Xianchao Xiu , Chenyi Huang , Wei Zhang , Wanquan Liu

An autoencoder is a neural network which data projects to and from a lower dimensional latent space, where this data is easier to understand and model. The autoencoder consists of two sub-networks, the encoder and the decoder, which carry…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Saïd Ladjal , Alasdair Newson , Chi-Hieu Pham

Autoencoders (AE) provide a useful method for nonlinear dimensionality reduction but are ill-suited for low data regimes. Conversely, Principal Component Analysis (PCA) is data-efficient but is limited to linear dimensionality reduction,…

Anomaly detection in large industrial cooling systems is very challenging due to the high data dimensionality, inconsistent sensor recordings, and lack of labels. The state of the art for automated anomaly detection in these systems…

In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Wenjing Dai , Xiufeng Liu , Alfred Heller , Per Sieverts Nielsen

Wear and tear detection in fleet and shared vehicle systems is a critical challenge, particularly in rental and car-sharing services, where minor damage, such as dents, scratches, and underbody impacts, often goes unnoticed or is detected…

Machine Learning · Computer Science 2025-10-21 Sara Khan , Mehmed Yüksel , Frank Kirchner

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-01 Namrata Vaswani , Han Guo

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-03 Namrata Vaswani , Han Guo

Automated anomaly detection is essential for managing information and communications technology (ICT) systems to maintain reliable services with minimum burden on operators. For detecting varying and continually emerging anomalies as…

Machine Learning · Statistics 2018-12-19 Yasuhiro Ikeda , Keisuke Ishibashi , Yuusuke Nakano , Keishiro Watanabe , Ryoichi Kawahara

Anomaly detection is fundamental yet, challenging problem with practical applications in industry. The current approaches neglect the higher-order dependencies within the networks of interconnected sensors in the high-dimensional time…

Machine Learning · Computer Science 2024-08-22 Sakhinana Sagar Srinivas , Rajat Kumar Sarkar , Venkataramana Runkana

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang

We present a method for performing Principal Component Analysis (PCA) on noisy datasets with missing values. Estimates of the measurement error are used to weight the input data such that compared to classic PCA, the resulting eigenvectors…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 Stephen Bailey

Due to the growing amount of data from in-situ sensors in wastewater systems, it becomes necessary to automatically identify abnormal behaviours and ensure high data quality. This paper proposes an anomaly detection method based on a deep…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Stefania Russo , Andy Disch , Frank Blumensaat , Kris Villez

Although federated learning has gained prominence as a privacy-preserving framework tailored for distributed Internet of Things (IoT) environments, current federated principal component analysis (PCA) methods lack integration of sparsity, a…

Machine Learning · Computer Science 2025-10-29 Chenyi Huang , Xianchao Xiu

Reliability is a cumbersome problem in High Performance Computing Systems and Data Centers evolution. During operation, several types of fault conditions or anomalies can arise, ranging from malfunctioning hardware to improper…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-30 Andrea Borghesi , Antonio Libri , Luca Benini , Andrea Bartolini