English
Related papers

Related papers: Big Data-driven Automated Anomaly Detection and Pe…

200 papers

We apply several machine learning algorithms to the problem of anomaly detection in operational data for large-scale, high-voltage electric power grids. We observe important differences in the performance of the algorithms. Neural networks…

Systems and Control · Electrical Eng. & Systems 2026-02-12 Marc Gillioz , Guillaume Dubuis , Étienne Voutaz , Philippe Jacquod

As modern software systems continue to grow in terms of complexity and volume, anomaly detection on multivariate monitoring metrics, which profile systems' health status, becomes more and more critical and challenging. In particular, the…

Software Engineering · Computer Science 2023-08-22 Jinyang Liu , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Cong Feng , Zengyin Yang , Michael R. Lyu

Today's cyber-world is vastly multivariate. Metrics collected at extreme varieties demand multivariate algorithms to properly detect anomalies. However, forecast-based algorithms, as widely proven approaches, often perform sub-optimally or…

Machine Learning · Computer Science 2022-01-14 Lan Wang , Yusan Lin , Yuhang Wu , Huiyuan Chen , Fei Wang , Hao Yang

With the rapid technological advancements, organizations need to rapidly scale up their information technology (IT) infrastructure viz. hardware, software, and services, at a low cost. However, the dynamic growth in the network services and…

Cryptography and Security · Computer Science 2020-08-14 Mahmoud Said Elsayed , Nhien-An Le-Khac , Soumyabrata Dev , Anca Delia Jurcut

Organizations leverage anomaly and changepoint detection algorithms to detect changes in user behavior or service availability and performance. Many off-the-shelf detection algorithms, though effective, cannot readily be used in large…

Machine Learning · Computer Science 2022-05-25 Sourav Chatterjee , Rohan Bopardikar , Marius Guerard , Uttam Thakore , Xiaodong Jiang

Log-based anomaly detection (LogAD) is the main component of Artificial Intelligence for IT Operations (AIOps), which can detect anomalous that occur during the system on-the-fly. Existing methods commonly extract log sequence features…

Machine Learning · Computer Science 2024-12-19 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Bin Han , Hailong Yang , Depei Qian

The increasing connectivity of data and cyber-physical systems has resulted in a growing number of cyber-attacks. Real-time detection of such attacks, through the identification of anomalous activity, is required so that mitigation and…

Machine Learning · Statistics 2021-04-23 Raisa Dzhamtyrova , Carsten Maple

A framework is proposed to detect anomalies in multi-modal data. A deep neural network-based object detector is employed to extract counts of objects and sub-events from the data. A cyclostationary model is proposed to model regular…

Signal Processing · Electrical Eng. & Systems 2018-07-19 Taposh Banerjee , Gene Whipps , Prudhvi Gurram , Vahid Tarokh

River water-quality monitoring is increasingly conducted using automated in situ sensors, enabling timelier identification of unexpected values. However, anomalies caused by technical issues confound these data, while the volume and…

Large network logs, recording multivariate time series generated from heterogeneous devices and sensors in a network, can often reveal important information about abnormal activities, such as network intrusions and device malfunctions.…

Machine Learning · Computer Science 2025-06-19 Yijun Lin , Yao-Yi Chiang

Network data has emerged as an active research area in statistics. Much of the focus of ongoing research has been on static networks that represent a single snapshot or aggregated historical data unchanging over time. However, most networks…

Applications · Statistics 2021-02-23 Lata Kodali , Srijan Sengupta , Leanna House , William H. Woodall

Secure and reliable data communication in optical networks is critical for high-speed internet. We propose a data driven approach for the anomaly detection and faults identification in optical networks to diagnose physical attacks such as…

Cryptography and Security · Computer Science 2022-02-25 Khouloud Abdelli , Joo Yeon Cho , Carsten Tropschug

An important tool grid operators use to safeguard against failures, whether naturally occurring or malicious, involves detecting anomalies in the power system SCADA data. In this paper, we aim to solve a real-time anomaly detection problem.…

Machine Learning · Computer Science 2024-04-12 SangWoo Park , Amritanshu Pandey

Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event…

Machine Learning · Computer Science 2023-05-16 Max Landauer , Sebastian Onder , Florian Skopik , Markus Wurzenberger

This paper presents an automated machine learning framework designed to assist hydrologists in detecting anomalies in time series data generated by sensors in a research watershed in the northeastern United States critical zone. The…

Machine Learning · Computer Science 2023-12-07 Ijaz Ul Haq , Byung Suk Lee , Donna M. Rizzo , Julia N Perdrial

Wireless Sensor Networks (WSNs) have become increasingly valuable in various civil/military applications like industrial process control, civil engineering applications such as buildings structural strength monitoring, environmental…

Life insurance, like other forms of insurance, relies heavily on large volumes of data. The business model is based on an exchange where companies receive payments in return for the promise to provide coverage in case of an accident. Thus,…

Applications · Statistics 2024-11-27 Andreas Groll , Akshat Khanna , Leonid Zeldin

The advent of novel 5G services and applications with binding latency requirements and guaranteed Quality of Service (QoS) hastened the need to incorporate autonomous and proactive decision-making in network management procedures. The…

Networking and Internet Architecture · Computer Science 2023-11-09 Marco Skocaj , Francesca Conserva , Nicol Sarcone Grande , Andrea Orsi , Davide Micheli , Giorgio Ghinamo , Simone Bizzarri , Roberto Verdone

To ensure reliability and service availability, next-generation networks are expected to rely on automated anomaly detection systems powered by advanced machine learning methods with the capability of handling multi-dimensional data. Such…

Machine Learning · Computer Science 2026-01-07 Mahsa Raeiszadeh , Amin Ebrahimzadeh , Roch H. Glitho , Johan Eker , Raquel A. F. Mini

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao