English
Related papers

Related papers: Develop End-to-End Anomaly Detection System

200 papers

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at both forecasting tasks, and at quantifying the uncertainty associated with those forecasts (prediction intervals). One example is Multivariate…

Machine Learning · Computer Science 2022-02-28 Thabang Mathonsi , Terence L van Zyl

One of the critical factors that drive the economic development of a country and guarantee the sustainability of its industries is the constant availability of electricity. This is usually provided by the national electric grid. However, in…

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 William Marfo , Enrique A. Rico , Deepak K. Tosh , Shirley V. Moore

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Rule-based IDS (intrusion detection systems) are being replaced by more robust neural IDS, which demonstrate great potential in the field of Cybersecurity. However, these ML approaches continue to rely on ad-hoc feature engineering…

Artificial Intelligence · Computer Science 2021-08-30 Andrew Golczynski , John A. Emanuello

To ensure the performance of online service systems, their status is closely monitored with various software and system metrics. Performance anomalies represent the performance degradation issues (e.g., slow response) of the service…

Software Engineering · Computer Science 2022-05-10 Zhuangbin Chen , Jinyang Liu , Yuxin Su , Hongyu Zhang , Xiao Ling , Yongqiang Yang , Michael R. Lyu

Network troubleshooting is still a heavily human-intensive process. To reduce the time spent by human operators in the diagnosis process, we present a system based on (i) unsupervised learning methods for detecting anomalies in the time…

Networking and Internet Architecture · Computer Science 2021-08-27 Jose M. Navarro , Alexis Huet , Dario Rossi

This article provides a thorough meta-analysis of the anomaly detection problem. To accomplish this we first identify approaches to benchmarking anomaly detection algorithms across the literature and produce a large corpus of anomaly…

Artificial Intelligence · Computer Science 2016-08-29 Andrew Emmott , Shubhomoy Das , Thomas Dietterich , Alan Fern , Weng-Keen Wong

Time series anomaly detection is critical for supply chain management to take proactive operations, but faces challenges: classical unsupervised anomaly detection based on exploiting data patterns often yields results misaligned with…

Machine Learning · Computer Science 2026-01-28 Haoting Zhang , Shekhar Jain

Performing anomaly detection in hybrid systems is a challenging task since it requires analysis of timing behavior and mutual dependencies of both discrete and continuous signals. Typically, it requires modeling system behavior, which is…

Machine Learning · Computer Science 2020-10-30 Nemanja Hranisavljevic , Oliver Niggemann , Alexander Maier

Timely and accurate detection of anomalies in power electronics is becoming increasingly critical for maintaining complex production systems. Robust and explainable strategies help decrease system downtime and preempt or mitigate…

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

Ever growing volume and velocity of data coupled with decreasing attention span of end users underscore the critical need for real-time analytics. In this regard, anomaly detection plays a key role as an application as well as a means to…

Machine Learning · Statistics 2017-10-16 Dhruv Choudhary , Arun Kejariwal , Francois Orsini

Unexpected recommender system constitutes an important tool to tackle the problem of filter bubbles and user boredom, which aims at providing unexpected and satisfying recommendations to target users at the same time. Previous unexpected…

Information Retrieval · Computer Science 2020-07-28 Pan Li , Alexander Tuzhilin

Mobile malware and mobile network attacks are becoming a significant threat that accompanies the increasing popularity of smart phones and tablets. Thus in this paper we present our research vision that aims to develop a network-based…

Cryptography and Security · Computer Science 2013-05-21 Omer H. Abdelrahman , Erol Gelenbe , Gökçe Görbil , Boris Oklander

We develop a real-time anomaly detection algorithm for directed activity on large, sparse networks. We model the propensity for future activity using a dynamic logistic model with interaction terms for sender- and receiver-specific latent…

Methodology · Statistics 2021-02-01 Wesley Lee , Tyler H. McCormick , Joshua Neil , Cole Sodja , Yanran Cui

Most anomaly detection systems try to model normal behavior and assume anomalies deviate from it in diverse manners. However, there may be patterns in the anomalies as well. Ideally, an anomaly detection system can exploit patterns in both…

Machine Learning · Computer Science 2023-05-23 Jonas Soenen , Elia Van Wolputte , Vincent Vercruyssen , Wannes Meert , Hendrik Blockeel

In many real-world AD applications including computer security and fraud prevention, the anomaly detector must be configurable by the human analyst to minimize the effort on false positives. One important way to configure the detector is by…

Machine Learning · Computer Science 2024-05-15 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa