English
Related papers

Related papers: Multivariate Log-based Anomaly Detection for Distr…

200 papers

Modern applications demand high performance and cost efficient database management systems (DBMSs). Their workloads may be diverse, ranging from online transaction processing to analytics and decision support. The cloud infrastructure…

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Performance and high availability have become increasingly important drivers, amongst other drivers, for user retention in the context of web services such as social networks, and web search. Exogenic and/or endogenic factors often give…

Machine Learning · Computer Science 2017-04-26 Jordan Hochenbaum , Owen S. Vallis , Arun Kejariwal

Detecting anomalies and the corresponding root causes in multivariate time series plays an important role in monitoring the behaviors of various real-world systems, e.g., IT system operations or manufacturing industry. Previous anomaly…

Machine Learning · Computer Science 2022-09-30 Wenzhuo Yang , Kun Zhang , Steven C. H. Hoi

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

It is effective to improve the reliability and availability of large-scale cluster systems through the analysis of failures. Existed failure analysis methods understand and analyze failures from one or few dimension. The analysis results…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-06-09 Wei Zhou , Jianfeng Zhan , Dan Meng

Operation and maintenance of large distributed cloud applications can quickly become unmanageably complex, putting human operators under immense stress when problems occur. Utilizing machine learning for identification and localization of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-10 Dominik Scheinert , Alexander Acker , Lauritz Thamsen , Morgan K. Geldenhuys , Odej Kao

Due to the complexity of modern IT services, failures can be manifold, occur at any stage, and are hard to detect. For this reason, anomaly detection applied to monitoring data such as logs allows gaining relevant insights to improve IT…

Machine Learning · Computer Science 2023-01-26 Thorsten Wittkopp , Dominik Scheinert , Philipp Wiesner , Alexander Acker , Odej Kao

The problem of identifying anomalies in dynamic networks is a fundamental task with a wide range of applications. However, it raises critical challenges due to the complex nature of anomalies, lack of ground truth knowledge, and complex and…

Machine Learning · Computer Science 2022-11-16 Ali Behrouz , Margo Seltzer

Many social and economic systems can be represented as attributed networks encoding the relations between entities who are themselves described by different node attributes. Finding anomalies in these systems is crucial for detecting abuses…

Social and Information Networks · Computer Science 2020-10-27 Leonardo Gutiérrez-Gómez , Alexandre Bovet , Jean-Charles Delvenne

Multivariate time series anomaly detection has been extensively studied under the semi-supervised setting, where a training dataset with all normal instances is required. However, preparing such a dataset is very laborious since each single…

Machine Learning · Computer Science 2023-06-21 Qihang Zhou , Jiming Chen , Haoyu Liu , Shibo He , Wenchao Meng

Machine learning (ML) holds great potential to advance anomaly detection (AD) in chemical processes. However, the development of ML-based methods is hindered by the lack of openly available experimental data. To address this gap, we have…

Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy.…

Machine Learning · Computer Science 2020-09-22 Egor Klevak , Sangdi Lin , Andy Martin , Ondrej Linda , Eric Ringger

Anomaly detection is crucial for understanding unusual behaviors in data, as anomalies offer valuable insights. This paper introduces Dependency-based Anomaly Detection (DepAD), a general framework that utilizes variable dependencies to…

Machine Learning · Computer Science 2024-04-18 Sha Lu , Lin Liu , Kui Yu , Thuc Duy Le , Jixue Liu , Jiuyong Li

Log-based anomaly detection is fundamentally constrained by training data sparsity. Our empirical study reveals that public benchmark datasets cover less than 10% of source code log templates. Consequently, models frequently misclassify…

Software Engineering · Computer Science 2026-04-14 Xinyu Li , Yintong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Yanlin Wang , Zibin Zheng

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Anomaly detection is a crucial task in various domains. Most of the existing methods assume the normal sample data clusters around a single central prototype while the real data may consist of multiple categories or subgroups. In addition,…

Machine Learning · Statistics 2024-12-03 Zhijin Dong , Hongzhi Liu , Boyuan Ren , Weimin Xiong , Zhonghai Wu

Numerous Deep Learning (DL)-based approaches have gained attention in software Log Anomaly Detection (LAD), yet class imbalance in training data remains a challenge, with anomalies often comprising less than 1% of datasets like Thunderbird.…

Software Engineering · Computer Science 2024-10-31 Xiaoxue Ma , Huiqi Zou , Pinjia He , Jacky Keung , Yishu Li , Xiao Yu , Federica Sarro

Logs are critical resources that record events, activities, or messages produced by software applications, operating systems, servers, and network devices. However, consolidating the heterogeneous logs and cross-referencing them is…

Software Engineering · Computer Science 2024-12-18 Rabimba Karanjai , Yang Lu , Dana Alsagheer , Keshav Kasichainula , Lei Xu , Weidong Shi , Shou-Hsuan Stephen Huang

Anomaly event detection is crucial for critical infrastructure security(transportation system, social-ecological sector, insurance service, government sector etc.) due to its ability to reveal and address the potential cyber-threats in…

Social and Information Networks · Computer Science 2021-04-20 Yipeng Ji , Jingyi Wang , Shaoning Li , Yangyang Li , Shenwen Lin , Xiong Li