English
Related papers

Related papers: A layered architecture for log analysis in complex…

200 papers

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

The tools employed in the DevOps Toolchain generates a large quantity of data that is typically ignored or inspected only in particular occasions, at most. However, the analysis of such data could enable the extraction of useful information…

Software Engineering · Computer Science 2019-09-30 Antonio Capizzi , Salvatore Distefano , Manuel Mazzara , Luiz J. P. Araùjo , Muhammad Ahmad , Evgeny Bobrov

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

Most of today's security solutions, such as security information and event management (SIEM) and signature based IDS, require the operator to evaluate potential attack vectors and update detection signatures and rules in a timely manner.…

Cryptography and Security · Computer Science 2021-01-19 Markus Wurzenberger , Florian Skopik , Roman Fiedler , Wolfgang Kastner

Due to the complexity of modern IT services, failures can be manifold, occur at any stage, and are hard to detect. For this reason, anomaly detection applied to monitoring data such as logs allows gaining relevant insights to improve IT…

Machine Learning · Computer Science 2023-01-26 Thorsten Wittkopp , Dominik Scheinert , Philipp Wiesner , Alexander Acker , Odej Kao

Multivariate anomaly detection can be used to identify outages within large volumes of telemetry data for computing systems. However, developing an efficient anomaly detector that can provide users with relevant information is a challenging…

Machine Learning · Computer Science 2022-02-15 Bruno Wassermann , David Ohana , Ronen Schaffer , Robert Shahla , Elliot K. Kolodner , Eran Raichstein , Michal Malka

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao

Automating cloud configuration and deployment remains a critical challenge due to evolving infrastructures, heterogeneous hardware, and fluctuating workloads. Existing solutions lack adaptability and require extensive manual tuning, leading…

The management of modern IT systems poses unique challenges, necessitating scalability, reliability, and efficiency in handling extensive data streams. Traditional methods, reliant on manual tasks and rule-based approaches, prove…

Operating Systems · Computer Science 2024-04-03 Youcef Remil , Anes Bendimerad , Romain Mathonat , Mehdi Kaytoue

Edge computing was introduced as a technical enabler for the demanding requirements of new network technologies like 5G. It aims to overcome challenges related to centralized cloud computing environments by distributing computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Soeren Becker , Florian Schmidt , Anton Gulenko , Alexander Acker , Odej Kao

Log analysis is a relevant research field in cybersecurity as they can provide a source of information for the detection of threats to networks and systems. This paper presents a pipeline to use fine-tuned Large Language Models (LLMs) for…

Cryptography and Security · Computer Science 2025-07-04 Jorge J. Tejero-Fernández , Alfonso Sánchez-Macián

Log anomaly detection is essential for system reliability, but it is extremely challenging to do considering it involves class imbalance. Additionally, the models trained in one domain are not applicable to other domains, necessitating the…

Machine Learning · Computer Science 2026-01-22 Krishna Sharma , Vivek Yelleti

With increasing scale and complexity of cloud operations, automated detection of anomalies in monitoring data such as logs will be an essential part of managing future IT infrastructures. However, many methods based on artificial…

Machine Learning · Computer Science 2021-11-29 Thorsten Wittkopp , Philipp Wiesner , Dominik Scheinert , Alexander Acker

Log-based anomaly detection is fundamentally constrained by training data sparsity. Our empirical study reveals that public benchmark datasets cover less than 10% of source code log templates. Consequently, models frequently misclassify…

Software Engineering · Computer Science 2026-04-14 Xinyu Li , Yintong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Yanlin Wang , Zibin Zheng

Cloud computing is ubiquitous: more and more companies are moving the workloads into the Cloud. However, this rise in popularity challenges Cloud service providers, as they need to monitor the quality of their ever-growing offerings…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Mohammad Saiful Islam , William Pourmajidi , Lei Zhang , John Steinbacher , Tony Erwin , Andriy Miranskyy

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

This project explores large language models (LLMs) for anomaly detection across heterogeneous log sources. Traditional intrusion detection systems suffer from high false positive rates, semantic blindness, and data scarcity, as logs are…

Cryptography and Security · Computer Science 2026-02-09 Yassine Chagna , Antal Goldschmidt