English
Related papers

Related papers: ClusterLog: Clustering Logs for Effective Log-base…

200 papers

Trace clustering has been extensively used to preprocess event logs. By grouping similar behavior, these techniques guide the identification of sub-logs, producing more understandable models and conformance analytics. Nevertheless, little…

Machine Learning · Computer Science 2021-09-03 Sylvio Barbon , Paolo Ceravolo , Ernesto Damiani , Gabriel Marques Tavares

Logs are crucial for analyzing large-scale software systems, offering insights into system health, performance, security threats, potential bugs, etc. However, their chaotic nature$\unicode{x2013}$characterized by sheer volume, lack of…

Software Engineering · Computer Science 2025-02-20 Dmytro Borysenkov , Adriano Vogel , Sören Henning , Esteban Perez-Wohlfeil

In this work we present a clustering technique called \textit{multi-level conformal clustering (MLCC)}. The technique is hierarchical in nature because it can be performed at multiple significance levels which yields greater insight into…

Machine Learning · Statistics 2020-06-25 Ilia Nouretdinov , James Gammerman , Matteo Fontana , Daljit Rehal

The identification of undesirable behavior in event logs is an important aspect of process mining that is often addressed by anomaly detection methods. Traditional anomaly detection methods tend to focus on statistically rare behavior and…

Artificial Intelligence · Computer Science 2024-07-01 Kiran Busch , Timotheus Kampik , Henrik Leopold

Software-intensive systems produce logs for troubleshooting purposes. Recently, many deep learning models have been proposed to automatically detect system anomalies based on log data. These models typically claim very high detection…

Software Engineering · Computer Science 2022-02-16 Van-Hoang Le , Hongyu Zhang

Log anomaly detection, which is critical for identifying system failures and preempting security breaches, detects irregular patterns within large volumes of log data, and impacts domains such as service reliability, performance…

Software Engineering · Computer Science 2025-11-19 Shenglin Zhang , Ziang Chen , Zijing Que , Yilun Liu , Yongqian Sun , Sicheng Wei , Dan Pei , Hailin Li

Due to the complexity of modern IT services, failures can be manifold, occur at any stage, and are hard to detect. For this reason, anomaly detection applied to monitoring data such as logs allows gaining relevant insights to improve IT…

Machine Learning · Computer Science 2023-01-26 Thorsten Wittkopp , Dominik Scheinert , Philipp Wiesner , Alexander Acker , Odej Kao

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

Log-based anomaly detection is critical for ensuring the stability and reliability of web systems. One of the key problems in this task is the lack of sufficient labeled logs, which limits the rapid deployment in new systems. Existing works…

Machine Learning · Computer Science 2026-03-27 Xinlong Zhao , Tong Jia , Minghua He , Xixuan Yang , Ying Li

Most log-based anomaly detectors assume logs are stable, though logs are often unstable due to software or environmental changes. Anomaly detection on unstable logs (ULAD) is therefore a more realistic, yet under-investigated challenge.…

Software Engineering · Computer Science 2025-10-10 Fatemeh Hadadi , Qinghua Xu , Domenico Bianculli , Lionel Briand

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Process discovery algorithms automatically extract process models from event logs, but high variability often results in complex and hard-to-understand models. To mitigate this issue, trace clustering techniques group process executions…

Machine Learning · Computer Science 2025-12-11 Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Event logs are widely used for anomaly detection and prediction in complex systems. Existing log-based anomaly detection methods usually consist of four main steps: log collection, log parsing, feature extraction, and anomaly detection,…

Machine Learning · Computer Science 2022-12-20 Zhong Li , Matthijs van Leeuwen

The increasing availability of traffic data from sensor networks has created new opportunities for understanding vehicular dynamics and identifying anomalies. In this study, we employ clustering techniques to analyse traffic flow data with…

Machine Learning · Computer Science 2025-09-26 Davide Moretti , Elia Onofri , Emiliano Cristiani

Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies. Through our…

Software Engineering · Computer Science 2021-09-01 Van-Hoang Le , Hongyu Zhang

The scarcity of high-quality public log datasets has become a critical bottleneck in advancing log-based anomaly detection techniques. Current datasets exhibit three fundamental limitations: (1) incomplete event coverage, (2) artificial…

Software Engineering · Computer Science 2025-04-17 Xinyu Li , Yingtong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Dan Li , Zibin Zheng

Log anomaly detection is crucial for preserving the security of operating systems. Depending on the source of log data collection, various information is recorded in logs that can be considered log modalities. In light of this intuition,…

Machine Learning · Computer Science 2026-01-01 Mohammad Nasirzadeh , Jafar Tahmoresnezhad , Parviz Rashidi-Khazaee

NetFlow data is a popular network log format used by many network analysts and researchers. The advantages of using NetFlow over deep packet inspection are that it is easier to collect and process, and it is less privacy intrusive. Many…

Machine Learning · Computer Science 2025-01-09 Clinton Cao , Annibale Panichella , Sicco Verwer , Agathe Blaise , Filippo Rebecchi

Hierarchical clustering based on pairwise similarities is a common tool used in a broad range of scientific applications. However, in many problems it may be expensive to obtain or compute similarities between the items to be clustered.…

Information Theory · Computer Science 2015-03-19 Brian Eriksson , Gautam Dasarathy , Aarti Singh , Robert Nowak

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang