English
Related papers

Related papers: Loginson: a transform and load system for very lar…

200 papers

Log parsing transforms log messages into structured formats, serving as the prerequisite step for various log analysis tasks. Although a variety of log parsing approaches have been proposed, their performance on complicated log data remains…

Software Engineering · Computer Science 2024-03-25 Zhihan Jiang , Jinyang Liu , Zhuangbin Chen , Yichen Li , Junjie Huang , Yintong Huo , Pinjia He , Jiazhen Gu , Michael R. Lyu

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao

This paper introduces LogLead, a tool designed for efficient log analysis benchmarking. LogLead combines three essential steps in log processing: loading, enhancing, and anomaly detection. The tool leverages Polars, a high-speed DataFrame…

Software Engineering · Computer Science 2024-01-22 Mika Mäntylä , Yuqing Wang , Jesse Nyyssölä

Log parsing is an essential task in log analysis, and many tools have been designed to accomplish it. Existing log parsers can be categorized into statistic-based and semantic-based approaches. In comparison to semantic-based parsers,…

Software Engineering · Computer Science 2025-08-14 Qiaolin Qin , Xingfang Wu , Heng Li , Ettore Merlo

The ability to detect log anomalies from system logs is a vital activity needed to ensure cyber resiliency of systems. It is applied for fault identification or facilitate cyber investigation and digital forensics. However, as logs…

Cryptography and Security · Computer Science 2023-11-10 Jonathan Pan , Swee Liang Wong , Yidi Yuan

Logs play a critical role in providing essential information for system monitoring and troubleshooting. Recently, with the success of pre-trained language models (PLMs) and large language models (LLMs) in natural language processing (NLP),…

Software Engineering · Computer Science 2025-02-03 Lipeng Ma , Weidong Yang , Sihang Jiang , Ben Fei , Mingjie Zhou , Shuhao Li , Mingyu Zhao , Bo Xu , Yanghua Xiao

Logs play a crucial role in modern software systems, serving as a means for developers to record essential information for future software maintenance. As the performance of these log-based maintenance tasks heavily relies on the quality of…

Software Engineering · Computer Science 2024-04-01 Xiaoyuan Xie , Zhipeng Cai , Songqiang Chen , Jifeng Xuan

Most of today's security solutions, such as security information and event management (SIEM) and signature based IDS, require the operator to evaluate potential attack vectors and update detection signatures and rules in a timely manner.…

Cryptography and Security · Computer Science 2021-01-19 Markus Wurzenberger , Florian Skopik , Roman Fiedler , Wolfgang Kastner

Inverse transparency is created by making all usages of employee data visible to them. This requires tools that handle the logging and storage of usage information, and making logged data visible to data owners. For research and teaching…

Software Engineering · Computer Science 2023-08-09 Valentin Zieglmeier

Logs are crucial for analyzing large-scale software systems, offering insights into system health, performance, security threats, potential bugs, etc. However, their chaotic nature$\unicode{x2013}$characterized by sheer volume, lack of…

Software Engineering · Computer Science 2025-02-20 Dmytro Borysenkov , Adriano Vogel , Sören Henning , Esteban Perez-Wohlfeil

Log parsing, a vital task for interpreting the vast and complex data produced within software architectures faces significant challenges in the transition from academic benchmarks to the industrial domain. Existing log parsers, while highly…

Software Engineering · Computer Science 2024-05-27 Wei Zhang , Xianfu Cheng , Yi Zhang , Jian Yang , Hongcheng Guo , Zhoujun Li , Xiaolin Yin , Xiangyuan Guan , Xu Shi , Liangfan Zheng , Bo Zhang

AI for IT Operations (AIOps) is a powerful platform that Site Reliability Engineers (SREs) use to automate and streamline operational workflows with minimal human intervention. Automated log analysis is a critical task in AIOps as it…

Computation and Language · Computer Science 2023-08-23 Pranjal Gupta , Harshit Kumar , Debanjana Kar , Karan Bhukar , Pooja Aggarwal , Prateeti Mohapatra

In the evolving IT landscape, stability and reliability of systems are essential, yet their growing complexity challenges DevOps teams in implementation and maintenance. Log analysis, a core element of AIOps, provides critical insights into…

Machine Learning · Computer Science 2025-09-11 Thorsten Wittkopp

Effective log anomaly detection is critical to sustaining reliability in large-scale IT infrastructures. Transformer-based models require substantial resources and labeled data, exacerbating the cold-start problem in target domains where…

Software Engineering · Computer Science 2025-12-11 Jingwei Ye , Zhi Wang , Chenbin Su , Jieshuai Yang , Jiayi Ding , Chunbo Liu , Ge Chu

AI systems produce large volumes of logs as they interact with tools and users. Analysing these logs can help understand model capabilities, propensities, and behaviours, or assess whether an evaluation worked as intended. Researchers have…

Modern, large scale monitoring systems have to process and store vast amounts of log data in near real-time. At query time the systems have to find relevant logs based on the content of the log message using support structures that can…

Information Retrieval · Computer Science 2024-03-28 Julian Reichinger , Thomas Krismayer , Jan Rellermeyer

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu

Logs are essential for understanding Continuous Integration (CI) behavior, particularly for diagnosing build failures and performance regressions. Yet their growing volume and verbosity make both manual inspection and automated analysis…

Software Engineering · Computer Science 2026-01-29 Marcus Emmanuel Barnes , Taher A. Ghaleb , Safwat Hassan

Blockchain is one of the most heavily invested technologies in recent years. Due to its tamper-proof and decentralization properties, blockchain has become an ideal utility for data storage that is applicable in many real world industrial…

Cryptography and Security · Computer Science 2020-02-11 Hao Wang , Desheng Yang , Nian Duan , Yang Guo , Lu Zhang

Log data plays a critical role in observability, debugging, and performance monitoring in modern cloud-native systems. In small and early-stage cloud deployments, however, log retention policies are frequently configured far beyond…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Jody Almaida Putra
‹ Prev 1 3 4 5 6 7 10 Next ›