English
Related papers

Related papers: Loginson: a transform and load system for very lar…

200 papers

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best…

Software Engineering · Computer Science 2021-11-01 Issam Sedki , Abdelwahab Hamou-Lhadj , Otmane Ait-Mohamed

Log analysis is crucial for monitoring system health and diagnosing failures in complex systems. Recent advances in large language models (LLMs) offer new opportunities for automated log analysis, leveraging their reasoning capabilities to…

Artificial Intelligence · Computer Science 2025-09-30 Lipeng Ma , Yixuan Li , Weidong Yang , Mingjie Zhou , Xinyi Liu , Ben Fei , Shuhao Li , Xiaoyan Sun , Sihang Jiang , Yanghua Xiao

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

Aircraft maintenance logs hold valuable safety data but remain underused due to their unstructured text format. This paper introduces LogSyn, a framework that uses Large Language Models (LLMs) to convert these logs into structured,…

Machine Learning · Computer Science 2026-02-10 Devansh Agarwal , Maitreyi Chatterjee , Biplab Chatterjee

Service Level Agreements (SLA) are employed to ensure the performance of Cloud solutions. When a component fails, the importance of logs increases significantly. All departments may turn to logs to determine the cause of the issue and find…

Software Engineering · Computer Science 2021-11-03 William Pourmajidi , Lei Zhang , John Steinbacher , Tony Erwin , Andriy Miranskyy

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based…

Software Engineering · Computer Science 2022-08-23 Shimin Tao , Weibin Meng , Yimeng Chen , Yichen Zhu , Ying Liu Chunning Du , Tao Han , Yongpeng Zhao , Xiangguang Wang , Hao Yang

Logs serve as a primary source of information for engineers to diagnose failures in large-scale online service systems. Log parsing, which extracts structured events from massive unstructured log data, is a critical first step for…

Software Engineering · Computer Science 2026-03-13 Jinrui Sun , Tong Jia , Minghua He , Ying Li

Logs contain critical information about the quality of the rendered services on the Cloud and can be used as digital evidence. Hence, we argue that the critical nature of logs calls for immutability and verification mechanism without the…

Cryptography and Security · Computer Science 2020-10-22 William Pourmajidi , Lei Zhang , John Steinbacher , Tony Erwin , Andriy Miranskyy

With the advent of modern embedded systems, logging as a process is becoming more and more prevalent for diagnostic and analytic services. Traditionally, storage and managing of the logged data are generally kept as a part of one entity…

Cryptography and Security · Computer Science 2023-11-10 Fikret Basic , Christian Steger , Robert Kofler

Log analysis is crucial for ensuring the orderly and stable operation of information systems, particularly in the field of Artificial Intelligence for IT Operations (AIOps). Large Language Models (LLMs) have demonstrated significant…

Computation and Language · Computer Science 2024-07-03 Tianyu Cui , Shiyu Ma , Ziang Chen , Tong Xiao , Shimin Tao , Yilun Liu , Shenglin Zhang , Duoming Lin , Changchang Liu , Yuzhe Cai , Weibin Meng , Yongqian Sun , Dan Pei

Logs are an essential source of information for people to understand the running status of a software system. Due to the evolving modern software architecture and maintenance methods, more research efforts have been devoted to automated log…

Software Engineering · Computer Science 2024-04-09 Xingfang Wu , Heng Li , Foutse Khomh

Effective alert diagnosis is essential for ensuring the reliability of large-scale online service systems. However, on-call engineers are often burdened with manually inspecting massive volumes of logs to identify root causes. While various…

Software Engineering · Computer Science 2025-10-01 Zhihan Jiang , Jinyang Liu , Yichen Li , Haiyu Huang , Xiao He , Tieying Zhang , Jianjun Chen , Yi Li , Rui Shi , Michael R. Lyu

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Processing and reviewing nightly test execution failure logs for large industrial systems is a tedious activity. Furthermore, multiple failures might share one root/common cause during test execution sessions, and the review might therefore…

Software Engineering · Computer Science 2023-01-10 Muhammad Abbas , Ali Hamayouni , Mahshid Helali Moghadam , Mehrdad Saadatmand , Per Erik Strandberg

The stability and performance of Cloud platforms are essential as they directly impact customers' satisfaction. Cloud service providers use Cloud monitoring tools to ensure that rendered services match the quality of service requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-09 William Pourmajidi , Andriy Miranskyy , John Steinbacher , Tony Erwin , David Godwin

System logs are a cornerstone of cybersecurity, supporting proactive breach prevention and post-incident investigations. However, analyzing vast amounts of diverse log data remains significantly challenging, as high costs, lack of in-house…

Artificial Intelligence · Computer Science 2025-10-29 Peng Cai , Reza Ryan , Nickson M. Karie

Kubernetes, an open-source platform for automating the deployment, scaling, and management of containerized applications, is widely used for its efficiency and scalability. However, its complexity and extensive configuration options often…

Cryptography and Security · Computer Science 2024-08-08 Eoghan Russell , Kapal Dev

This paper presents a methodology and a system, named LogMaster, for mining correlations of events that have multiple attributions, i.e., node ID, application ID, event type, and event severity, in logs of large-scale cluster systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-18 Rui Ren , Xiaoyu Fu , Jianfeng Zhan , Wei Zhou

Intrusion detection systems (IDS) monitor system logs and network traffic to recognize malicious activities in computer networks. Evaluating and comparing IDSs with respect to their detection accuracies is thereby essential for their…

Cryptography and Security · Computer Science 2023-05-16 Max Landauer , Florian Skopik , Maximilian Frank , Wolfgang Hotwagner , Markus Wurzenberger , Andreas Rauber