English
Related papers

Related papers: On the Effectiveness of Log Representation for Log…

200 papers

As Machine Learning (ML) gains adoption across industries and new use cases, practitioners increasingly realize the challenges around effectively developing and iterating on ML systems: reproducibility, debugging, scalability, and…

Machine Learning · Computer Science 2023-03-22 Jacopo Tagliabue , Hugo Bowne-Anderson , Ville Tuulos , Savin Goyal , Romain Cledat , David Berg

Logging, the practice of inserting log statements into source code, is critical for improving software reliability. Recently, language model-based techniques have been developed to automate log statement generation based on input code.…

Software Engineering · Computer Science 2025-04-03 Boyin Tan , Junjielong Xu , Zhouruixing Zhu , Pinjia He

Data representation plays a critical role in the performance of novelty detection (or ``anomaly detection'') methods in machine learning. The data representation of network traffic often determines the effectiveness of these models as much…

Networking and Internet Architecture · Computer Science 2021-06-11 Kun Yang , Samory Kpotufe , Nick Feamster

Logs constitute a form of evidence signaling the operational status of software systems. Automated log anomaly detection is crucial for ensuring the reliability of modern software systems. However, existing approaches face significant…

Log data is a crucial resource for recording system events and states during system execution. However, as systems grow in scale, log data generation has become increasingly explosive, leading to an expensive overhead on log storage, such…

Software Engineering · Computer Science 2023-09-19 Xiaoyun Li , Hongyu Zhang , Van-Hoang Le , Pengfei Chen

In the evolving IT landscape, stability and reliability of systems are essential, yet their growing complexity challenges DevOps teams in implementation and maintenance. Log analysis, a core element of AIOps, provides critical insights into…

Machine Learning · Computer Science 2025-09-11 Thorsten Wittkopp

Logging is indispensable for maintaining the reliability and diagnosability of modern software, yet developers still struggle to decide where and how to log effectively. Existing automated logging techniques focus on isolated sub-tasks -…

Software Engineering · Computer Science 2025-07-29 Shengcheng Duan , Yihua Xu , Sheng Zhang , Shen Wang , Yue Duan

With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events…

Software Engineering · Computer Science 2022-02-16 Lei Yu , Tian Wu , Jiaqi Li , Patrick Chan , Hong Min , Fanjing Meng

[Context] Machine learning (ML)-enabled systems are present in our society, driving significant digital transformations. The dynamic nature of ML development, characterized by experimental cycles and rapid changes in data, poses challenges…

Software Engineering · Computer Science 2025-06-27 Lucas Romao , Hugo Villamizar , Romeu Oliveira , Silvio Alonso , Marcos Kalinowski

Context: Ensuring high levels of dependability in modern computer-based systems has become increasingly challenging due to their complexity. Although systems are validated at design time, their behavior can be different at runtime, possibly…

Software Engineering · Computer Science 2026-03-30 Francesco Vitale , Francesco Flammini , Mauro Caporuscio , Nicola Mazzocca

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

To assist IT service developers and operators in managing their increasingly complex service landscapes, there is a growing effort to leverage artificial intelligence in operations. To speed up troubleshooting, log anomaly detection has…

Machine Learning · Computer Science 2024-05-24 Thorsten Wittkopp , Philipp Wiesner , Odej Kao

The increasing reliance on applications with machine learning (ML) components calls for mature engineering techniques that ensure these are built in a robust and future-proof manner. We aim to empirically determine the state of the art in…

Software Engineering · Computer Science 2020-07-30 Alex Serban , Koen van der Blom , Holger Hoos , Joost Visser

Log data are essential for intrusion detection and forensic investigations. However, manual log analysis is tedious due to high data volumes, heterogeneous event formats, and unstructured messages. Even though many automated methods for log…

Cryptography and Security · Computer Science 2026-03-05 Max Landauer , Wolfgang Hotwagner , Thorina Boenke , Florian Skopik , Markus Wurzenberger

Machine learning (ML) has become a ubiquitous tool across various domains of data mining and big data analysis. The efficacy of ML models depends heavily on high-quality datasets, which are often complicated by the presence of missing…

Machine Learning · Computer Science 2024-10-14 Abu Fuad Ahmad , Md Shohel Sayeed , Khaznah Alshammari , Istiaque Ahmed

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based…

Software Engineering · Computer Science 2022-08-23 Shimin Tao , Weibin Meng , Yimeng Chen , Yichen Zhu , Ying Liu Chunning Du , Tao Han , Yongpeng Zhao , Xiangguang Wang , Hao Yang

Context: Dynamic production environments make it challenging to maintain reliable machine learning (ML) systems. Runtime issues, such as changes in data patterns or operating contexts, that degrade model performance are a common occurrence…

Software Engineering · Computer Science 2025-09-19 Hira Naveed , Scott Barnett , Chetan Arora , John Grundy , Hourieh Khalajzadeh , Omar Haggag

After a machine learning (ML)-based system is deployed, monitoring its performance is important to ensure the safety and effectiveness of the algorithm over time. When an ML algorithm interacts with its environment, the algorithm can affect…

There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers…

Machine Learning · Computer Science 2020-05-05 Anh Truong , Austin Walters , Jeremy Goodsitt , Keegan Hines , C. Bayan Bruss , Reza Farivar

Logs play a crucial role in modern software systems, serving as a means for developers to record essential information for future software maintenance. As the performance of these log-based maintenance tasks heavily relies on the quality of…

Software Engineering · Computer Science 2024-04-01 Xiaoyuan Xie , Zhipeng Cai , Songqiang Chen , Jifeng Xuan