English
Related papers

Related papers: Log Parsing using LLMs with Self-Generated In-Cont…

200 papers

Log parsing transforms raw logs into structured templates containing constants and variables. It underpins anomaly detection, failure diagnosis, and other AIOps tasks. Current parsers are mostly reactive and log-centric. They only infer…

Software Engineering · Computer Science 2025-12-05 Jiaqi Sun , Wei Li , Heng Zhang , Chutong Ding , Shiyou Qian , Jian Cao , Guangtao Xue

Logging is a critical function in modern distributed applications, but the lack of standardization in log query languages and formats creates significant challenges. Developers currently must write ad hoc queries in platform-specific…

Modern distributed systems produce massive, heterogeneous logs essential for reliability, security, and anomaly detection. Converting these free-form messages into structured templates (log parsing) is challenging due to evolving formats…

Software Engineering · Computer Science 2026-04-23 Amir Shetaia , Sean Kauffman

Logging is indispensable for maintaining the reliability and diagnosability of modern software, yet developers still struggle to decide where and how to log effectively. Existing automated logging techniques focus on isolated sub-tasks -…

Software Engineering · Computer Science 2025-07-29 Shengcheng Duan , Yihua Xu , Sheng Zhang , Shen Wang , Yue Duan

Language models for scientific tasks are trained on text from scientific publications, most distributed as PDFs that require parsing. PDF parsing approaches range from inexpensive heuristics (for simple documents) to computationally…

Logs generated by large-scale software systems provide crucial information for engineers to understand the system status and diagnose problems of the systems. Log parsing, which converts raw log messages into structured data, is the first…

Software Engineering · Computer Science 2023-02-16 Van-Hoang Le , Hongyu Zhang

Large language models (LLMs) have achieved remarkable success across various natural language processing (NLP) tasks. However, recent studies suggest that they still face challenges in performing fundamental NLP tasks essential for deep…

Computation and Language · Computer Science 2025-04-22 Ziyan Zhang , Yang Hou , Chen Gong , Zhenghua Li

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

We study the problem of determining whether a piece of text has been authored by a human or by a large language model (LLM). Existing state of the art logits-based detectors make use of statistics derived from the log-probability of the…

Computation and Language · Computer Science 2026-02-03 Hongyi Zhou , Jin Zhu , Pingfan Su , Kai Ye , Ying Yang , Shakeel A O B Gavioli-Akilagun , Chengchun Shi

Large language models (LLMs) have achieved outstanding performance in natural language processing, but enormous model sizes and high computational costs limit their practical deployment. Structured pruning can effectively reduce the…

Computation and Language · Computer Science 2025-03-11 Jun Kong , Xinge Ma , Jin Wang , Xuejie Zhang

Log statements have become an integral part of modern software systems. Prior research efforts have focused on supporting the decisions of placing log statements, such as where/what to log. With the increasing adoption of Large Language…

Software Engineering · Computer Science 2025-11-05 Hao Zhang , Dongjun Yu , Lei Zhang , Guoping Rong , Yongda Yu , Haifeng Shen , He Zhang , Dong Shao , Hongyu Kuang

Any modern system writes events into files, called log files. Those contain crucial information which are subject to various analyses. Examples range from cybersecurity, intrusion detection over usage analyses to trouble shooting. Before…

Machine Learning · Computer Science 2022-02-02 Nadine Ruecker , Andreas Maier

Log analysis represents a critical sub-domain within AI applications that facilitates automatic approaches to fault and error management of large-scaled software systems, saving labors of traditional manual methods. While existing solutions…

Computation and Language · Computer Science 2025-08-27 Yuhe Ji , Yilun Liu , Feiyu Yao , Minggui He , Shimin Tao , Xiaofeng Zhao , Su Chang , Xinhua Yang , Weibin Meng , Yuming Xie , Boxing Chen , Shenglin Zhang , Yongqian Sun

Logs provide first-hand information for engineers to diagnose failures in large-scale online service systems. Log parsing, which transforms semi-structured raw log messages into structured data, is a prerequisite of automated log analysis…

Software Engineering · Computer Science 2022-02-15 Yudong Liu , Xu Zhang , Shilin He , Hongyu Zhang , Liqun Li , Yu Kang , Yong Xu , Minghua Ma , Qingwei Lin , Yingnong Dang , Saravan Rajmohan , Dongmei Zhang

Recently, researchers have proposed many multi-agent frameworks for function-level code generation, which aim to improve software development productivity by automatically generating function-level source code based on task descriptions. A…

Software Engineering · Computer Science 2025-04-08 Yueheng Zhu , Chao Liu , Xuan He , Xiaoxue Ren , Zhongxin Liu , Ruwei Pan , Hongyu Zhang

Automated logging statement generation supports developers in documenting critical software runtime behavior. Given the great success in natural language generation and programming language comprehension, large language models (LLMs) might…

Software Engineering · Computer Science 2024-04-02 Yichen Li , Yintong Huo , Zhihan Jiang , Renyi Zhong , Pinjia He , Yuxin Su , Lionel Briand , Michael R. Lyu

Logs play a critical role in providing essential information for system monitoring and troubleshooting. Recently, with the success of pre-trained language models (PLMs) and large language models (LLMs) in natural language processing (NLP),…

Software Engineering · Computer Science 2025-02-03 Lipeng Ma , Weidong Yang , Sihang Jiang , Ben Fei , Mingjie Zhou , Shuhao Li , Mingyu Zhao , Bo Xu , Yanghua Xiao

Modern information and communication systems have become increasingly challenging to manage. The ubiquitous system logs contain plentiful information and are thus widely exploited as an alternative source for system management. As log files…

Information Retrieval · Computer Science 2024-02-15 Tianzhu Zhang , Han Qiu , Gabriele Castellano , Myriana Rifai , Chung Shue Chen , Fabio Pianese

Recent development of large language models (LLMs), such as ChatGPT has been widely applied to a wide range of software engineering tasks. Many papers have reported their analysis on the potential advantages and limitations of ChatGPT for…

Software Engineering · Computer Science 2023-09-18 Priyanka Mudgal , Rita Wouhaybi

Leadership-class HPC systems generate massive volumes of heterogeneous, largely unstructured system logs. Because these logs originate from diverse software, hardware, and runtime layers, they exhibit inconsistent formats, making structure…

Artificial Intelligence · Computer Science 2026-04-08 Ahmad Maroof Karimi , Jong Youl Choi , Charles Qing Cao , Awais Khan