English
Related papers

Related papers: Query Log Compression for Workload Analytics

200 papers

Logs are essential for understanding Continuous Integration (CI) behavior, particularly for diagnosing build failures and performance regressions. Yet their growing volume and verbosity make both manual inspection and automated analysis…

Software Engineering · Computer Science 2026-01-29 Marcus Emmanuel Barnes , Taher A. Ghaleb , Safwat Hassan

Recent techniques such as retrieval-augmented generation or chain-of-thought reasoning have led to longer contexts and increased inference costs. Context compression techniques can reduce these costs, but the most effective approaches…

Computation and Language · Computer Science 2025-10-24 Hippolyte Pilchen , Edouard Grave , Patrick Pérez

Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of automated log analysis. However, existing log parsers are…

Software Engineering · Computer Science 2026-03-16 Yifan Wu , Bingxu Chai , Siyu Yu , Ying Li , Pinjia He , Wei Jiang , Jianguo Li

Modern RDBMSs support the ability to compress data using methods such as null suppression and dictionary encoding. Data compression offers the promise of significantly reducing storage requirements and improving I/O performance for decision…

Databases · Computer Science 2011-09-06 Hideaki Kimura , Vivek Narasayya , Manoj Syamala

System logs perform a critical function in software-intensive systems as logs record the state of the system and significant events in the system at important points in time. Unfortunately, log entries are typically created in an ad-hoc,…

Software Engineering · Computer Science 2020-01-30 Nathan Bosch , Jan Bosch

Logs are a critical data source for cloud systems, enabling advanced features like monitoring, alerting, and root cause analysis. However, the massive scale and diverse formats of unstructured logs pose challenges for adaptable, efficient,…

Software Engineering · Computer Science 2025-04-15 Zeyan Li , Jie Song , Tieying Zhang , Tao Yang , Xiongjun Ou , Yingjie Ye , Pengfei Duan , Muchen Lin , Jianjun Chen

Graph compression is a data analysis technique that consists in the replacement of parts of a graph by more general structural patterns in order to reduce its description length. It notably provides interesting exploration tools for the…

Data Structures and Algorithms · Computer Science 2018-07-19 Robin Lamarche-Perrin

One requirement of maintaining digital information is storage. With the latest advances in the digital world, new emerging media types have required even more storage space to be kept than before. In fact, in many cases it is required to…

Data Structures and Algorithms · Computer Science 2025-01-22 Vasileios Alevizos , Nikitas Gerolimos , Sabrina Edralin , Clark Xu , Akebu Simasiku , Georgios Priniotakis , George Papakostas , Zongliang Yue

Large Language Models (LLMs) achieve superior performance through Chain-of-Thought (CoT) reasoning, but these token-level reasoning chains are computationally expensive and inefficient. In this paper, we introduce Compressed Latent…

Computation and Language · Computer Science 2026-02-04 Wenhui Tan , Jiaze Li , Jianzhong Ju , Zhenbo Luo , Ruihua Song , Jian Luan

Parser-based log compressors have been widely explored in recent years because the explosive growth of log volumes makes the compression performance of general-purpose compressors unsatisfactory. These parser-based compressors preprocess…

Software Engineering · Computer Science 2024-08-13 Siyu Yu , Yifan Wu , Ying Li , Pinjia He

Network traffic analysis increasingly relies on feature-based representations to support monitoring and security in the presence of pervasive encryption. Although features are more compact than raw packet traces, their storage has become a…

Networking and Internet Architecture · Computer Science 2026-02-26 Fabio Palmese , Gabriele Merlach , Damiano Ravalico , Martino Trevisan , Alessandro E. C. Redondi

Logs are critical resources that record events, activities, or messages produced by software applications, operating systems, servers, and network devices. However, consolidating the heterogeneous logs and cross-referencing them is…

Software Engineering · Computer Science 2024-12-18 Rabimba Karanjai , Yang Lu , Dana Alsagheer , Keshav Kasichainula , Lei Xu , Weidong Shi , Shou-Hsuan Stephen Huang

Logs provide first-hand information for engineers to diagnose failures in large-scale online service systems. Log parsing, which transforms semi-structured raw log messages into structured data, is a prerequisite of automated log analysis…

Software Engineering · Computer Science 2022-02-15 Yudong Liu , Xu Zhang , Shilin He , Hongyu Zhang , Liqun Li , Yu Kang , Yong Xu , Minghua Ma , Qingwei Lin , Yingnong Dang , Saravan Rajmohan , Dongmei Zhang

Smart databases are adopting artificial intelligence (AI) technologies to achieve {\em instance optimality}, and in the future, databases will come with prepackaged AI models within their core components. The reason is that every database…

Databases · Computer Science 2021-05-27 Debjyoti Paul , Jie Cao , Feifei Li , Vivek Srikumar

The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on direct supervised fine-tuning (SFT) on log-label pairs.…

Log parsing is a critical step that transforms unstructured log data into structured formats, facilitating subsequent log-based analysis. Traditional syntax-based log parsers are efficient and effective, but they often experience decreased…

Software Engineering · Computer Science 2024-11-19 Zeyang Ma , Dong Jae Kim , Tse-Hsun Chen

System-generated logs are typically converted into categorical log templates through parsing. These templates are crucial for generating actionable insights in various downstream tasks. However, existing parsers often fail to capture…

Computation and Language · Computer Science 2025-06-03 Prerak Srivastava , Giulio Corallo , Sergey Rybalko

Logs are ubiquitous digital footprints, playing an indispensable role in system diagnostics, security analysis, and performance optimization. The extraction of actionable insights from logs is critically dependent on the log parsing…

Software Engineering · Computer Science 2024-08-27 Aoxiao Zhong , Dengyao Mo , Guiyang Liu , Jinbu Liu , Qingda Lu , Qi Zhou , Jiesheng Wu , Quanzheng Li , Qingsong Wen

Our increasingly digital and connected world has led to the generation of unprecedented amounts of data. This data must be efficiently managed, transmitted, and stored to preserve resources and allow scalability. Data compression has…

Information Theory · Computer Science 2025-10-09 Jonas G. Matt , Pengcheng Huang , Balz Maag

System logs are a cornerstone of cybersecurity, supporting proactive breach prevention and post-incident investigations. However, analyzing vast amounts of diverse log data remains significantly challenging, as high costs, lack of in-house…

Artificial Intelligence · Computer Science 2025-10-29 Peng Cai , Reza Ryan , Nickson M. Karie