English
Related papers

Related papers: Query Log Compression for Workload Analytics

200 papers

Today's graphs used in domains such as machine learning or social network analysis may contain hundreds of billions of edges. Yet, they are not necessarily stored efficiently, and standard graph representations such as adjacency lists waste…

Data Structures and Algorithms · Computer Science 2020-11-02 Maciej Besta , Dimitri Stanojevic , Tijana Zivic , Jagpreet Singh , Maurice Hoerold , Torsten Hoefler

Logs are imperative in the development and maintenance process of many software systems. They record detailed runtime information that allows developers and support engineers to monitor their systems and dissect anomalous behaviors and…

Software Engineering · Computer Science 2019-01-07 Jieming Zhu , Shilin He , Jinyang Liu , Pinjia He , Qi Xie , Zibin Zheng , Michael R. Lyu

Context: Logs are often the primary source of information for system developers and operations engineers to understand and diagnose the behavior of a software system in production. In many cases, logs are the only evidence available for…

Software Engineering · Computer Science 2021-12-23 Eduardo Mendes , Fabio Petrillo

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

Compressing integer keys is a fundamental operation among multiple communities, such as database management (DB), information retrieval (IR), and high-performance computing (HPC). Recent advances in \emph{learned indexes} have inspired the…

Databases · Computer Science 2024-12-17 Qiyu Liu , Siyuan Han , Jianwei Liao , Jin Li , Jingshu Peng , Jun Du , Lei Chen

Nowadays, with the rapid development of the Internet, the era of big data has come. The Internet generates huge amounts of data every day. However, extracting meaningful information from massive data is like looking for a needle in a…

Artificial Intelligence · Computer Science 2022-12-21 Xinhong Chen , Wensheng Gan , Shicheng Wan , Tianlong Gu

Large Language Models (LLMs) have been increasingly employed for query expansion. However, their generative nature often undermines performance on complex multi-hop retrieval tasks by introducing irrelevant or noisy information. To address…

Information Retrieval · Computer Science 2026-03-24 JungMin Yun , YoungBin Kim

Efficient long-context processing remains a crucial challenge for contemporary large language models (LLMs), especially in resource-constrained environments. Soft compression architectures promise to extend effective context length by…

Computation and Language · Computer Science 2026-02-16 Julia Belikova , Danila Rozhevskii , Dennis Svirin , Konstantin Polev , Alexander Panchenko

Long Context Language Models (LCLMs) have emerged as a new paradigm to perform Information Retrieval (IR), which enables the direct ingestion and retrieval of information by processing an entire corpus in their single context, showcasing…

Information Retrieval · Computer Science 2025-05-29 Minju Seo , Jinheon Baek , Seongyun Lee , Sung Ju Hwang

It is a challenging and practical research problem to obtain effective compression of lengthy product titles for E-commerce. This is particularly important as more and more users browse mobile E-commerce apps and more merchants make the…

Computation and Language · Computer Science 2018-01-08 Jingang Wang , Junfeng Tian , Long Qiu , Sheng Li , Jun Lang , Luo Si , Man Lan

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

Lossy compression algorithms take advantage of the inherent limitations of the human eye and discard information that cannot be seen. In the present paper, a technique termed as Lossy Data Compression using Logarithm (LDCL) is proposed to…

Information Theory · Computer Science 2016-04-08 Vivek Kumar , Srijita Barthwal , Rishabh Kishore , Ruchika Saklani , Anuj Sharma , Sandeep Sharma

Logs are an essential source of information for people to understand the running status of a software system. Due to the evolving modern software architecture and maintenance methods, more research efforts have been devoted to automated log…

Software Engineering · Computer Science 2024-04-09 Xingfang Wu , Heng Li , Foutse Khomh

Machine learning has had a major impact on data compression over the last decade and inspired many new, exciting theoretical and applied questions. This paper describes one such direction -- relative entropy coding -- which focuses on…

Information Theory · Computer Science 2026-02-10 Gergely Flamich , Deniz Gündüz

Log parsing serves as an essential prerequisite for various log analysis tasks. Recent advancements in this field have improved parsing accuracy by leveraging the semantics in logs through fine-tuning large language models (LLMs) or…

Software Engineering · Computer Science 2024-08-09 Junjie Huang , Zhihan Jiang , Zhuangbin Chen , Michael R. Lyu

Validation of compliance rules against process data is a fundamental functionality for business process management. Over the years, the problem has been addressed for different types of process data, i.e., process models, process event data…

Databases · Computer Science 2022-06-22 Nesma M. Zaki , Iman M. A. Helal , Ahmed Awad , Ehab E. Hassanein

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based…

Software Engineering · Computer Science 2022-08-23 Shimin Tao , Weibin Meng , Yimeng Chen , Yichen Zhu , Ying Liu Chunning Du , Tao Han , Yongpeng Zhao , Xiangguang Wang , Hao Yang

System logs constitute valuable information for analysis and diagnosis of system behavior. The size of parallel computing systems and the number of their components steadily increase. The volume of generated logs by the system is in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-23 Siavash Ghiasvand , Florina M. Ciorba

In-context learning has established itself as an important learning paradigm for Large Language Models (LLMs). In this paper, we demonstrate that LLMs can learn encoding keys in-context and perform analysis directly on encoded…

Computation and Language · Computer Science 2026-04-16 Andresa Rodrigues de Campos , David Lee , Imry Kissos , Piyush Paritosh