English
Related papers

Related papers: LogFold: Compressing Logs with Structured Tokens a…

200 papers

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

Insider threat detection presents a significant challenge due to the deceptive nature of malicious behaviors, which often resemble legitimate user operations. However, existing approaches typically model system logs as flat event sequences,…

Cryptography and Security · Computer Science 2025-08-11 Kaichuan Kong , Dongjie Liu , Xiaobo Jin , Zhiying Li , Guanggang Geng

We propose a special-purpose class of compression algorithms for efficient compression of Prolog programs. It is a dictionary-based compression method, specially designed for the compression of Prolog code, and therefore we name it PCA…

Programming Languages · Computer Science 2007-05-23 Alin Suciu , Kalman Pusztai

Data compression is a popular technique for improving the efficiency of data processing workloads such as SQL queries and more recently, machine learning (ML) with classical batch gradient methods. But the efficacy of such ideas for…

Machine Learning · Computer Science 2019-01-23 Fengan Li , Lingjiao Chen , Yijing Zeng , Arun Kumar , Jeffrey F. Naughton , Jignesh M. Patel , Xi Wu

Understanding the relationship between data compression and the capabilities of Large Language Models (LLMs) is crucial, especially in specialized domains like code intelligence. Prior work posited a linear relationship between compression…

Computation and Language · Computer Science 2026-03-27 Shijie Xuyang , Xianzhen Luo , Zheng Chu , Houyi Li , Siming Huang , Qiufeng Wang , Wanxiang Che , Qingfu Zhu , Shuigeng Zhou

Many software analysis methods have come to rely on machine learning approaches. Code segmentation - the process of decomposing source code into meaningful blocks - can augment these methods by featurizing code, reducing noise, and limiting…

Software Engineering · Computer Science 2019-07-23 Jacob Dormuth , Ben Gelman , Jessica Moore , David Slater

Log anomaly detection, which is critical for identifying system failures and preempting security breaches, detects irregular patterns within large volumes of log data, and impacts domains such as service reliability, performance…

Software Engineering · Computer Science 2025-11-19 Shenglin Zhang , Ziang Chen , Zijing Que , Yilun Liu , Yongqian Sun , Sicheng Wei , Dan Pei , Hailin Li

Low Rank Decomposition of matrix - splitting a large matrix into a product of two smaller matrix offers a means for compression that reduces the parameters of a model without sparsification, and hence delivering more speedup on modern…

Computation and Language · Computer Science 2023-09-26 Ayush Kaushal , Tejas Vaidhya , Irina Rish

The analysis of logs is a vital activity undertaken for fault or cyber incident detection, investigation and technical forensics analysis for system and cyber resilience. The potential application of AI algorithms for Log analysis could…

Machine Learning · Computer Science 2023-04-21 Jonathan Pan

Logging code is written by developers to capture system runtime behavior and plays a vital role in debugging, performance analysis, and system monitoring. However, defects in logging code can undermine the usefulness of logs and lead to…

Software Engineering · Computer Science 2025-08-18 Xin Wang , Zhenhao Li , Zishuo Ding

Logs are widely used in the development and maintenance of software systems. Logs can help engineers understand the runtime behavior of systems and diagnose system failures. For anomaly diagnosis, existing methods generally use log event…

Software Engineering · Computer Science 2024-02-20 Haitian Yang , Degang Sun , Wen Liu , Yanshu Li , Yan Wang , Weiqing Huang

Context-aware compression techniques have gained increasing attention as model sizes continue to grow, introducing computational bottlenecks that hinder efficient deployment. A structured encoding approach was proposed to selectively…

Computation and Language · Computer Science 2025-02-13 Barnaby Schmitt , Alistair Grosvenor , Matthias Cunningham , Clementine Walsh , Julius Pembrokeshire , Jonathan Teel

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

Fine-tuning large language models (LLMs) with low-rank adaptations (LoRAs) has become common practice, often yielding numerous copies of the same LLM differing only in their LoRA updates. This paradigm presents challenges for systems that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-02 Rickard Brüel-Gabrielsson , Jiacheng Zhu , Onkar Bhardwaj , Leshem Choshen , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

Log anomaly detection is a key component in the field of artificial intelligence for IT operations (AIOps). Considering log data of variant domains, retraining the whole network for unknown domains is inefficient in real industrial…

Machine Learning · Computer Science 2024-01-11 Hongcheng Guo , Jian Yang , Jiaheng Liu , Jiaqi Bai , Boyang Wang , Zhoujun Li , Tieqiao Zheng , Bo Zhang , Junran peng , Qi Tian

Transformer-based document cross-encoder rerankers are a central component of modern information retrieval systems. Despite their success, these models suffer from high computational costs due to processing long query-document sequences at…

Information Retrieval · Computer Science 2026-05-22 Shengyao Zhuang , Zhichao Xu , Ivano Lauriola

We introduce a new family of compressed data structures to efficiently store and query large string dictionaries in main memory. Our main technique is a combination of hierarchical Front-coding with ideas from longest-common-prefix…

Data Structures and Algorithms · Computer Science 2019-11-20 Nieves R. Brisaboa , Ana Cerdeira-Pena , Guillermo de Bernardo , Gonzalo Navarro

Multimodal large language models (MLLMs) have made remarkable strides, largely driven by their ability to process increasingly long and complex contexts, such as high-resolution images, extended video sequences, and lengthy audio input.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Kele Shao , Keda Tao , Kejia Zhang , Sicheng Feng , Mu Cai , Yuzhang Shang , Haoxuan You , Can Qin , Yang Sui , Huan Wang

Log parsing, which involves log template extraction from semi-structured logs to produce structured logs, is the first and the most critical step in automated log analysis. However, current log parsers suffer from limited effectiveness for…

Software Engineering · Computer Science 2024-03-01 Junjielong Xu , Ruichun Yang , Yintong Huo , Chengyu Zhang , Pinjia He

Lossless compression is essential for efficient data storage and transmission. Although learning-based lossless compressors achieve strong results, most of them are designed for a single modality, leading to redundant compressor deployments…

Machine Learning · Computer Science 2026-03-03 Yan Zhao , Zhengxue Cheng , Junxuan Zhang , Dajiang Zhou , Qunshan Gu , Qi Wang , Li Song