中文
相关论文

相关论文: Logzip: Extracting Hidden Structures via Iterative…

200 篇论文

It was estimated that the world produced $59 ZB$ ($5.9 \times 10^{13} GB$) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new…

机器学习 · 计算机科学 2021-11-02 Shifeng Zhang , Ning Kang , Tom Ryder , Zhenguo Li

Compressing integer keys is a fundamental operation among multiple communities, such as database management (DB), information retrieval (IR), and high-performance computing (HPC). Recent advances in \emph{learned indexes} have inspired the…

数据库 · 计算机科学 2024-12-17 Qiyu Liu , Siyuan Han , Jianwei Liao , Jin Li , Jingshu Peng , Jun Du , Lei Chen

We consider lossless compression based on statistical data modeling followed by prediction-based encoding, where an accurate statistical model for the input data leads to substantial improvements in compression. We propose DZip, a…

机器学习 · 计算机科学 2020-09-21 Mohit Goyal , Kedar Tatwawadi , Shubham Chandak , Idoia Ochoa

The widespread use of Large Language Models (LLMs) in software engineering has intensified the need for improved model and resource efficiency. In particular, for neural code generation, LLMs are used to translate function/method signature…

软件工程 · 计算机科学 2025-06-12 Guang Yang , Yu Zhou , Wei Cheng , Xiangyu Zhang , Xiang Chen , Terry Yue Zhuo , Ke Liu , Xin Zhou , David Lo , Taolue Chen

Natural language processing (NLP) models often require a massive number of parameters for word embeddings, resulting in a large storage or memory footprint. Deploying neural NLP models to mobile devices requires compressing the word…

计算与语言 · 计算机科学 2017-11-20 Raphael Shu , Hideki Nakayama

Logs play a crucial role in modern software systems, serving as a means for developers to record essential information for future software maintenance. As the performance of these log-based maintenance tasks heavily relies on the quality of…

软件工程 · 计算机科学 2024-04-01 Xiaoyuan Xie , Zhipeng Cai , Songqiang Chen , Jifeng Xuan

Computing the LZ factorization (or LZ77 parsing) of a string is a computational bottleneck in many diverse applications, including data compression, text indexing, and pattern discovery. We describe new linear time LZ factorization…

数据结构与算法 · 计算机科学 2020-12-11 Juha Kärkkäinen , Dominik Kempa , Simon J. Puglisi

Log files record computational events that reflect system state and behavior, making them a primary source of operational insights in modern computer systems. Automated anomaly detection on logs is therefore critical, yet most established…

机器学习 · 计算机科学 2026-02-04 Simon Dietz , Kai Klede , An Nguyen , Bjoern M Eskofier

Our modern world relies on a growing number of interconnected and interacting devices, leading to a plethora of logs establishing audit trails for all kinds of events. Simultaneously, logs become increasingly important for forensic…

密码学与安全 · 计算机科学 2023-08-11 David Koisser , Ahmad-Reza Sadeghi

Multimedia compression allows us to watch videos, see pictures and hear sounds within a limited bandwidth, which helps the flourish of the internet. During the past decades, multimedia compression has achieved great success using hand-craft…

多媒体 · 计算机科学 2023-08-21 Yuhao Cheng , Siru Zhang , Yiqiang Yan , Rong Chen , Yun Zhang

Data deduplication, one of the key features of modern Big Data storage devices, is the process of removing replicas of data chunks stored by different users. Despite the importance of deduplication, several drawbacks of the method, such as…

信息论 · 计算机科学 2024-11-05 Yun-Han Li , Jin Sima , Ilan Shomorony , Olgica Milenkovic

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

软件工程 · 计算机科学 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Data compression and decompression have become vital components of big-data applications to manage the exponential growth in the amount of data collected and stored. Furthermore, big-data applications have increasingly adopted GPUs due to…

In GPU-accelerated data analytics, the overhead of data transfer from CPU to GPU becomes a performance bottleneck when the data scales beyond GPU memory capacity due to the limited PCIe bandwidth. Data compression has come to rescue for…

数据库 · 计算机科学 2026-02-10 Gwangoo Yeo , Zhiyang Shen , Wei Cui , Matteo Interlandi , Rathijit Sen , Bailu Ding , Qi Chen , Minsoo Rhu

Workload consolidation, sharing physical resources among multiple workloads, is a promising technique to save cost and energy in cluster computing systems. This paper highlights a few challenges of workload consolidation for Hadoop as one…

分布式、并行与集群计算 · 计算机科学 2016-11-15 Reza Moraveji , Javid Taheri , MohammadReza HosseinyFarahabady , Nikzad Babaii Rizvandi , Albert Y. Zomaya

Federated Learning marks a turning point in the implementation of decentralized machine learning (especially deep learning) for wireless devices by protecting users' privacy and safeguarding raw data from third-party access. It assigns the…

Current tabling systems suffer from an increase in space complexity, time complexity or both when dealing with sequences due to the use of data structures for tabled subgoals and answers and the need to copy terms into and from the table…

编程语言 · 计算机科学 2012-10-08 Neng-Fa Zhou , Christian Theil Have

We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method…

计算与语言 · 计算机科学 2016-12-19 Armand Joulin , Edouard Grave , Piotr Bojanowski , Matthijs Douze , Hérve Jégou , Tomas Mikolov

At the present scenario of the internet, there exist many optimization techniques to improve the Web speed but almost expensive in terms of bandwidth. So after a long investigation on different techniques to compress the data without any…

信息论 · 计算机科学 2014-05-20 Hemant Kumar Saini , Satpal Singh Kushwaha , C. Rama Krishna

Zigzag persistence is a powerful extension of the standard persistence which allows deletions of simplices besides insertions. However, computing zigzag persistence usually takes considerably more time than the standard persistence. We…

计算几何 · 计算机科学 2022-07-06 Tamal K. Dey , Tao Hou