English
Related papers

Related papers: Lightweight Correlation-Aware Table Compression

200 papers

With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidth at the price of additional CPU utilization. However, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-24 Jayjeet Chakraborty , Ivo Jimenez , Sebastiaan Alvarez Rodriguez , Alexandru Uta , Jeff LeFevre , Carlos Maltzahn

For almost a century, since Bernal\'s attempts at a molecular theory of liquid structure(Bernal [1]), correlation functions have been the bridge to compare theoretical calculations with experimental measurements in the study of disordered…

Linear combination is a potent data fusion method in information retrieval tasks, thanks to its ability to adjust weights for diverse scenarios. However, achieving optimal weight training has traditionally required manual relevance…

Information Retrieval · Computer Science 2023-09-25 Qiuyu Xu , Yidong Huang , Shengli Wu , Adrian Moore

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

Information Theory · Computer Science 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

Compressed bitmap indexes are used in databases and search engines. Many bitmap compression techniques have been proposed, almost all relying primarily on run-length encoding (RLE). However, on unsorted data, we can get superior performance…

Databases · Computer Science 2018-03-05 Daniel Lemire , Gregory Ssi-Yan-Kai , Owen Kaser

Efficient similarity retrieval from large-scale multimodal database is pervasive in modern search engines and social networks. To support queries across content modalities, the system should enable cross-modal correlation and…

Information Retrieval · Computer Science 2016-05-24 Mingsheng Long , Yue Cao , Jianmin Wang , Philip S. Yu

Tensor decomposition (TD) is essential for analyzing high-dimensional sparse data, yet its irregular computations and memory-access patterns pose major performance challenges on modern parallel processors. Prior works rely on…

Machine Learning · Computer Science 2025-09-03 Ahmed E. Helal , Fabio Checconi , Jan Laukemann , Yongseok Soh , Jesmin Jahan Tithi , Fabrizio Petrini , Jee Choi

Relational datasets are being generated at an alarmingly rapid rate across organizations and industries. Compressing these datasets could significantly reduce storage and archival costs. Traditional compression algorithms, e.g., gzip, are…

Databases · Computer Science 2016-06-21 Yihan Gao , Aditya Parameswaran

The quadratic complexity of Multimodal Large Language Models (MLLMs) with respect to context length poses significant computational and memory challenges, hindering their real-world deployment. In the paper, we devise a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuhang Han , Xuyang Liu , Zihan Zhang , Pengxiang Ding , Junjie Chen , Donglin Wang , Honggang Chen , Qingsen Yan , Siteng Huang

Switching, routing, and security functions are the backbone of packet processing networks. Fast and efficient processing of packets requires maintaining the state of a large number of transient network connections. In particular, modern…

Networking and Internet Architecture · Computer Science 2023-05-05 Luke McHale , Paul V Gratz , Alex Sprintson

We introduce a new and improved characterization of the label complexity of disagreement-based active learning, in which the leading quantity is the version space compression set size. This quantity is defined as the size of the smallest…

Machine Learning · Computer Science 2014-04-08 Yair Wiener , Steve Hanneke , Ran El-Yaniv

Computing over compressed data combines the space saving of data compression with efficient support for queries directly on the compressed representation. Such data structures are widely applied in text indexing and have been successfully…

Data Structures and Algorithms · Computer Science 2025-06-27 Ziad Ismaili Alaoui , Namrata , Sebastian Wild

Text retrieval using learned sparse representations of queries and documents has, over the years, evolved into a highly effective approach to search. It is thanks to recent advances in approximate nearest neighbor search-with the emergence…

Information Retrieval · Computer Science 2026-02-06 Sebastian Bruch , Martino Fontana , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Modern RDBMSs support the ability to compress data using methods such as null suppression and dictionary encoding. Data compression offers the promise of significantly reducing storage requirements and improving I/O performance for decision…

Databases · Computer Science 2011-09-06 Hideaki Kimura , Vivek Narasayya , Manoj Syamala

Dataset distillation and dataset pruning are two prominent techniques for compressing datasets to improve computational and storage efficiency. Despite their overlapping objectives, these approaches are rarely compared directly. Even within…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Lingao Xiao , Songhua Liu , Yang He , Xinchao Wang

The graphical representation of the correlation matrix by means of different multivariate statistical methods is reviewed, a comparison of the different procedures is presented with the use of an example data set, and an improved…

Computation · Statistics 2024-01-24 Jan Graffelman , Jan de Leeuw

Key-Value cache (\texttt{KV} \texttt{cache}) compression has emerged as a promising technique to optimize Large Language Model (LLM) serving. It primarily decreases the memory consumption of \texttt{KV} \texttt{cache} to reduce the…

Machine Learning · Computer Science 2025-04-01 Wei Gao , Xinyu Zhou , Peng Sun , Tianwei Zhang , Yonggang Wen

Traditional video compression technologies have been developed over decades in pursuit of higher coding efficiency. Efficient temporal information representation plays a key role in video coding. Thus, in this paper, we propose to exploit…

Image and Video Processing · Electrical Eng. & Systems 2019-12-16 Haojie Liu , Han shen , Lichao Huang , Ming Lu , Tong Chen , Zhan Ma

Recent optical flow estimation methods often employ local cost sampling from a dense all-pairs correlation volume. This results in quadratic computational and memory complexity in the number of pixels. Although an alternative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Karlis Martins Briedis , Markus Gross , Christopher Schroers

Recent technological advancements have led to the generation of huge amounts of data over the web, such as text, image, audio and video. Most of this data is high dimensional and sparse, for e.g., the bag-of-words representation used for…

Information Theory · Computer Science 2017-08-17 Rameshwar Pratap , Ishan Sohony , Raghav Kulkarni