English
Related papers

Related papers: Consistently faster and smaller compressed bitmaps…

200 papers

Raw data sizes are growing and proliferating in scientific research, driven by the success of data-hungry computational methods, such as machine learning. The preponderance of proprietary and shoehorned data formats make computations slower…

Databases · Computer Science 2022-01-02 David S. Smith

Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Fangrui Liu , Zheng Liu

Embedding tables are used by machine learning systems to work with categorical features. In modern Recommendation Systems, these tables can be very large, necessitating the development of new methods for fitting them in memory, even during…

Machine Learning · Computer Science 2023-10-24 Henry Ling-Hei Tsang , Thomas Dybdahl Ahle

The escalating volume of data involved in Android backup packages necessitates an innovative approach to compression beyond traditional methods like GZIP, which may not fully exploit the redundancy inherent in Android backups, particularly…

Information Retrieval · Computer Science 2024-04-16 Jasurbek Shukurov

Contemporary natural language processing (NLP) revolves around learning from latent document representations, generated either implicitly by neural language models or explicitly by methods such as doc2vec or similar. One of the key…

Computation and Language · Computer Science 2021-10-15 Blaž Škrlj , Matej Petkovič

This paper presents innovative algorithms to efficiently compute erosions and dilations of run-length encoded (RLE) binary images with arbitrary shaped structuring elements. An RLE image is given by a set of runs, where a run is a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-07 Gregor Ehrensperger , Alexander Ostermann , Felix Schwitzer

Unsourced random access (URA) has emerged as a pragmatic framework for next-generation distributed sensor networks. Within URA, concatenated coding structures are often employed to ensure that the central base station can accurately recover…

Information Theory · Computer Science 2021-12-02 Vamsi K. Amalladinne , Jamison R. Ebert , Jean-Francois Chamberland , Krishna R. Narayanan

Previous compact representations of permutations have focused on adding a small index on top of the plain data $<\pi(1), \pi(2),...\pi(n)>$, in order to efficiently support the application of the inverse or the iterated permutation. In this…

Data Structures and Algorithms · Computer Science 2011-08-23 Jérémy Barbay , Gonzalo Navarro

Column-oriented indexes-such as projection or bitmap indexes-are compressed by run-length encoding to reduce storage and increase speed. Sorting the tables improves compression. On realistic data sets, permuting the columns in the right…

Databases · Computer Science 2015-03-13 Daniel Lemire , Owen Kaser

Binary embedding of high-dimensional data requires long codes to preserve the discriminative power of the input space. Traditional binary coding methods often suffer from very high computation and storage costs in such a scenario. To…

Machine Learning · Statistics 2014-05-14 Felix X. Yu , Sanjiv Kumar , Yunchao Gong , Shih-Fu Chang

Dimension reduction is widely regarded as an effective way for decreasing the computation, storage and communication loads of data-driven intelligent systems, leading to a growing demand for statistical methods that allow analysis (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Guangcan Liu , Zhao Zhang , Qingshan Liu , Kongkai Xiong

The biggest cost of computing with large matrices in any modern computer is related to memory latency and bandwidth. The average latency of modern RAM reads is 150 times greater than a clock step of the processor. Throughput is a little…

Data Structures and Algorithms · Computer Science 2013-03-04 Crysttian Arantes Paixão , Flávio Codeço Coelho

We introduce RAGE, an image compression framework that achieves four generally conflicting objectives: 1) good compression for a wide variety of color images, 2) computationally efficient, fast decompression, 3) fast random access of images…

Image and Video Processing · Electrical Eng. & Systems 2024-02-12 Christian D. Rask , Daniel E. Lucani

Nowadays, the digital world is most focused on storage space and speed. With the growing demand for better bandwidth utilization, efficient image data compression techniques have emerged as an important factor for image data transmission…

Information Theory · Computer Science 2012-09-26 Rehna. V. J , Jeyakumar. M. K

To overcome the barrier of storage and computation, the hashing technique has been widely used for nearest neighbor search in multimedia retrieval applications recently. Particularly, cross-modal retrieval that searches across different…

Information Retrieval · Computer Science 2019-05-16 Sarawut Markchit , Chih-Yi Chiu

There is an immediate need for creative ways to improve resource ef iciency given the dynamic nature of robust sensor networks and their increasing reliance on data-driven approaches.One key challenge faced is ef iciently managing large…

Networking and Internet Architecture · Computer Science 2024-02-27 Ephrance Eunice Namugenyi , David Tugume , Augustine Kigwana , Benjamin Rukundo

Coded compressed sensing is an algorithmic framework tailored to sparse recovery in very large dimensional spaces. This framework is originally envisioned for the unsourced multiple access channel, a wireless paradigm attuned to…

Information Theory · Computer Science 2019-10-23 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

Fine-tuning large language models (LLMs) with low-rank adaptations (LoRAs) has become common practice, often yielding numerous copies of the same LLM differing only in their LoRA updates. This paradigm presents challenges for systems that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-02 Rickard Brüel-Gabrielsson , Jiacheng Zhu , Onkar Bhardwaj , Leshem Choshen , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

Although large language models (LLM) have achieved remarkable performance, their enormous parameter counts hinder deployment on resource-constrained hardware. Low-rank compression can reduce both memory usage and computational demand, but…

Computation and Language · Computer Science 2025-10-13 Yu-Chen Lu , Chong-Yan Chen , Chi-Chih Chang , Yu-Fang Hu , Kai-Chiang Wu

We introduce a recursive algorithm for performing compressed sensing on streaming data. The approach consists of a) recursive encoding, where we sample the input stream via overlapping windowing and make use of the previous measurement in…

Machine Learning · Statistics 2013-12-18 Nikolaos M. Freris , Orhan Öçal , Martin Vetterli