English
Related papers

Related papers: Key Compression Limits for $k$-Minimum Value Sketc…

200 papers

The rapid growth of large language models (LLMs) has outpaced the memory constraints of edge devices, necessitating extreme weight compression beyond the 1-bit limit. While quantization reduces model size, it is fundamentally limited to 1…

Machine Learning · Computer Science 2025-06-24 Sunan Zou , Ziyun Zhang , Xueting Sun , Guojie Luo

Researchers have presented systems for efficiently analysing video data at scale using sampling algorithms. While these systems effectively leverage the temporal redundancy present in videos, they suffer from three limitations. First, they…

Databases · Computer Science 2021-04-06 Jaeho Bang , Pramod Chunduri , Joy Arulraj

Most sequence sketching methods work by selecting specific $k$-mers from sequences so that the similarity between two sequences can be estimated using only the sketches. Estimating sequence similarity is much faster using sketches than…

Data Structures and Algorithms · Computer Science 2023-11-08 Guillaume Marçais , Dan DeBlasio , Carl Kingsford

In the problem of minimal perfect hashing, we are given a size $k$ subset $\mathcal{A}$ of a universe of keys $[n] = \{1,2, \cdots, n\}$, for which we wish to construct a hash function $h: [n] \to [k]$ such that $h(\cdot)$ maps…

Information Theory · Computer Science 2026-04-14 Ryan Song , Emre Telatar

Coded Caching is a promising solution to reduce the peak traffic in broadcast networks by prefetching the popular content close to end users and using coded transmissions. One of the chief issues of most coded caching schemes in literature…

Information Theory · Computer Science 2019-02-26 Hari Hara Suthan Chittoor , Bhavana M , Prasad Krishnan

Efficient key-value (KV) cache management is crucial for the practical deployment of large language models (LLMs), yet existing compression techniques often incur a trade-off between performance degradation and computational overhead. We…

Machine Learning · Computer Science 2026-02-10 Jang-Hyun Kim , Dongyoon Han , Sangdoo Yun

We give a simple, low resource method to produce order embeddings from ontologies. Such embeddings map words to vectors so that order relations on the words, such as hypernymy/hyponymy, are represented in a direct way. Our method uses…

Computation and Language · Computer Science 2021-01-07 Kenneth L. Clarkson , Sanjana Sahayaraj

To approximate sums of values in key-value data streams, sketches are widely used in databases and networking systems. They offer high-confidence approximations for any given key while ensuring low time and space overhead. While existing…

Data Structures and Algorithms · Computer Science 2024-06-04 Yuhan Wu , Hanbo Wu , Xilai Liu , Yikai Zhao , Tong Yang , Kaicheng Yang , Sha Wang , Lihua Miao , Gaogang Xie

This paper proposes a discrete knowledge graph (KG) embedding (DKGE) method, which projects KG entities and relations into the Hamming space based on a computationally tractable discrete optimization algorithm, to solve the formidable…

Information Retrieval · Computer Science 2021-01-14 Yunqi Li , Shuyuan Xu , Bo Liu , Zuohui Fu , Shuchang Liu , Xu Chen , Yongfeng Zhang

We present MemEC, an erasure-coding-based in-memory key-value (KV) store that achieves high availability and fast recovery while keeping low data redundancy across storage servers. MemEC is specifically designed for workloads dominated by…

Databases · Computer Science 2017-05-23 Matt M. T. Yiu , Helen H. W. Chan , Patrick P. C. Lee

KV-cache compression at small budgets is a crowded design space spanning cache representation, head-wise routing, compression cadence, decoding behavior, and within-budget scoring. We study seven mechanisms across these five families under…

Machine Learning · Computer Science 2026-05-19 Libo Sun , Po-wei Harn , Peixiong He , Xiao Qin

We consider the problem of sketching set valuation functions, defined as the expectation of a valuation function applied to independent random item values. For valuation functions that are monotone and either subadditive or submodular, and…

Statistics Theory · Mathematics 2026-03-11 Milan Vojnović , Yiliu Wang

We give a sketching-based iterative algorithm that computes a $1+\varepsilon$ approximate solution for the ridge regression problem $\min_x \|Ax-b\|_2^2 +\lambda\|x\|_2^2$ where $A \in R^{n \times d}$ with $d \ge n$. Our algorithm, for a…

Data Structures and Algorithms · Computer Science 2022-06-20 Praneeth Kacham , David P. Woodruff

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

In this paper we propose an index key compression scheme based on the notion of distinction bits by proving that the distinction bits of index keys are sufficient information to determine the sorted order of the index keys correctly. While…

Databases · Computer Science 2020-09-25 Yongsik Kwon , Cheol Ryu , Sang Kyun Cha , Arthur H. Lee , Kunsoo Park , Bongki Moon

As compared to a large spectrum of performance optimizations, relatively little effort has been dedicated to optimize other aspects of embedded applications such as memory space requirements, power, real-time predictability, and…

Other Computer Science · Computer Science 2011-11-09 O. Ozturk , H. Saputra , M. Kandemir , I. Kolcu

We introduce the concept of compressed convolution, a technique to convolve a given data set with a large number of non-orthogonal kernels. In typical applications our technique drastically reduces the effective number of computations. The…

Instrumentation and Methods for Astrophysics · Physics 2014-01-08 F. Elsner , B. D. Wandelt

We initiate the study of sub-linear sketching and streaming techniques for estimating the output size of common dictionary compressors such as Lempel-Ziv '77, the run-length Burrows-Wheeler transform, and grammar compression. To this end,…

Data Structures and Algorithms · Computer Science 2024-08-20 Ruben Becker , Matteo Canton , Davide Cenzato , Sung-Hwan Kim , Bojana Kodric , Nicola Prezza

Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching previously generated visual tokens. Recent research has shown that retaining only a few…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Yunming Ye

Autoregressive language models rely on a Key-Value (KV) Cache, which avoids re-computing past hidden states during generation, making it faster. As model sizes and context lengths grow, the KV Cache becomes a significant memory bottleneck,…

Computation and Language · Computer Science 2025-03-05 Nathan Godey , Alessio Devoto , Yu Zhao , Simone Scardapane , Pasquale Minervini , Éric de la Clergerie , Benoît Sagot