English
Related papers

Related papers: Erasure Coding for Small Objects in In-Memory KV S…

200 papers

Erasure codes play an important role in storage systems to prevent data loss. In this work, we study a class of erasure codes called Multi-Erasure Locally Recoverable Codes (ME-LRCs) for storage arrays. Compared to previous related works,…

Information Theory · Computer Science 2017-09-29 Pengfei Huang , Eitan Yaakobi , Paul H. Siegel

Large language models (LLMs) based on Transformer Decoders have become the preferred choice for conversational generative AI. Despite the overall superiority of the Decoder architecture, the gradually increasing Key-Value (KV) cache during…

Computation and Language · Computer Science 2025-07-16 Luohe Shi , Zuchao Li , Lefei Zhang , Guoming Liu , Baoyuan Qi , Hai Zhao

We consider a queue-channel model that captures the waiting time-dependent degradation of information bits as they wait to be transmitted. Such a scenario arises naturally in quantum communications, where quantum bits tend to decohere…

Information Theory · Computer Science 2023-05-09 Jaswanthi Mandalapu , Krishna Jagannathan , Avhishek Chatterjee , Andrew Thangaraj

Serving transformer language models with high throughput requires caching Key-Values (KVs) to avoid redundant computation during autoregressive generation. The memory footprint of KV caching is significant and heavily impacts serving costs.…

Machine Learning · Computer Science 2026-04-28 Anastasiia Filippova , David Grangier , Marco Cuturi , João Monteiro

We consider the problem of secure distributed data storage under the paradigm of \emph{weak security}, in which no \emph{meaningful information} is leaked to the eavesdropper. More specifically, the eavesdropper cannot get any information…

Information Theory · Computer Science 2014-05-13 Swanand Kadhe , Alex Sprintson

In a distributed storage system, code symbols are dispersed across space in nodes or storage units as opposed to time. In settings such as that of a large data center, an important consideration is the efficient repair of a failed node.…

Information Theory · Computer Science 2018-06-13 S. B. Balaji , M. Nikhil Krishnan , Myna Vajha , Vinayak Ramkumar , Birenjith Sasidharan , P. Vijay Kumar

Mobile edge computing (MEC) is expected to be an effective solution to deliver 360-degree virtual reality (VR) videos over wireless networks. In contrast to previous computation-constrained MEC framework, which reduces the…

Information Theory · Computer Science 2017-08-03 Xiao Yang , Zhiyong Chen , Kuikui Li , Yaping Sun , Hongming Zheng

Streaming video understanding requires models to robustly encode, store, and retrieve information from a continuous video stream to support accurate video question answering (VQA). Existing state-of-the-art approaches rely on key-value…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Vatsal Agarwal , Saksham Suri , Matthew Gwilliam , Pulkit Kumar , Abhinav Shrivastava

Key-Value (KV) cache has become a de facto component of modern Large Vision-Language Models (LVLMs) for inference. While it enhances decoding efficiency in Large Language Models (LLMs), its direct adoption in LVLMs introduces substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xihao Chen , Yangyang Guo , Roger Zimmermann

Virtual reality (VR) over wireless is emerging as an important use case of 5G networks. Immersive VR experience requires the delivery of huge data at ultra-low latency, thus demanding ultra-high transmission rate. This challenge can be…

Information Theory · Computer Science 2018-06-26 Yaping Sun , Zhiyong Chen , Meixia Tao , Hui Liu

KV caches, typically used only to speed up autoregressive decoding, encode contextual information that can be reused for downstream tasks at no extra cost. We propose treating the KV cache as a lightweight representation, eliminating the…

Computation and Language · Computer Science 2026-01-29 Zeyu Xing , Xing Li , Hui-Ling Zhen , Mingxuan Yuan , Sinno Jialin Pan

Large Language Models (LLMs) have been widely adopted to process long-context tasks. However, the large memory overhead of the key-value (KV) cache poses significant challenges in long-context scenarios. Existing training-free KV cache…

Machine Learning · Computer Science 2024-10-22 Luning Wang , Shiyao Li , Xuefei Ning , Zhihang Yuan , Shengen Yan , Guohao Dai , Yu Wang

The emerging brain-inspired computing paradigm known as hyperdimensional computing (HDC) has been proven to provide a lightweight learning framework for various cognitive tasks compared to the widely used deep learning-based approaches.…

Emerging Technologies · Computer Science 2021-06-23 Geethan Karunaratne , Manuel Le Gallo , Michael Hersche , Giovanni Cherubini , Luca Benini , Abu Sebastian , Abbas Rahimi

This paper presents a memory assessment of the next-generation Versatile Video Coding (VVC). The memory analyses are performed adopting as a baseline the state-of-the-art High-Efficiency Video Coding (HEVC). The goal is to offer insights…

Multimedia · Computer Science 2020-06-02 Arthur Cerveira , Luciano Agostini , Bruno Zatt , Felipe Sampaio

In order to scale economically, data centers are increasingly evolving their data storage methods from the use of simple data replication to the use of more powerful erasure codes, which provide the same level of reliability as replication…

Information Theory · Computer Science 2013-11-12 Nihar B. Shah , Kangwook Lee , Kannan Ramchandran

Quantum reservoir computing (QRC) offers a promising framework for online quantum-enhanced machine learning tailored to temporal tasks, yet practical implementations with native memory capabilities remain limited. Here, we demonstrate an…

We consider the problem of designing codes for distributed storage that protect user data against eavesdroppers that can gain access to network links as well as individual nodes. Our goal is to achieve weak security (also known as block…

Information Theory · Computer Science 2017-10-19 Swanand Kadhe , Alex Sprintson

Key-Value (KV) cache plays a crucial role in accelerating inference in large language models (LLMs) by storing intermediate attention states and avoiding redundant computation during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-04-14 Yuzhen Mao , Qitong Wang , Martin Ester , Ke Li

Key-value (KV) caching has become the de-facto to accelerate generation speed for large language models (LLMs) inference. However, the growing cache demand with increasing sequence length has transformed LLM inference to be a memory bound…

Machine Learning · Computer Science 2024-10-02 Hao Kang , Qingru Zhang , Souvik Kundu , Geonhwa Jeong , Zaoxing Liu , Tushar Krishna , Tuo Zhao

Cloud storage systems generally add redundancy in storing content files such that $K$ files are replicated or erasure coded and stored on $N > K$ nodes. In addition to providing reliability against failures, the redundant copies can be used…