English
Related papers

Related papers: Erasure Coding for Small Objects in In-Memory KV S…

200 papers

Semantic maps are increasingly utilized in areas such as robotics, autonomous systems, and extended reality, motivating the investigation of efficient compression methods that preserve structured semantic information. This paper studies…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Runyu Yang , Junqi Liao , Hyomin Choi , Fabien Racapé , Ivan V. Bajić

Continual Learning (CL) is an emerging machine learning paradigm that aims to learn from a continuous stream of tasks without forgetting knowledge learned from the previous tasks. To avoid performance decrease caused by forgetting, prior…

Machine Learning · Computer Science 2023-01-02 Soobee Lee , Minindu Weerakoon , Jonghyun Choi , Minjia Zhang , Di Wang , Myeongjae Jeon

KV-cache quantizers usually optimize storage-space reconstruction, even though attention reads keys through logits and values through attention-weighted readout. We argue that persistent cache error should be measured in model-visible…

Machine Learning · Computer Science 2026-05-21 Jorge L. Ruiz Williams

Erasure codes are being increasingly used in distributed-storage systems in place of data-replication, since they provide the same level of reliability with much lower storage overhead. We consider the problem of constructing explicit…

Information Theory · Computer Science 2015-09-08 Preetum Nakkiran , K. V. Rashmi , Kannan Ramchandran

The key-value (KV) cache in the tensor version of transformers presents a significant bottleneck during inference. While previous work analyzes the fundamental space complexity barriers in standard attention mechanisms [Haris and Onak,…

Machine Learning · Computer Science 2025-03-28 Yifang Chen , Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Yu Tian

In recent network architectures, multi-MEC cooperative caching has been introduced to reduce the transmission latency of VR videos, in which MEC servers' computing and caching capability are utilized to optimize the transmission process.…

Networking and Internet Architecture · Computer Science 2023-03-09 Jingwen Xia , Luyao Chen , Yong Tang , Ting Yang , Wenyong Wang

Erasure codes are an efficient means of storing data across a network in comparison to data replication, as they tend to reduce the amount of data stored in the network and offer increased resilience in the presence of node failures. The…

Information Theory · Computer Science 2016-11-17 K. V. Rashmi , Nihar B. Shah , P. Vijay Kumar

Coded computing has emerged as a promising framework for tackling significant challenges in large-scale distributed computing, including the presence of slow, faulty, or compromised servers. In this approach, each worker node processes a…

Machine Learning · Computer Science 2026-03-26 Parsa Moradi , Behrooz Tahmasebi , Mohammad Ali Maddah-Ali

Large Language Models (LLMs) require substantial computational resources during generation. While the Key-Value (KV) cache significantly accelerates this process by storing attention intermediates, its memory footprint grows linearly with…

Computation and Language · Computer Science 2025-08-05 Yi Su , Quantong Qiu , Yuechi Zhou , Juntao Li , Qingrong Xia , Ping Li , Xinyu Duan , Zhefeng Wang , Min Zhang

Erasure codes provide a storage efficient alternative to replication based redundancy in (networked) storage systems. They however entail high communication overhead for maintenance, when some of the encoded fragments are lost and need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-11-24 Frederique Oggier , Anwitaman Datta

Large Language models (LLMs) have become a research hotspot. To accelerate the inference of LLMs, storing computed caches in memory has become the standard technique. However, as the inference length increases, growing KV caches might lead…

Computation and Language · Computer Science 2024-12-13 Meizhi Zhong , Xikai Liu , Chen Zhang , Yikun Lei , Yan Gao , Yao Hu , Kehai Chen , Min Zhang

Efficient key-value (KV) cache management is crucial for the practical deployment of large language models (LLMs), yet existing compression techniques often incur a trade-off between performance degradation and computational overhead. We…

Machine Learning · Computer Science 2026-02-10 Jang-Hyun Kim , Dongyoon Han , Sangdoo Yun

Recent Multimodal Large Language Models (MLLMs) have demonstrated strong performance on vision-language understanding tasks, yet their inference efficiency is often hampered by the large number of visual tokens, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiafei Song , Fengwei Zhou , Jin Qu , Wenjin Jason Li , Tong Wu , Gengjian Xue , Zhikang Zhao , Daomin Wei , Yichao Lu , Bailin Na

The key-value (KV) cache in transformer models is a critical component for efficient decoding or inference, yet its memory demands scale poorly with sequence length, posing a major challenge for scalable deployment of large language models.…

Computation and Language · Computer Science 2025-06-06 Vinay Joshi , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Quantum error-correcting codes (QECCs) can eliminate the negative effects of quantum noise, the major obstacle to the execution of quantum algorithms. However, realizing practical quantum error correction (QEC) requires resolving many…

In this paper, we propose Zero Aware Configurable Data Encoding by Skipping Transfer (ZAC-DEST), a data encoding scheme to reduce the energy consumption of DRAM channels, specifically targeted towards approximate computing and error…

Hardware Architecture · Computer Science 2021-05-18 Chandan Kumar Jha , Shreyas Singh , Riddhi Thakker , Manu Awasthi , Joycee Mekie

This paper presents a novel achievable scheme for coded caching systems with $N$ files and $K$ users, specifically when $N \leq K$. This new scheme employs linear coding both during the placement phase - where cache contents are linear…

Information Theory · Computer Science 2024-06-11 Yinbin Ma , Daniela Tuninetti

Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used for machines is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Alon Harell , Yalda Foroutan , Ivan V. Bajic

Large language model (LLM) serving has transformed from stateless to stateful systems, utilizing techniques like context caching and disaggregated inference. These optimizations extend the lifespan and domain of the KV cache, necessitating…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-24 Cunchen Hu , Heyang Huang , Junhao Hu , Jiang Xu , Xusheng Chen , Tao Xie , Chenxi Wang , Sa Wang , Yungang Bao , Ninghui Sun , Yizhou Shan

Recent literature including our past work provide analysis and solutions for using (i) erasure coding, (ii) parallelism, or (iii) variable slicing/chunking (i.e., dividing an object of a specific size into a variable number of smaller…

Networking and Internet Architecture · Computer Science 2014-03-21 Guanfeng Liang , Ulas C. Kozat