English
Related papers

Related papers: Decouple and Cache: KV Cache Construction for Stre…

200 papers

Video instance segmentation (VIS) is a critical task with diverse applications, including autonomous driving and video editing. Existing methods often underperform on complex and long videos in real world, primarily due to two factors.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tao Zhang , Xingye Tian , Yu Wu , Shunping Ji , Xuebo Wang , Yuan Zhang , Pengfei Wan

This paper proposes a learned cost estimation model for Distributed Stream Processing Systems (DSPS) with an aim to provide accurate cost predictions of executing queries. A major premise of this work is that the proposed learned model can…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-11 Roman Heinrich , Manisha Luthra , Harald Kornmayer , Carsten Binnig

The concept of SCN offers a fast framework with universal approximation guarantee for lifelong learning of non-stationary data streams. Its adaptive scope selection property enables for proper random generation of hidden unit parameters…

Machine Learning · Computer Science 2019-12-10 Mahardhika Pratama , Dianhui Wang

Short video streaming has become a dominant paradigm in digital media, characterized by rapid swiping interactions and diverse media content. A key technical challenge is designing an effective preloading strategy that dynamically selects…

Multimedia · Computer Science 2025-10-22 Tong Liu , Zhiwei Fan , Guanyan Peng , Haodan Zhang , Yucheng Zhang , Zhen Wang , Pengjin Xie , Liang Liu

Large language models (LLMs) excel at processing long sequences, boosting demand for key-value (KV) caching. While recent efforts to evict KV cache have alleviated the inference burden, they often fail to allocate resources rationally…

Computation and Language · Computer Science 2025-12-25 Ziran Qin , Yuchen Cao , Mingbao Lin , Wen Hu , Shixuan Fan , Ke Cheng , Weiyao Lin , Jianguo Li

KV caches, typically used only to speed up autoregressive decoding, encode contextual information that can be reused for downstream tasks at no extra cost. We propose treating the KV cache as a lightweight representation, eliminating the…

Computation and Language · Computer Science 2026-01-29 Zeyu Xing , Xing Li , Hui-Ling Zhen , Mingxuan Yuan , Sinno Jialin Pan

Mobile network operators are considering caching as one of the strategies to keep up with the increasing demand for high-definition wireless video streaming. By prefetching popular content into memory at wireless access points or end user…

Information Theory · Computer Science 2015-11-13 P. Hassanzadeh , E. Erkip , J. Llorca , A. Tulino

In this paper, we present \textbf{\textit{FasterCache}}, a novel training-free strategy designed to accelerate the inference of video diffusion models with high-quality generation. By analyzing existing cache-based methods, we observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zhengyao Lv , Chenyang Si , Junhao Song , Zhenyu Yang , Yu Qiao , Ziwei Liu , Kwan-Yee K. Wong

In this paper, we present a novel content caching and delivery approach for mobile virtual reality (VR) video streaming. The proposed approach aims to maximize VR video streaming performance, i.e., minimizing video frame missing rate, by…

Signal Processing · Electrical Eng. & Systems 2023-11-20 Mushu Li , Jie Gao , Conghao Zhou , Xuemin Shen , Weihua Zhuang

Video streaming analytics is a crucial workload for vision-language model serving, but the high cost of multimodal inference limits scalability. Prior systems reduce inference cost by exploiting temporal and spatial redundancy in video…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Yulin Zou , Yan Chen , Wenyan Chen , JooYoung Park , Shivaraman Nitin , Luo Tao , Francisco Romero , Dmitrii Ustiugov

Diffusion-based video editing has emerged as an important paradigm for high-quality and flexible content generation. However, despite their generality and strong modeling capacity, Diffusion Transformers (DiT) remain computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Tianyi Liu , Ye Lu , Linfeng Zhang , Chen Cai , Jianjun Gao , Yi Wang , Kim-Hui Yap , Lap-Pui Chau

Disaggregated inference has become an essential framework that separates the prefill (P) and decode (D) stages in large language model inference to improve throughput. However, the KV cache transfer faces significant delays between prefill…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Weiqing Li , Guochao Jiang , Xiangyong Ding , Zhangcheng Tao , Chuzhan Hao , Chenfeng Xu , Yuewei Zhang , Hao Wang

Autoregressive models, often built on Transformer architectures, represent a powerful paradigm for generating ultra-long videos by synthesizing content in sequential chunks. However, this sequential generation process is notoriously slow.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yuexiao Ma , Xuzhe Zheng , Jing Xu , Xiwei Xu , Feng Ling , Xiawu Zheng , Huafeng Kuang , Huixia Li , Xing Wang , Xuefeng Xiao , Fei Chao , Rongrong Ji

An underlying assumption in conventional multi-view learning algorithms is that all views can be simultaneously accessed. However, due to various factors when collecting and pre-processing data from different views, the streaming view…

Machine Learning · Statistics 2016-04-29 Chang Xu , Dacheng Tao , Chao Xu

Distributed LLM serving is costly and often underutilizes hardware accelerators due to three key challenges: bubbles in pipeline-parallel deployments caused by the bimodal latency of prompt and token processing, GPU memory overprovisioning,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-05 Foteini Strati , Sara Mcallister , Amar Phanishayee , Jakub Tarnawski , Ana Klimovic

While live 360 degree video streaming delivers immersive viewing experience, it poses significant bandwidth and latency challenges for content delivery networks. Edge servers are expected to play an important role in facilitating live…

Multimedia · Computer Science 2024-01-30 Chen Li , Tingwei Ye , Tongyu Zong , Liyang Sun , Houwei Cao , Yong Liu

The development of large language models (LLMs) has significantly expanded model sizes, resulting in substantial GPU memory requirements during inference. The key and value storage of the attention map in the KV (key-value) cache accounts…

Machine Learning · Computer Science 2024-10-25 Yifei Yang , Zouying Cao , Qiguang Chen , Libo Qin , Dongjie Yang , Hai Zhao , Zhi Chen

Multi-modal Large Language Models (MLLMs) serving systems commonly employ KV-cache compression to reduce memory footprint. However, existing compression methods introduce significant processing overhead and queuing delays, particularly in…

Multimedia · Computer Science 2025-03-12 Jianian Zhu , Hang Wu , Haojie Wang , Yinghui Li , Biao Hou , Ruixuan Li , Jidong Zhai

Replicating or caching popular content in memories distributed across the network is a technique to reduce peak network loads. Conventionally, the main performance gain of this caching was thought to result from making part of the requested…

Information Theory · Computer Science 2015-09-08 Mohammad Ali Maddah-Ali , Urs Niesen

Online Video Large Language Models (VideoLLMs) play a critical role in supporting responsive, real-time interaction. Existing methods focus on streaming perception, lacking a synchronized logical reasoning stream. However, directly applying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yiran Guan , Liang Yin , Dingkang Liang , Jianzhong Ju , Zhenbo Luo , Jian Luan , Yuliang Liu , Xiang Bai