English
Related papers

Related papers: VAT: Asymptotic Cost Analysis for Multi-Level Key-…

200 papers

Background: Software Vulnerability (SV) assessment is increasingly adopted to address the ever-increasing volume and complexity of SVs. Data-driven approaches have been widely used to automate SV assessment tasks, particularly the…

Software Engineering · Computer Science 2024-07-16 Triet H. M. Le , M. Ali Babar

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive…

Machine Learning · Statistics 2016-06-01 Rajesh Ranganath , Dustin Tran , David M. Blei

Visualization and virtual environments (VEs) have been two interconnected parallel strands in visual computing for decades. Some VEs have been purposely developed for visualization applications, while many visualization applications are…

Human-Computer Interaction · Computer Science 2018-12-04 Min Chen , Kelly Gaither , Nigel W. John , Brian McCann

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

Variational quantum algorithms (VQAs) provide a promising approach to achieving quantum advantage for practical problems on near-term noisy intermediate-scale quantum (NISQ) devices. Thus far, most studies on VQAs have focused on…

Quantum Physics · Physics 2023-10-06 Yutaro Enomoto , Keitaro Anai , Kenta Udagawa , Shuntaro Takeda

Building vehicles capable of operating without human supervision requires the determination of the agent's pose. Visual Odometry (VO) algorithms estimate the egomotion using only visual changes from the input images. The most recent VO…

Robotics · Computer Science 2021-07-08 Iury Cleveston , Esther L. Colombini

KV cache compression methods have mainly relied on scalar quantization techniques to reduce the memory requirements during decoding. In this work, we apply residual vector quantization, which has been widely used for high fidelity audio…

Machine Learning · Computer Science 2024-10-22 Ankur Kumar

Repeated off-chip memory accesses to DRAM drive up operating power for data-intensive applications, and SRAM technology scaling and leakage power limits the efficiency of embedded memories. Future on-chip storage will need higher density…

Emerging Technologies · Computer Science 2022-01-13 Lillian Pentecost , Alexander Hankin , Marco Donato , Mark Hempstead , Gu-Yeon Wei , David Brooks

In this study, we identify the inefficient attention phenomena in Large Vision-Language Models (LVLMs), notably within prominent models like LLaVA-1.5, QwenVL-Chat and Video-LLaVA. We find out that the attention computation over visual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Liang Chen , Haozhe Zhao , Tianyu Liu , Shuai Bai , Junyang Lin , Chang Zhou , Baobao Chang

Value Added Tax (VAT) fraud erodes public revenue and puts legitimate businesses at a disadvantaged position thereby impacting inequality. Identifying and combating VAT fraud before it occurs is therefore important for welfare. This paper…

We introduce F-IVM, a unified incremental view maintenance (IVM) approach for a variety of tasks, including gradient computation for learning linear regression models over joins, matrix chain multiplication, and factorized evaluation of…

Databases · Computer Science 2018-03-02 Milos Nikolic , Dan Olteanu

Long-context LLM inference is bottlenecked by the memory and bandwidth cost of reading large KV caches during decoding. KV compression reduces this cost by keeping only part of the cache, but task accuracy alone does not identify why a…

Machine Learning · Computer Science 2026-05-12 Ruijie Zhang , Haozhe Liang , Da Chang , Li Hu , Fanqi Kong , Huaxiao Yin , Yu Li

We estimate the scattering matrix of an arbitrarily complex linear, passive, time-invariant system with $N$ monomodal lumped ports by inputting and outputting waves only via a fixed set of $N_\mathrm{A}<N$ ports while terminating the…

Applied Physics · Physics 2025-02-17 Philipp del Hougne

The increasing size of the Key-Value (KV) cache during the Large Language Models long-context inference is the main obstacle for its balance between the deployment cost and task accuracy. To reduce the KV cache size in such scenarios, most…

Machine Learning · Computer Science 2025-07-25 Manlai Liang , JiaMing Zhang , Xiong Li , Jinlong Li

Efficient deployment of Large Language Models (LLMs) requires batching multiple requests together to improve throughput. As the batch size, context length, or model size increases, the size of the key and value (KV) cache can quickly become…

Machine Learning · Computer Science 2024-05-08 Tianyi Zhang , Jonah Yi , Zhaozhuo Xu , Anshumali Shrivastava

This paper considers an incremental Volt/Var control scheme for distribution systems with high integration of inverter-interfaced distributed generation (such as photovoltaic systems). The incremental Volt/Var controller is implemented with…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Antonin Colot , Elisabetta Perotti , Mevludin Glavic , Emiliano Dall'Anese

Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively…

Machine Learning · Computer Science 2026-04-10 Sikai Bai , Haoxi Li , Jie Zhang , Yongjiang Liu , Song Guo

Serving large language models (LLMs) at scale necessitates efficient key-value (KV) cache management. KV caches can be reused across conversation turns via shared-prefix prompts that are common in iterative code editing and chat. However,…

Computation and Language · Computer Science 2026-03-12 Konrad Staniszewski , Adrian Łańcucki

In recent studies, it could be shown that the energy demand of Versatile Video Coding (VVC) decoders can be twice as high as comparable High Efficiency Video Coding (HEVC) decoders. A significant part of this increase in complexity is…

Image and Video Processing · Electrical Eng. & Systems 2024-02-16 Matthias Kränzler , Christian Herglotz , André Kaup

The increasing deployment of Large Language Model (LLM) inference on edge AI systems demands efficient execution under tight memory budgets. A key challenge arises from Key-Value (KV) caches, which often exceed available device memory.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Bodon Jeong , Hongsu Byun , Youngjae Kim , Weikuan Yu , Kyungkeun Lee , Jihoon Yang , Sungyong Park