English
Related papers

Related papers: Latency Guarantees for Caching with Delayed Hits

200 papers

Many settings, such as matching riders to drivers in ride-hailing platforms or in-stream video advertising, require handling arrivals over time. In such applications, it is often beneficial to group the arriving orders or requests into…

Data Structures and Algorithms · Computer Science 2025-08-04 Akhil Bhimaraju , S. Rasoul Etesami , Lav R. Varshney

Modern processors use cache memory: a memory access that "hits" the cache returns early, while a "miss" takes more time. Given a memory access in a program, cache analysis consists in deciding whether this access is always a hit, always a…

Programming Languages · Computer Science 2019-09-24 David Monniaux , Valentin Touzeau

Next-generation communication networks are envisioned to extensively utilize storage-enabled caching units to alleviate unfavorable surges of data traffic by pro-actively storing anticipated highly popular contents across geographically…

Networking and Internet Architecture · Computer Science 2019-02-20 Alireza Sadeghi , Antonio G. Marques , Georgios B. Giannakis

Software caches are an intrinsic component of almost every computer system. Consequently, caching algorithms, particularly eviction policies, are the topic of many papers. Almost all these prior papers evaluate the caching algorithm based…

Performance · Computer Science 2024-11-19 Ziyue Qiu , Juncheng Yang , Mor Harchol-Balter

Caching is an efficient way to reduce peak-hour network traffic congestion by storing some contents at user's local cache without knowledge of later demands. Maddah-Ali and Niesen initiated a fundamental study of caching systems; they…

Information Theory · Computer Science 2015-11-10 Kai Wan , Daniela Tuninetti , Pablo Piantanida

The work identifies the fundamental limits of coded caching when the K receiving users share {\Lambda}$\leq$ K helper-caches, each assisting an arbitrary number of different users. The main result is the derivation of the exact optimal…

Information Theory · Computer Science 2018-10-17 Emanuele Parrinello , Ayşe Ünsal , Petros Elia

We take a systematic look at the problem of storing whole files in a cache with limited capacity in the context of optimistic learning, where the caching policy has access to a prediction oracle (provided by, e.g., a Neural Network). The…

Machine Learning · Computer Science 2022-11-10 Naram Mhaisen , Abhishek Sinha , Georgios Paschos , Georgios Iosifidis

Caching at the base stations brings the contents closer to the users, reduces the traffic through the backhaul links, and reduces the delay experienced by the cellular users. The cellular network operator may charge the content providers…

Networking and Internet Architecture · Computer Science 2015-09-11 Ammar Gharaibeh , Abdallah Khreishah , Bo Ji , Moussa Ayyash

Caching is an efficient way to reduce network traffic congestion during peak hours by storing some content at the user's local cache memory without knowledge of later demands. For the shared-link caching model, Maddah-Ali and Niesen (MAN)…

Information Theory · Computer Science 2020-06-22 Kai Wan , Giuseppe Caire

Dynamic load balancing lies at the heart of distributed caching. Here, the goal is to assign objects (load) to servers (computing nodes) in a way that provides load balancing while at the same time dynamically adjusts to the addition or…

Data Structures and Algorithms · Computer Science 2020-06-17 John Chen , Ben Coleman , Anshumali Shrivastava

We study in this paper the impact of communication latency on the classical Work Stealing load balancing algorithm. Our paper extends the reference model in which we introduce a latency parameter. By using a theoretical analysis and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Nicolas Gast , Mohammed Khatiri , Denis Trystram , Frederic Wagner

Modern content delivery networks consist of one or more back-end servers which store the entire content catalog, assisted by multiple front-end servers with limited storage and service capacities located near the end-users. Appropriate…

Data Structures and Algorithms · Computer Science 2016-02-24 Rahul Vaze , Sharayu Moharir

We consider a hierarchical network that consists of mobile users, a two-tiered cellular network (namely small cells and macro cells) and central routers, each of which follows a Poisson point process (PPP). In this scenario, small cells…

Information Theory · Computer Science 2016-05-05 Ejder Baştuğ , Marios Kountouris , Mehdi Bennis , Mérouane Debbah

High load latency that results from deep cache hierarchies and relatively slow main memory is an important limiter of single-thread performance. Data prefetch helps reduce this latency by fetching data up the hierarchy before it is…

Hardware Architecture · Computer Science 2021-03-30 Majid Jalili , Mattan Erez

Coded caching utilizes pre-fetching during off-peak hours and multi-casting for delivery in order to balance the traffic load in communication networks. Several works have studied the achievable peak and average rates under different…

Information Theory · Computer Science 2022-01-27 Ciyuan Zhang , Su Wang , Vaneet Aggarwal , Borja Peleato

The ever-growing end user data demands, and the simultaneous reductions in memory costs are fueling edge-caching deployments. Caching at the edge is substantially different from that at the core and needs to take into account the nature of…

Networking and Internet Architecture · Computer Science 2023-10-24 Guocong Quan , Atilla Eryilmaz , Ness Shroff

In data warehouse and data mart systems, queries often take a long time to execute due to their complex nature. Query response times can be greatly improved by caching final/intermediate results of previous queries, and using them to answer…

Databases · Computer Science 2007-05-23 Prasan Roy , Krithi Ramamritham , S. Seshadri , Pradeep Shenoy , S. Sudarshan

We study in this paper the impact of communication latency on the classical Work Stealing load balancing algorithm. Our approach considers existing performance models and the underlying algorithms. We introduce a latency parameter in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-07 Mohammed Khatiri , Denis Trystram , Frederic Wagner

Modern computer architectures rely on caches to reduce the latency gap between the CPU and main memory. While indispensable for performance, caches pose a serious threat to security because they leak information about memory access patterns…

Cryptography and Security · Computer Science 2023-06-22 Pablo Cañones , Boris Köpf , Jan Reineke

With files proactively stored at base stations (BSs), mobile edge caching enables direct content delivery without remote file fetching, which can reduce the end-to-end delay while relieving backhaul pressure. To effectively utilize the…

Networking and Internet Architecture · Computer Science 2017-10-25 Shan Zhang , Peter He , Katsuya Suto , Peng Yang , Lian Zhao , Xuemin , Shen