English
Related papers

Related papers: Optimistic Online Caching for Batched Requests

200 papers

In the on-line file-caching problem problem, the input is a sequence of requests for files, given on-line (one at a time). Each file has a non-negative size and a non-negative retrieval cost. The problem is to decide which files to keep in…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

We consider a generalization of the standard cache problem called file-bundle caching, where different queries (tasks), each containing $l\ge 1$ files, sequentially arrive. An online algorithm that does not know the sequence of queries…

Data Structures and Algorithms · Computer Science 2020-11-09 Tiancheng Qin , S. Rasoul Etesami

In the classical caching problem, when a requested page is not present in the cache (i.e., a "miss"), it is assumed to travel from the backing store into the cache "before" the next request arrives. However, in many real-life applications,…

Data Structures and Algorithms · Computer Science 2025-01-29 Keerthana Gurushankar , Noah G. Singer , Bernardo Subercaseaux

Optimal caching of files in a content distribution network (CDN) is a problem of fundamental and growing commercial interest. Although many different caching algorithms are in use today, the fundamental performance limits of network caching…

Information Theory · Computer Science 2020-04-01 Rajarshi Bhattacharjee , Subhankar Banerjee , Abhishek Sinha

We consider models of content delivery networks in which the servers are constrained by two main resources: memory and bandwidth. In such systems, the throughput crucially depends on how contents are replicated across servers and how the…

Performance · Computer Science 2018-01-10 Arpan Mukhopadhyay , Nidhi Hegde , Marc Lelarge

Despite significant progress in the caching literature concerning the worst case and uniform average case regimes, the algorithms for caching with nonuniform demands are still at a basic stage and mostly rely on simple grouping and…

Information Theory · Computer Science 2018-02-01 Pierre Quinton , Saeid Sahraei , Michael Gastpar

In learning theory, the performance of an online policy is commonly measured in terms of the static regret metric, which compares the cumulative loss of an online policy to that of an optimal benchmark in hindsight. In the definition of…

Information Theory · Computer Science 2022-08-23 Ativ Joshi , Abhishek Sinha

In this paper, we study a data caching problem in the cloud environment, where multiple frequently co-utilised data items could be packed as a single item being transferred to serve a sequence of data requests dynamically with reduced cost.…

Data Structures and Algorithms · Computer Science 2022-08-08 Jiashu Wu , Hao Dai , Yang Wang , Yong Zhang , Dong Huang , Chengzhong Xu

We address the problem of learning-augmented online caching in the scenario when each request is accompanied by a prediction of the next occurrence of the requested page. We improve currently known bounds on the competitive ratio of the…

Databases · Computer Science 2025-07-29 Daniel Skachkov , Denis Ponomaryov , Yuri Dorn , Alexander Demin

We study the problem of optimal content placement over a network of caches, a problem naturally arising in several networking applications, including ICNs, CDNs, and P2P systems. Given a demand of content request rates and paths followed,…

Networking and Internet Architecture · Computer Science 2016-04-13 Stratis Ioannidis , Edmund Yeh

Competitive analysis of online algorithms has commonly been applied to understand the behaviour of real-time systems during overload conditions. While competitive analysis provides insight into the behaviour of certain algorithms, it is…

Performance · Computer Science 2018-06-06 Sathish Gopalakrishnan

Large Language Models (LLMs) and other large foundation models have achieved noteworthy success, but their size exacerbates existing resource consumption and latency challenges. In particular, the large-scale deployment of these models is…

Machine Learning · Computer Science 2023-08-30 Banghua Zhu , Ying Sheng , Lianmin Zheng , Clark Barrett , Michael I. Jordan , Jiantao Jiao

In this work, we propose MUSTACHE, a new page cache replacement algorithm whose logic is learned from observed memory access requests rather than fixed like existing policies. We formulate the page request prediction problem as a…

Operating Systems · Computer Science 2022-11-07 Gabriele Tolomei , Lorenzo Takanen , Fabio Pinelli

Online learning algorithms have been successfully used to design caching policies with regret guarantees. Existing algorithms assume that the cache knows the exact request sequence, but this may not be feasible in high load and/or…

Machine Learning · Computer Science 2023-09-06 Younes Ben Mazziane , Francescomaria Faticanti , Giovanni Neglia , Sara Alouf

Design of distributed caching mechanisms is considered as an active area of research due to its promising solution in reducing data load in the backhaul link of a cellular network. In this paper, the problem of distributed content caching…

Information Theory · Computer Science 2020-10-14 S. Krishnendu , B. N. Bharath , Navneet Garg , Vimal Bhatia , Tharmalingam Ratnarajah

This paper studies content caching in cloud-aided wireless networks where small cell base stations with limited storage are connected to the cloud via limited capacity fronthaul links. By formulating a utility (inverse of service delay)…

Networking and Internet Architecture · Computer Science 2017-10-03 Syed Tamoor-ul-Hassan , Sumudu Samarakoon , Mehdi Bennis , Matti Latva-aho , Choong-Seong Hong

This paper has two results. The first is based on the surprising observation that the well-known ``least-recently-used'' paging algorithm and the ``balance'' algorithm for weighted caching are linear-programming primal-dual algorithms. This…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

Caching is a crucial component of many computer systems, so naturally it is a well-studied topic in algorithm design. Much of traditional caching research studies cache management for a single-user or single-processor environment. In this…

Data Structures and Algorithms · Computer Science 2022-07-14 Sharat Ibrahimpur , Manish Purohit , Zoya Svitkina , Erik Vee , Joshua Wang

We consider caching in cellular networks in which each base station is equipped with a cache that can store a limited number of files. The popularity of the files is known and the goal is to place files in the caches such that the…

Networking and Internet Architecture · Computer Science 2017-11-27 Konstantin Avrachenkov , Jasper Goseling , Berksan Serbetci

Efficient edge caching reduces latency and alleviates backhaul congestion in modern networks. Traditional caching policies, such as Least Recently Used (LRU) and Least Frequently Used (LFU), perform well under specific request patterns. LRU…

Networking and Internet Architecture · Computer Science 2025-12-10 Agrim Bari , Gustavo de Veciana , Yuqi Zhou