English
Related papers

Related papers: A Unified Framework for Quantitative Cache Analysi…

200 papers

Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the execution time of a cache-sensitive task strongly depends on…

Hardware Architecture · Computer Science 2023-10-05 Binqi Sun , Debayan Roy , Tomasz Kloda , Andrea Bastoni , Rodolfo Pellizzoni , Marco Caccamo

The static analysis of cache accesses consists in correctly predicting which accesses are hits or misses. While there exist good exact and approximate analyses for caches implementing the least recently used (LRU) replacement policy, such…

Hardware Architecture · Computer Science 2022-02-01 David Monniaux

Cache replacement algorithms are critical building blocks of storage systems. This paper examines the characteristics of metadata caches and argues that they inherently exhibit correlated references, even when the corresponding data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-08 Yiyan Zhai , Bintang Dwi Marthen , Sarath Balivada , Vamsi Sudhakar Bojji , Eric Knauft , Jitender Rohilla , Jiaqi Zuo , Quanxing Liu , Maxime Austruy , Wenguang Wang , Juncheng Yang

This paper proposes to use a frequency based cache admission policy in order to boost the effectiveness of caches subject to skewed access distributions. Given a newly accessed item and an eviction candidate from the cache, our scheme…

Operating Systems · Computer Science 2015-12-04 Gil Einziger , Roy Friedman , Ben Manes

The concurrency literature presents a number of approaches for building non-blocking, FIFO, multiple-producer and multiple-consumer (MPMC) queues. However, only a fraction of them have high performance. In addition, many queue designs, such…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-15 Ruslan Nikolaev , Binoy Ravindran

We consider a generalization of the standard cache problem called file-bundle caching, where different queries (tasks), each containing $l\ge 1$ files, sequentially arrive. An online algorithm that does not know the sequence of queries…

Data Structures and Algorithms · Computer Science 2020-11-09 Tiancheng Qin , S. Rasoul Etesami

As machine learning algorithms are shown to be an increasingly valuable tool, the demand for their access has grown accordingly. Oftentimes, it is infeasible to run inference with larger models without an accelerator, which may be…

Machine Learning · Computer Science 2025-06-03 Spencer Banasik

Designing an efficient concurrent data structure is an important challenge that is not easy to meet. Intuitively, efficiency of an implementation is defined, in the first place, by its ability to process applied operations in parallel,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-15 Vitaly Aksenov , Vincent Gramoli , Petr Kuznetsov , Srivatsan Ravi , Di Shang

This article introduces a novel family of decentralised caching policies, applicable to wireless networks with finite storage at the edge-nodes (stations). These policies are based on the Least-Recently-Used replacement principle, and are,…

Performance · Computer Science 2016-06-22 Anastasios Giovanidis , Apostolos Avranas

Real-time and cyber-physical systems need to interact with and respond to their physical environment in a predictable time. While multicore platforms provide incredible computational power and throughput, they also introduce new sources of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-29 Ayoosh Bansal , Jayati Singh , Yifan Hao , Jen-Yang Wen , Renato Mancuso , Marco Caccamo

We propose novel attention architectures, Multi-matrix Factorization Attention (MFA) and MFA-Key-Reuse (MFA-KR). Existing variants for standard Multi-Head Attention (MHA), including SOTA methods like MLA, fail to maintain as strong…

Machine Learning · Computer Science 2025-01-15 Jingcheng Hu , Houyi Li , Yinmin Zhang , Zili Wang , Shuigeng Zhou , Xiangyu Zhang , Heung-Yeung Shum , Daxin Jiang

We study, formally and experimentally, the trade-off in temporal and spatial overhead when managing contiguous blocks of memory using the explicit, dynamic and real-time heap management system Compact-fit (CF). The key property of CF is…

Programming Languages · Computer Science 2014-04-08 Silviu S. Craciunas , Christoph M. Kirsch , Hannes Payer , Harald Röck , Ana Sokolova

Recent studies highlighting the vulnerability of computer architecture to information leakage attacks have been a cause of significant concern. Among the various classes of microarchitectural attacks, cache timing channels are especially…

Cryptography and Security · Computer Science 2019-02-14 Fan Yao , Hongyu Fang , Milos Doroslovacki , Guru Venkataramani

Cache eviction algorithms are used widely in operating systems, databases and other systems that use caches to speed up execution by caching data that is used by the application. There are many policies such as MRU (Most Recently Used), MFU…

Data Structures and Algorithms · Computer Science 2021-10-25 Dhruv Matani , Ketan Shah , Anirban Mitra

Clustering algorithms are widely used in many societal resource allocation applications, such as loan approvals and candidate recruitment, among others, and hence, biased or unfair model outputs can adversely impact individuals that rely on…

Machine Learning · Computer Science 2023-02-22 Anshuman Chhabra , Peizhao Li , Prasant Mohapatra , Hongfu Liu

In any caching system, the admission and eviction policies determine which contents are added and removed from a cache when a miss occurs. Usually, these policies are devised so as to mitigate staleness and increase the hit probability.…

Networking and Internet Architecture · Computer Science 2016-11-15 Mostafa Dehghan , Laurent Massoulie , Don Towsley , Daniel Menasche , Y. C. Tay

Mining large graphs for information is becoming an increasingly important workload due to the plethora of graph structured data becoming available. An aspect of graph algorithms that has hitherto not received much interest is the effect of…

Data Structures and Algorithms · Computer Science 2012-03-27 Amitabha Roy

Memory bandwidth regulation and cache partitioning are widely used techniques for achieving predictable timing in real-time computing systems. Combined with partitioned scheduling, these methods require careful co-allocation of tasks and…

Optimization and Control · Mathematics 2025-05-20 Binqi Sun , Zhihang Wei , Andrea Bastoni , Debayan Roy , Mirco Theile , Tomasz Kloda , Rodolfo Pellizzoni , Marco Caccamo

We study general techniques for implementing distributed data structures on top of future many-core architectures with non cache-coherent or partially cache-coherent memory. With the goal of contributing towards what might become, in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-09 Panagiota Fatourou , Nikolaos D. Kallimanis , Eleni Kanellou , Odysseas Makridakis , Christi Symeonidou

Large language models (LLMs) are becoming increasingly capable at small parameter scales. At the same time, conventional cloud-centric deployment introduces challenges around data privacy, latency, and cost that are acute in operational…

Hardware Architecture · Computer Science 2026-04-29 Harri Renney , Fouad Trad , Michael Mattarock , Zena Wood