English

Improving Memory Dependence Prediction with Static Analysis

Programming Languages 2024-06-06 v3 Hardware Architecture

Abstract

This paper explores the potential of communicating information gained by static analysis from compilers to Out-of-Order (OoO) machines, focusing on the memory dependence predictor (MDP). The MDP enables loads to issue without all in-flight store addresses being known, with minimal memory order violations. We use LLVM to find loads with no dependencies and label them via their opcode. These labelled loads skip making lookups into the MDP, improving prediction accuracy by reducing false dependencies. We communicate this information in a minimally intrusive way, i.e.~without introducing additional hardware costs or instruction bandwidth, providing these improvements without any additional overhead in the CPU. We find that in select cases in Spec2017, a significant number of load instructions can skip interacting with the MDP and lead to a performance gain. These results point to greater possibilities for static analysis as a source of near zero cost performance gains in future CPU designs.

Keywords

Cite

@article{arxiv.2403.08056,
  title  = {Improving Memory Dependence Prediction with Static Analysis},
  author = {Luke Panayi and Rohan Gandhi and Jim Whittaker and Vassilios Chouliaras and Martin Berger and Paul Kelly},
  journal= {arXiv preprint arXiv:2403.08056},
  year   = {2024}
}

Comments

15 pages

R2 v1 2026-06-28T15:17:56.086Z