English

Redbench: A Benchmark Reflecting Real Workloads

Databases 2025-06-17 v1

Abstract

Instance-optimized components have made their way into production systems. To some extent, this adoption is due to the characteristics of customer workloads, which can be individually leveraged during the model training phase. However, there is a gap between research and industry that impedes the development of realistic learned components: the lack of suitable workloads. Existing ones, such as TPC-H and TPC-DS, and even more recent ones, such as DSB and CAB, fail to exhibit real workload patterns, particularly distribution shifts. In this paper, we introduce Redbench, a collection of 30 workloads that reflect query patterns observed in the real world. The workloads were obtained by sampling queries from support benchmarks and aligning them with workload characteristics observed in Redset.

Keywords

Cite

@article{arxiv.2506.12488,
  title  = {Redbench: A Benchmark Reflecting Real Workloads},
  author = {Skander Krid and Mihail Stoian and Andreas Kipf},
  journal= {arXiv preprint arXiv:2506.12488},
  year   = {2025}
}

Comments

Eighth International Workshop on Exploiting Artificial Intelligence Techniques for Data Management (aiDM 2025)

R2 v1 2026-07-01T03:17:44.017Z