English

Circllhist -- A Log-Linear Histogram Data Structure for IT Infrastructure Monitoring

Data Structures and Algorithms 2020-01-22 v1
Authors: Heinrich Hartmann , Theo Schlossnagle
View on arXiv ↗ PDF ↗

Abstract

The circllhist histogram is a fast and memory efficient data structure for summarizing large numbers of latency measurements. It is particularly suited for applications in IT infrastructure monitoring, and provides nano-second data insertion, full mergeability, accurate approximation of quantiles with a-priori bounds on the relative error. Open-source implementations are available for C/lua/python/Go/Java/JavaScript.

Keywords

runtime monitoring data processing compiler optimization

Cite

@article{arxiv.2001.06561,
  title  = {Circllhist -- A Log-Linear Histogram Data Structure for IT Infrastructure Monitoring},
  author = {Heinrich Hartmann and Theo Schlossnagle},
  journal= {arXiv preprint arXiv:2001.06561},
  year   = {2020}
}

Comments

16 pages, 7 figures

Related papers

View all related →
Performance · Computer Science
LightningSim: Fast and Accurate Trace-Based Simulation for High-Level Synthesis
Rishov Sarkar, Cong Hao
2023-04-25
Hardware Architecture · Computer Science
NISTT: A Non-Intrusive SystemC-TLM 2.0 Tracing Tool
Nils Bosbach, Lukas Jünger, Jan Moritz Joseph, Rainer Leupers
2025-05-20
Instrumentation and Methods for Astrophysics · Physics
HILTS, the Herschel Inspector and Long-Term Scheduler
Pedro Gómez-Alvarez, Jon Brumfitt, Rosario Lorente, Pedro García-Lario
2011-02-08
Cryptography and Security · Computer Science
LibIHT: A Hardware-Based Approach to Efficient and Evasion-Resistant Dynamic Binary Analysis
Changyu Zhao, Yohan Beugin, Jean-Charles Noirot Ferrand, Quinn Burke +2
2025-10-21
Machine Learning · Computer Science
CIRCUITSYNTH: Leveraging Large Language Models for Circuit Topology Synthesis
Prashanth Vijayaraghavan, Luyao Shi, Ehsan Degan, Xin Zhang
2024-07-17
Systems and Control · Computer Science
Robust Online Monitoring of Signal Temporal Logic
Jyotirmoy V. Deshmukh, Alexandre Donzé, Shromona Ghosh, Xiaoqing Jin +2
2015-06-30
Data Structures and Algorithms · Computer Science
SetSketch: Filling the Gap between MinHash and HyperLogLog
Otmar Ertl
2021-08-12
Distributed, Parallel, and Cluster Computing · Computer Science
LIKWID Monitoring Stack: A flexible framework enabling job specific performance monitoring for the masses
Thomas Röhl, Jan Eitzinger, Georg Hager, Gerhard Wellein
2019-02-19
Distributed, Parallel, and Cluster Computing · Computer Science
HyperLogLog Sketch Acceleration on FPGA
Amit Kulkarni, Monica Chiosa, Thomas B. Preußer, Kaan Kara +2
2020-10-21
Distributed, Parallel, and Cluster Computing · Computer Science
HiQ -- A Declarative, Non-intrusive, Dynamic and Transparent Observability and Optimization System
Fuheng Wu, Ivan Davchev, Jun Qian
2023-04-27
Machine Learning · Computer Science
Linnaeus: A highly reusable and adaptable ML based log classification pipeline
Armin Catovic, Carolyn Cartwright, Yasmin Tesfaldet Gebreyesus, Simone Ferlin
2021-03-15
Distributed, Parallel, and Cluster Computing · Computer Science
LISA (Localhost Information Service Agent)
Iosif C. Legrand, Ciprian Dobre, Ramiro Voicu, Corina Stratan +2
2011-06-28
Software Engineering · Computer Science
Analyzing Logs of Large-Scale Software Systems using Time Curves Visualization
Dmytro Borysenkov, Adriano Vogel, Sören Henning, Esteban Perez-Wohlfeil
2025-02-20
Instrumentation and Methods for Astrophysics · Physics
Libpsht - algorithms for efficient spherical harmonic transforms
Martin Reinecke
2011-01-11
Optimization and Control · Mathematics
An integral quadratic constraint framework for real-time steady-state optimization of linear time-invariant systems
Zachary E. Nelson, Enrique Mallada
2017-10-30
Information Theory · Computer Science
IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks
Patricia Wollstadt, Joseph T. Lizier, Raul Vicente, Conor Finn +4
2019-02-20
Sound · Computer Science
Rhythmic segment analysis: Conceptualizing, visualizing, and measuring rhythmic data
Bas Cornelissen
2026-03-31
Data Structures and Algorithms · Computer Science
CR-precis: A deterministic summary structure for update data streams
Sumit Ganguly, Anirban Majumder
2007-05-23
Programming Languages · Computer Science
Visualizing JIT Compiler Graphs
HeuiChan Lim, Stephen Kobourov
2021-08-27
Computation · Statistics
clustra: A multi-platform k-means clustering algorithm for analysis of longitudinal trajectories in large electronic health records data
Nimish Adhikari, Hanna Gerlovin, George Ostrouchov, Rachel Ehrbar +9
2025-07-02
Instrumentation and Methods for Astrophysics · Physics
A new model for archiving synoptic data in the VISTA Data Flow System
Nicholas Cross, Ross Collins, Nigel Hambly, Mike Read +1
2009-01-26
Hardware Architecture · Computer Science
Blink: Fast Automated Design of Run-Time Power Monitors on FPGA-Based Computing Platforms
Andrea Galimberti, Michele Piccoli, Davide Zoni
2025-01-30
Software Engineering · Computer Science
Log Summarisation for Defect Evolution Analysis
Rares Dolga, Ran Zmigrod, Rui Silva, Salwa Alamir +1
2024-03-14
Machine Learning · Computer Science
RigLSTM: Recurrent Independent Grid LSTM for Generalizable Sequence Learning
Ziyu Wang, Wenhao Jiang, Zixuan Zhang, Wei Tang +1
2023-11-07
Databases · Computer Science
Loginson: a transform and load system for very large scale log analysis in large IT infrastructures
Carlos Vega, Paula Roquero, Rafael Leira, Ivan Gonzalez +1
2017-03-09
R2 v1 2026-06-23T13:14:28.817Z