Next generation input-output data format for HEP using Google's protocol buffers
Abstract
We propose a data format for Monte Carlo (MC) events, or any structural data, including experimental data, in a compact binary form using variable-size integer encoding as implemented in the Google's Protocol Buffers package. This approach is implemented in the so-called ProMC library which produces smaller file sizes for MC records compared to the existing input-output libraries used in high-energy physics (HEP). Other important features are a separation of abstract data layouts from concrete programming implementations, self-description and random access. Data stored in ProMC files can be written, read and manipulated in a number of programming languages, such C++, Java and Python.
Cite
@article{arxiv.1306.6675,
title = {Next generation input-output data format for HEP using Google's protocol buffers},
author = {S. V. Chekanov},
journal= {arXiv preprint arXiv:1306.6675},
year = {2013}
}
Comments
7 pages, 1 figure, 2 tables. Contributed to the Snowmass 2013 Study