English

Wanted: standards for automatic reproducibility of computational experiments

Software Engineering 2023-07-24 v1

Abstract

Those seeking to reproduce a computational experiment often need to manually look at the code to see how to build necessary libraries, configure parameters, find data, and invoke the experiment; it is not automatic. Automatic reproducibility is a more stringent goal, but working towards it would benefit the community. This work discusses a machine-readable language for specifying how to execute a computational experiment. We invite interested stakeholders to discuss this language at https://github.com/charmoniumQ/execution-description .

Keywords

Cite

@article{arxiv.2307.11383,
  title  = {Wanted: standards for automatic reproducibility of computational experiments},
  author = {Samuel Grayson and Reed Milewicz and Joshua Teves and Daniel S. Katz and Darko Marinov},
  journal= {arXiv preprint arXiv:2307.11383},
  year   = {2023}
}

Comments

Submitted to SE4RS'23 Portland, OR

R2 v1 2026-06-28T11:36:42.229Z