English

CrashJS: A NodeJS Benchmark for Automated Crash Reproduction

Software Engineering 2024-05-10 v1

Abstract

Software bugs often lead to software crashes, which cost US companies upwards of $2.08 trillion annually. Automated Crash Reproduction (ACR) aims to generate unit tests that successfully reproduce a crash. The goal of ACR is to aid developers with debugging, providing them with another tool to locate where a bug is in a program. The main approach ACR currently takes is to replicate a stack trace from an error thrown within a program. Currently, ACR has been developed for C, Java, and Python, but there are no tools targeting JavaScript programs. To aid the development of JavaScript ACR tools, we propose CrashJS: a benchmark dataset of 453 Node.js crashes from several sources. CrashJS includes a mix of real-world and synthesised tests, multiple projects, and different levels of complexity for both crashes and target programs.

Keywords

Cite

@article{arxiv.2405.05541,
  title  = {CrashJS: A NodeJS Benchmark for Automated Crash Reproduction},
  author = {Philip Oliver and Jens Dietrich and Craig Anslow and Michael Homer},
  journal= {arXiv preprint arXiv:2405.05541},
  year   = {2024}
}

Comments

Pre-print; Accepted to MSR 2024

R2 v1 2026-06-28T16:21:40.530Z