English

Anachronic Tertiary Studies in Software Engineering: An Exploratory Quaternary Study

Software Engineering 2023-11-02 v1

Abstract

Systematic literature reviews tentativelydescribe the state of the art in a given research area. However, the continuous publication of new primary and secondary studies following the release of a tertiary study can make the communication of results not integrally representative in regards to the advances achieved by that time. Consequently, using such a study as a reference within specific bodies of knowledge may introduce imprecision, both in terms of its subareas and with respect to new methodologies, languages, and tools. Thus, a review of tertiary studies (what could be understood as a quaternary study) could contribute to show the representativeness of the reported findings in comparison to the state of the art and also to compile a set of perceptions that could not be previously achieved. In that direction, the main contribution of this paper is presenting the findings from an analysis of 34 software engineering tertiary studies published between 2009 and 2021. The results indicate that over 60% of the studies demonstrate varying degrees of anachronism due to the publication of primary and secondary studies following the publication of the tertiary study or even due to a time elapse between its conduction and its publication.

Keywords

Cite

@article{arxiv.2311.00211,
  title  = {Anachronic Tertiary Studies in Software Engineering: An Exploratory Quaternary Study},
  author = {Valdemar Vicente Graciano Neto and Célia Laís Rodrigues and Fernando Kenji Kamei and Juliano Lopes de Oliveira and Eliomar Araújo de Lima and Mohamad Kassab and Roberto Oliveira},
  journal= {arXiv preprint arXiv:2311.00211},
  year   = {2023}
}

Comments

8 pages, not peer-reviewed yet

R2 v1 2026-06-28T13:08:04.732Z