English
Related papers

Related papers: Lessons learned from replicating a study on inform…

200 papers

Many software systems originate as prototypes or minimum viable products (MVPs), developed with an emphasis on delivery speed and responsiveness to changing requirements rather than long-term code maintainability. While effective for rapid…

Software Engineering · Computer Science 2026-04-06 Ema Smolic , Mario Brcic , Luka Hobor , Mihael Kovac

With the advent of open source software, a veritable treasure trove of previously proprietary software development data was made available. This opened the field of empirical software engineering research to anyone in academia. Data that is…

Software Engineering · Computer Science 2022-04-19 Adam Tutko , Austin Z. Henley , Audris Mockus

Software development relies heavily on traceability links between various software artifacts to ensure quality and facilitate maintenance. While automated traceability recovery techniques have advanced for different artifact pairs, the…

Software Engineering · Computer Science 2026-03-18 Zhifei Chen , Lata Yi , Liming Nie , Yangyang Zhao , Hao Liu , Yiqing Shi , Wei Song

Obtaining a relevant dataset is central to conducting empirical studies in software engineering. However, in the context of mining software repositories, the lack of appropriate tooling for large scale mining tasks hinders the creation of…

Software Engineering · Computer Science 2023-06-21 Romain Lefeuvre , Jessie Galasso , Benoit Combemale , Houari Sahraoui , Stefano Zacchiroli

Estimating software testability can crucially assist software managers to optimize test budgets and software quality. In this paper, we propose a new approach that radically differs from the traditional approach of pursuing testability…

Software Engineering · Computer Science 2023-08-01 Luca Guglielmo , Leonardo Mariani , Giovanni Denaro

A recurring problem in software development is incorrect decision making on the techniques, methods and tools to be used. Mostly, these decisions are based on developers' perceptions about them. A factor influencing people's perceptions is…

Software Engineering · Computer Science 2024-02-13 Sira Vegas , Patricia Riofrio , Esperanza Marcos , Natalia Juristo

The ubiquity of computation in modern scientific research inflicts new challenges for reproducibility. While most journals now require code and data be made available, the standards for organization, annotation, and validation remain lax,…

Other Quantitative Biology · Quantitative Biology 2022-10-07 Griffin Chure

Test case prioritization focuses on finding a suitable order of execution of the test cases in a test suite to meet some performance goals like detecting faults early. It is likely that some test cases execute the program parts that are…

Software Engineering · Computer Science 2025-08-27 S. Panda , D. Munjal , D. P. Mohapatra

Background: Empirical studies on widely used model-based development tools such as MATLAB/Simulink are limited despite the tools' importance in various industries. Aims: The aim of this paper is to investigate the reproducibility of…

Software Engineering · Computer Science 2023-08-10 Sohil Lal Shrestha , Shafiul Azam Chowdhury , Christoph Csallner

Science is conducted collaboratively, often requiring the sharing of knowledge about computational experiments. When experiments include only datasets, they can be shared using Uniform Resource Identifiers (URIs) or Digital Object…

Databases · Computer Science 2018-06-19 Zhihao Yuan , Dai Hai Ton That , Siddhant Kothari , Gabriel Fils , Tanu Malik

Assessment of replicability is critical to ensure the quality and rigor of scientific research. In this paper, we discuss inference and modeling principles for replicability assessment. Targeting distinct application scenarios, we propose…

Methodology · Statistics 2021-05-11 Yi Zhao , Xiaoquan Wen

Context: Research software is essential for developing advanced tools and models to solve complex research problems and drive innovation across domains. Therefore, it is essential to ensure its correctness. Software testing plays a vital…

Software Engineering · Computer Science 2025-01-30 Nasir U. Eisty , Upulee Kanewala , Jeffrey C. Carver

Reproducibility is an important feature of science; experiments are retested, and analyses are repeated. Trust in the findings increases when consistent results are achieved. Despite the importance of reproducibility, significant work is…

Digital Libraries · Computer Science 2023-01-12 Akhil Pandey Akella , Hamed Alhoori , David Koop

Requirements prioritization is a critical activity during the early software development process, which produces a set of key requirements to implement. The prioritization process offers a parity among the requirements based on multiple…

Software Engineering · Computer Science 2023-06-22 Jonathan Winton , Francis Palma

The integration of machine learning techniques in materials discovery has become prominent in materials science research and has been accompanied by an increasing trend towards open-source data and tools to propel the field. Despite the…

Materials Science · Physics 2026-05-27 Daniel Persaud , Logan Ward , Jason Hattrick-Simpers

Empirical research in reverse engineering and software protection is crucial for evaluating the efficacy of methods designed to protect software against unauthorized access and tampering. However, conducting such studies with professional…

Software Engineering · Computer Science 2026-03-05 Tab , Zhang , Bjorn De Sutter , Christian Collberg , Bart Coppens , Waleed Mebane

This paper discusses a model-based approach to testing as a vital part of software development. It argues that an approach using models as central development artifact needs to be added to the portfolio of software engineering techniques,…

Software Engineering · Computer Science 2014-09-24 Bernhard Rumpe

Context: Software Engineering research makes use of collections of software artifacts (corpora) to derive empirical evidence from. Goal: To improve quality and reproducibility of research, we need to understand the characteristics of used…

Software Engineering · Computer Science 2013-04-04 Ekaterina Pek , Ralf Lämmel

Reproducing experiments is an important instrument to validate previous work and build upon existing approaches. It has been tackled numerous times in different areas of science. In this paper, we introduce an empirical replicability study…

Computation and Language · Computer Science 2017-01-09 Edison Marrese-Taylor , Yutaka Matsuo

Reproducibility is a fundamental requirement of the scientific process since it enables outcomes to be replicated and verified. Computational scientific experiments can benefit from improved reproducibility for many reasons, including…

Databases · Computer Science 2019-09-04 Maria Luiza Mondelli , A. Townsend Peterson , Luiz M. R. Gadelha