English
Related papers

Related papers: Towards Improving the External Validity of Softwar…

200 papers

Evaluating Software testability can assist software managers in optimizing testing budgets and identifying opportunities for refactoring. In this paper, we abandon the traditional approach of pursuing testability measurements based on the…

Software Engineering · Computer Science 2021-02-23 Luca Guglielmo , Andrea Riboni , Giovanni Denaro

With the increase of research in self-adaptive systems, there is a need to better understand the way research contributions are evaluated. Such insights will support researchers to better compare new findings when developing new knowledge…

Software Engineering · Computer Science 2021-03-23 Ilias Gerostathopoulos , Thomas Vogel , Danny Weyns , Patricia Lago

Background. There are some publications in software engineering research that aim at guiding researchers in assessing validity threats to their studies. Still, many researchers fail to address many aspects of validity that are essential to…

Software Engineering · Computer Science 2018-09-07 Lucas Gren

Two important considerations in clinical research studies are proper evaluations of internal and external validity. While randomized clinical trials can overcome several threats to internal validity, they may be prone to poor external…

Methodology · Statistics 2022-07-19 Kevin P. Josey , Fan Yang , Debashis Ghosh , Sridharan Raghavan

Transportability provides a principled framework to address the problem of applying study results to new populations. Here, we consider the problem of selecting variables to include in transport estimators. We provide a brief overview of…

Methodology · Statistics 2019-12-11 Megha L. Mehrotra , M. Maria Glymour , Elvin Geng , Daniel Westreich , David V. Glidden

Recent research in causal inference has made important progress in addressing challenges to the external validity of trial findings. Such methods weight trial participant data to more closely resemble the distribution of effect-modifying…

Methodology · Statistics 2024-07-18 Justin M. Clark , Kollin W. Rott , James S. Hodges , Jared D. Huling

Estimating software testability can crucially assist software managers to optimize test budgets and software quality. In this paper, we propose a new approach that radically differs from the traditional approach of pursuing testability…

Software Engineering · Computer Science 2023-08-01 Luca Guglielmo , Leonardo Mariani , Giovanni Denaro

Many lifestyle intervention trials depend on collecting self-reported outcomes, like dietary intake, to assess the intervention's effectiveness. Self-reported outcome measures are subject to measurement error, which could impact treatment…

Methodology · Statistics 2020-04-06 Benjamin Ackerman , Juned Siddique , Elizabeth A. Stuart

Background: Sustainable software engineering (SSE) means creating software in a way that meets present needs without undermining our collective capacity to meet our future needs. It is typically conceptualized as several intersecting…

Software Engineering · Computer Science 2024-04-02 Sean McGuire , Erin Shultz , Bimpe Ayoola , Paul Ralph

If public trust is lost in a new technology early in its life cycle it can take much more time for the benefits of that technology to be realised. Eventually tens-of-millions of people will collectively have the power to determine…

Human-Computer Interaction · Computer Science 2025-06-11 Jonathan Smith , Siddartha Khastgir

Software systems with large parameter spaces, nondeterminism and high computational cost are challenging to test. Recently, software testing techniques based on causal inference have been successfully applied to systems that exhibit such…

Software Engineering · Computer Science 2025-04-28 Michael Foster , Robert M. Hierons , Donghwan Shin , Neil Walkinshaw , Christopher Wild

Searching for clues, gathering evidence, and reviewing case files are all techniques used by criminal investigators to draw sound conclusions and avoid wrongful convictions. Similarly, in software engineering (SE) research, we can develop…

Software Engineering · Computer Science 2023-09-19 Marvin Muñoz Barón , Marvin Wyrich , Daniel Graziotin , Stefan Wagner

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

This paper presents the validation of shared control strategies for critical maneuvers in automated driving systems. Shared control involves collaboration between the driver and automation, allowing both parties to actively engage and…

Human-Computer Interaction · Computer Science 2024-04-08 Mauricio Marcano , Joseba Sarabia , Asier Zubizarreta , Sergio Díaz

The Causal Roadmap outlines a systematic approach to asking and answering questions of cause-and-effect: define the quantity of interest, evaluate needed assumptions, conduct statistical estimation, and carefully interpret results. To…

Methodology · Statistics 2024-05-30 Nerissa Nance , Maya L. Petersen , Mark van der Laan , Laura B. Balzer

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does…

Software Engineering · Computer Science 2023-01-24 Changwen Li , Joseph Sifakis , Qiang Wang , Rongjie Yan , Jian Zhang

While Sustainable Software Engineering (SSE) tools are widely studied in academia, their practical feasibility in industrial workflows, particularly in regulated environments, remains poorly understood. This study investigates how software…

Software Engineering · Computer Science 2026-04-01 Satwik Ghanta , Peggy Gregory , Gul Calikli

In this paper we discuss the growing need for system behaviour to be validated and verified (V&V'ed) early in model-based systems engineering. Several aspects push companies towards integration of techniques, methods, and processes that…

Software Engineering · Computer Science 2024-06-07 Johan Cederbladh , Antonio Cicchetti

Existing work on the practical impact of software engineering (SE) research examines industrial relevance rather than adoption of study results, hence the question of how results have been practically applied remains open. To answer this…

Software Engineering · Computer Science 2022-09-23 Zoe Kotti , Georgios Gousios , Diomidis Spinellis

Randomized trials are widely considered as the gold standard for evaluating the effects of decision policies. Trial data is, however, drawn from a population which may differ from the intended target population and this raises a problem of…

Methodology · Statistics 2024-10-30 Sofia Ek , Dave Zachariah