English
Related papers

Related papers: Researcher Bias in Software Engineering Experiment…

200 papers

Simulation can enable the study of recommender system (RS) evolution while circumventing many of the issues of empirical longitudinal studies; simulations are comparatively easier to implement, are highly controlled, and pose no ethical…

Computers and Society · Computer Science 2021-08-02 Amy A. Winecoff , Matthew Sun , Eli Lucherini , Arvind Narayanan

Large Reasoning Models (LRMs), evolved from standard Large Language Models (LLMs), are increasingly utilized as automated judges because of their explicit reasoning processes. Yet we show that both LRMs and standard LLMs are vulnerable to…

Computers and Society · Computer Science 2025-09-30 Qian Wang , Zhenheng Tang , Zhanzhi Lou , Nuo Chen , Wenxuan Wang , Bingsheng He

Recent studies conducted in different scientific disciplines have concluded that researchers belonging to some socio-cultural groups (e.g., women, racialized people) are usually less cited than other researchers belonging to dominating…

Digital Libraries · Computer Science 2024-11-28 Karolina Tchilinguirova , Alvine Boaye Belle , Gouled Mahamud

Causal inference is a study of causal relationships between events and the statistical study of inferring these relationships through interventions and other statistical techniques. Causal reasoning is any line of work toward determining…

Software Engineering · Computer Science 2023-04-03 Patrick Chadbourne , Nasir Eisty

Accurately measuring discrimination is crucial to faithfully assessing fairness of trained machine learning (ML) models. Any bias in measuring discrimination leads to either amplification or underestimation of the existing disparity.…

Machine Learning · Computer Science 2023-06-09 Sami Zhioua , Rūta Binkytė

Most Software Engineering (SE) human-based controlled experiments rely on students as participants, raising concerns about their external validity. Specifically, the realism of results obtained from students and their applicability to the…

Software Engineering · Computer Science 2025-06-16 Simone Romano , Francesco Paolo Sferratore , Giuseppe Scanniello

Recent work has demonstrated that high-threshold quantum error correction is possible for biased-noise qubits, provided one can implement a controlled-not (CX) gate that preserves the bias. Bias-preserving CX gates have been proposed for…

Quantum Physics · Physics 2023-02-01 Jahan Claes , Shruti Puri

Background: Given the social aspects of Software Engineering (SE), in the last twenty years, researchers from the field started using research methods common in social sciences such as case study, ethnography, and grounded theory. More…

Software Engineering · Computer Science 2020-07-28 Jorge Melegati , Xiaofeng Wang

[Context] In software engineering research, emphasis is given to sound evaluations of new approaches. While industry surveys or industrial case studies are preferred to evaluate industrial applicability, controlled experiments with student…

Software Engineering · Computer Science 2017-08-17 Marian Daun , Carolin Hübscher , Thorsten Weyer

Software engineering (SE) is full of abstract concepts that are crucial for both researchers and practitioners, such as programming experience, team productivity, code comprehension, and system security. Secondary studies aimed at…

Software Engineering · Computer Science 2024-02-15 Marvin Wyrich , Marvin Muñoz Barón , Justus Bogner

Research software is a class of software developed to support research. Today a wealth of such software is created daily in universities, government, and commercial research enterprises worldwide. The sustainability of this software faces…

Software Engineering · Computer Science 2021-05-18 Jeffrey C. Carver , Ian A. Cosden , Chris Hill , Sandra Gesing , Daniel S. Katz

In the research area of reinforcement learning (RL), frequently novel and promising methods are developed and introduced to the RL community. However, although many researchers are keen to apply their methods on real-world problems,…

Artificial Intelligence · Computer Science 2022-11-28 Daniel Hein , Stefan Depeweg , Michel Tokic , Steffen Udluft , Alexander Hentschel , Thomas A. Runkler , Volkmar Sterzing

Controlled experiments are a core research method in software engineering (SE) for validating causal claims. However, recruiting a sample of participants that represents the intended target population is often difficult or expensive, which…

Software Engineering · Computer Science 2026-04-27 Julian Frattini , Richard Torkar , Robert Feldt , Carlo A. Furia

While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational…

Information Retrieval · Computer Science 2021-12-30 Jiawei Chen , Hande Dong , Xiang Wang , Fuli Feng , Meng Wang , Xiangnan He

Background: Blog posts are frequently used by software practitioners to share information about their practice. Blog posts therefore provide a potential source of evidence for software engineering (SE) research. The use of blog posts as…

Software Engineering · Computer Science 2021-03-03 Austen Rainer , Ashley Williams

For more than thirty years, it has been claimed that a way to improve software developers' productivity and software quality is to focus on people. The underlying assumption seems to be that "happy and satisfied software developers perform…

Software Engineering · Computer Science 2016-01-27 Daniel Graziotin

Medical studies that depend on electronic health records (EHR) data are often subject to measurement error, as the data are not collected to support research questions under study. These data errors, if not accounted for in study analyses,…

Methodology · Statistics 2020-03-10 Eric J. Oh , Bryan E. Shepherd , Thomas Lumley , Pamela A. Shaw

Context: Requirements engineering (RE) is an important part of Software Engineering (SE), consisting of various human-centric activities that require the frequent collaboration of a variety of roles. Prior research has shown that…

Software Engineering · Computer Science 2023-11-21 Dulaji Hidellaarachchi , John Grundy , Rashina Hoda , Ingo Mueller

Context. Pair programming (PP) has been found to increase student interest in Computer Science, particularly so for women, and would therefore appear to be a way to help remedy their under-representation, which could be partially motivated…

Software Engineering · Computer Science 2021-10-06 Amador Durán , Pablo Fernández , Beatriz Bernárdez , Nathaniel Weinman , Aslı Akalın , Armando Fox

Background: The development of scientific software applications is far from trivial, due to the constant increase in the necessary complexity of these applications, their increasing size, and their need for intensive maintenance and reuse.…

Software Engineering · Computer Science 2020-10-21 Elvira-Maria Arvanitou , Apostolos Ampatzoglou , Alexander Chatzigeorgiou , Jeffrey C. Carver