English
Related papers

Related papers: Researcher Bias in Software Engineering Experiment…

200 papers

The significant momentum and importance of Mining Software Repositories (MSR) in Software Engineering (SE) has fostered new opportunities and challenges for extensive empirical research. However, MSR researchers seem to struggle to…

Software Engineering · Computer Science 2021-10-19 Claudia Ayala , Burak Turhan , Xavier Franch , Natalia Juristo

Background. Software Engineering (SE) researchers extensively perform experiments with human subjects. Well-defined samples are required to ensure external validity. Samples are selected \textit{purposely} or by \textit{convenience},…

Software Engineering · Computer Science 2021-08-30 Valentina Lenarduzzi , Oscar Dieste , Davide Fucci , Sira Vegas

Researchers generally place the most trust in peer-reviewed, published information, such as journals and conference papers. By contrast, software engineering (SE) practitioners typically do not have the time, access or expertise to review…

Software Engineering · Computer Science 2019-11-28 Vahid Garousi , Michael Felderer , Mika V. Mäntylä , Austen Rainer

In its many variants, randomized benchmarking (RB) is a broadly used technique for assessing the quality of gate implementations on quantum computers. A detailed theoretical understanding and general guarantees exist for the functioning and…

Quantum Physics · Physics 2023-06-28 Markus Heinrich , Martin Kliesch , Ingo Roth

Recommender Systems (RSs) aim to provide personalized recommendations for users. A newly discovered bias, known as sentiment bias, uncovers a common phenomenon within Review-based RSs (RRSs): the recommendation accuracy of users or items…

Information Retrieval · Computer Science 2025-05-07 Le Pan , Yuanjiang Cao , Chengkai Huang , Wenjie Zhang , Lina Yao

[Background] Well-formulated Software Engineering (SE) research problems are essential for bridging the gap between industry-academia. Lean Research Inception (LRI) aims to support this activity. [Goal] Apply LRI to support SE students in…

Software Engineering · Computer Science 2026-03-23 Anrafel Fernandes Pereira , Tatiane Ornelas , Allysson Allex Araujo , Marcos Kalinowski

Is it possible to reliably evaluate the quality of peer reviews? We study this question driven by two primary motivations -- incentivizing high-quality reviewing using assessed quality of reviews and measuring changes to review quality in…

Digital Libraries · Computer Science 2024-11-08 Alexander Goldberg , Ivan Stelmakh , Kyunghyun Cho , Alice Oh , Alekh Agarwal , Danielle Belgrave , Nihar B. Shah

Experimentation is an essential method for causal inference in any empirical discipline. Crossover-design experiments are common in Software Engineering (SE) research. In these, subjects apply more than one treatment in different orders.…

Software Engineering · Computer Science 2025-01-08 Julian Frattini , Davide Fucci , Sira Vegas

Affects---emotions and moods---have an impact on cognitive processing activities and the working performance of individuals. It has been established that software development tasks are undertaken through cognitive processing activities.…

Software Engineering · Computer Science 2015-09-18 Daniel Graziotin , Xiaofeng Wang , Pekka Abrahamsson

Randomized benchmarking (RB) is an efficient and robust method to characterize gate errors in quantum circuits. Averaging over random sequences of gates leads to estimates of gate errors in terms of the average fidelity. These estimates are…

Quantum Physics · Physics 2019-09-11 Jonas Helsen , Joel J. Wallman , Steven T. Flammia , Stephanie Wehner

Noise characterization methods such as randomized benchmarking (RB) are critical for the development of scalable quantum computers. Modern RB protocols for multiqubit systems extract physically relevant error rates by exploiting the…

Quantum Physics · Physics 2026-04-15 Yale Fan , Riley Murray , Thaddeus D. Ladd , Kevin Young , Robin Blume-Kohout

Context: Research software is essential for developing advanced tools and models to solve complex research problems and drive innovation across domains. Therefore, it is essential to ensure its correctness. Software testing plays a vital…

Software Engineering · Computer Science 2025-01-30 Nasir U. Eisty , Upulee Kanewala , Jeffrey C. Carver

On-line experimentation (also known as A/B testing) has become an integral part of software development. To timely incorporate user feedback and continuously improve products, many software companies have adopted the culture of agile…

Applications · Statistics 2019-08-13 Yu Wang , Somit Gupta , Jiannan Lu , Ali Mahmoudzadeh , Sophia Liu

As a newly designated professional title, research software engineers (RSEs) link the two worlds of software engineering and research science. They lack clear development and training opportunities, particularly in the realm of mentoring.…

Software Engineering · Computer Science 2021-10-07 Reed Milewicz , Miranda Mundt

When interacting with information retrieval (IR) systems, users, affected by confirmation biases, tend to select search results that confirm their existing beliefs on socially significant contentious issues. To understand the judgments and…

Information Retrieval · Computer Science 2024-06-18 Ben Wang , Jiqun Liu

Many measurements at collider experiments study physics candidates that are a subset of a collision event. The presence of multiple such candidates in a given event can cause raw biases which are large compared to typical statistical…

High Energy Physics - Experiment · Physics 2019-08-22 Patrick Koppenburg

Randomized benchmarking (RB) is widely used to measure an error rate of a set of quantum gates, by performing random circuits that would do nothing if the gates were perfect. In the limit of no finite-sampling error, the exponential decay…

Quantum Physics · Physics 2017-10-03 Timothy Proctor , Kenneth Rudinger , Kevin Young , Mohan Sarovar , Robin Blume-Kohout

Background: The need for empirical investigations in software engineering is growing. Many researchers nowadays, conduct and validate their solutions using empirical research. Survey is one empirical method which enables researchers to…

Software Engineering · Computer Science 2018-11-13 Ahmad Nauman Ghazi , Kai Petersen , Sri Sai Vijay Raj Reddy , Harini Nekkanti

Behavioral research can provide important insights for SE practices. But in performing it, many studies of SE are committing a normative fallacy - they misappropriate normative and prescriptive theories for descriptive purposes. The…

Software Engineering · Computer Science 2020-05-08 Christoph Becker

Motivation: Receptor-binding proteins (RBPs) initiate viral infection and determine host specificity, serving as key targets for phage engineering and therapy. However, the identification of RBPs is complicated by their extreme sequence…

Genomics · Quantitative Biology 2026-03-17 Xiling Luo , Le Ou-Yang , Yang Shen , Jiaojiao Guan , Dehan Cai , Jun Zhang , Yanni Sun , Jiayu Shang