English
Related papers

Related papers: Towards debiasing code review support

200 papers

Background: Contemporary software development organizations lack diversity and the ratios of women in Free and open-source software (FOSS) communities are even lower than the industry average. Although the results of recent studies hint the…

Software Engineering · Computer Science 2023-02-07 Sayma Sultana , Amiangshu Bosu

With the growing use of large language models(LLMs) as evaluators, their application has expanded to code evaluation tasks, where they assess the correctness of generated code without relying on reference implementations. While this offers…

Computation and Language · Computer Science 2026-01-06 Jiwon Moon , Yerin Hwang , Dongryeol Lee , Taegwan Kang , Yongil Kim , Kyomin Jung

Quantitative research relies heavily on coding, and coding errors are relatively common even in published research. In this paper, we examine whether individuals are more or less likely to check their code depending on the results they…

General Economics · Economics 2025-09-26 Bruno Ferman , Lucas Finamor

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

Several techniques have been proposed to automate code review. Early support consisted in recommending the most suited reviewer for a given change or in prioritizing the review tasks. With the advent of deep learning in software…

Software Engineering · Computer Science 2024-12-02 Rosalia Tufano , Alberto Martin-Lopez , Ahmad Tayeb , Ozren Dabić , Sonia Haiduc , Gabriele Bavota

Despite the popularity and importance of modern code review, the understanding of the cognitive processes that enable reviewers to analyze code and provide meaningful feedback is lacking. To address this gap, we observed and interviewed ten…

Software Engineering · Computer Science 2025-03-28 Pavlína Wurzel Gonçalves , Pooja Rani , Margaret-Anne Storey , Diomidis Spinellis , Alberto Bacchelli

Code review is a widely-used practice in software development companies to identify defects. Hence, code review has been included in many software engineering curricula at universities worldwide. However, teaching code review is still a…

Software Engineering · Computer Science 2021-02-04 Chun Yong Chong , Patanamon Thongtanunam , Chakkrit Tantithamthavorn

Code reviews are a critical aspect of open-source software (OSS) development, ensuring quality and fostering collaboration. This study examines perceptions, challenges, and biases in OSS code review processes, focusing on the perspectives…

Software Engineering · Computer Science 2025-04-28 Yoseph Berhanu Alebachew , Minhyuk Ko , Chris Brown

Context: Contemporary software development organizations lack diversity and the ratios of women in Free and open-source software (FOSS) communities are even lower than the industry average. Although the results of recent studies hint the…

Software Engineering · Computer Science 2023-02-09 Sayma Sultana , Asif Kamal Turzo , Amiangshu Bosu

As the adoption of LLMs becomes more widespread in software coding ecosystems, a pressing issue has emerged: does the generated code contain social bias and unfairness, such as those related to age, gender, and race? This issue concerns the…

Software Engineering · Computer Science 2025-03-24 Dong Huang , Jie M. Zhang , Qingwen Bu , Xiaofei Xie , Junjie Chen , Heming Cui

Reviewing source code from a security perspective has proven to be a difficult task. Indeed, previous research has shown that developers often miss even popular and easy-to-detect vulnerabilities during code review. Initial evidence…

Software Engineering · Computer Science 2022-02-15 Larissa Braz , Christian Aeberhard , Gül Çalikli , Alberto Bacchelli

Cognitive biases have been studied in psychology, sociology, and behavioral economics for decades. Traditionally, they have been considered a negative human trait that leads to inferior decision-making, reinforcement of stereotypes, or can…

Information Retrieval · Computer Science 2024-09-02 Markus Schedl , Oleg Lesota , Stefan Brandl , Mohammad Lotfi , Gustavo Junior Escobedo Ticona , Shahed Masoudian

Online comments significantly influence users' judgments, yet their presentation, often determined by platform algorithms, can introduce biases, such as anchoring effects, which distort reasoning. While existing research emphasizes…

Human-Computer Interaction · Computer Science 2026-01-28 Yang Ouyang , Shenghan Gao , Ruichuan Wang , Hailiang Zhu , Yuheng Shao , Xiaoyu Gu , Quan Li

Cognitive biases, systematic deviations from rationality in judgment, pose significant challenges in generating objective content. This paper introduces a novel approach for real-time cognitive bias detection in user-generated text using…

Computers and Society · Computer Science 2025-03-10 Frederic Lemieux , Aisha Behr , Clara Kellermann-Bryant , Zaki Mohammed

Human-AI collaboration increasingly drives decision-making across industries, from medical diagnosis to content moderation. While AI systems promise efficiency gains by providing automated suggestions for human review, these workflows can…

Human-Computer Interaction · Computer Science 2025-09-11 Jacob Beck , Stephanie Eckman , Christoph Kern , Frauke Kreuter

Motivation: Code understandability is crucial in software development, as developers spend 58% to 70% of their time reading source code. Improving it can improve productivity and reduce maintenance costs. Problem: Experimental studies often…

Software Engineering · Computer Science 2024-11-13 Delano Oliveira , Reydne Santos , Benedito de Oliveira , Martin Monperrus , Fernando Castor , Fernanda Madeiral

Code review has evolved for decades, from informal peer checking to today's pull request (PR) workflows, yet it remains a largely manual, uneven, and cognitively demanding process. The rise of Artificial Intelligence (AI) coding assistants…

Software Engineering · Computer Science 2026-05-19 Hüseyin Özgür Kamalı , Erdem Tuna , Vahid Haratian , Eray Tüzün

Deception plays a key role in adversarial or strategic interactions for the purpose of self-defence and survival. This paper introduces a general framework and solution to address deception. Most existing approaches for deception consider…

Artificial Intelligence · Computer Science 2019-04-26 Bo Wu , Murat Cubuktepe , Suda Bharadwaj , Ufuk Topcu

We examine "vibe coding": an emerging programming paradigm where developers primarily write code by interacting with code-generating large language models rather than writing code directly. We present the first empirical study of vibe…

Human-Computer Interaction · Computer Science 2025-10-06 Advait Sarkar , Ian Drosos

Research on cognitive biases and heuristics has become increasingly popular in the visualization literature in recent years. Researchers have studied the effects of biases on visualization interpretation and subsequent decision-making.…

Human-Computer Interaction · Computer Science 2025-03-07 Ali Baigelenov , Prakash Shukla , Zixu Zhang , Paul Parsons