English
Related papers

Related papers: GitHub Copilot AI pair programmer: Asset or Liabil…

200 papers

This paper aims to evaluate GitHub Copilot's generated code quality based on the LeetCode problem set using a custom automated framework. We evaluate the results of Copilot for 4 programming languages: Java, C++, Python3 and Rust. We aim to…

Software Engineering · Computer Science 2024-06-18 Ilja Siroš , Dave Singelée , Bart Preneel

As software development practices increasingly adopt AI-powered tools, ensuring that such tools can support secure coding has become critical. This study evaluates the effectiveness of GitHub Copilot's recently introduced code review…

Software Engineering · Computer Science 2025-09-18 Amena Amro , Manar H. Alalfi

GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing…

Software Engineering · Computer Science 2024-12-13 Daniel Erhabor , Sreeharsha Udayashankar , Meiyappan Nagappan , Samer Al-Kiswany

AI-powered programming assistants are increasingly gaining popularity, with GitHub Copilot alone used by over a million developers worldwide. These tools are far from perfect, however, producing code suggestions that may be incorrect in…

Human-Computer Interaction · Computer Science 2024-02-26 Kasra Ferdowsi , Ruanqianqian Huang , Michael B. James , Nadia Polikarpova , Sorin Lerner

Generative artificial intelligence (AI) facilitates content production and enhances ideation capabilities, which can significantly influence developer productivity and participation in software development. To explore its impact on…

Software Engineering · Computer Science 2026-05-15 Fangchen Song , Ashish Agarwal , Wen Wen

This study examines the impact of GitHub Copilot on a large sample of Copilot users (n=934,533). The analysis shows that users on average accept nearly 30% of the suggested code, leading to increased productivity. Furthermore, our research…

General Economics · Economics 2023-06-28 Thomas Dohmke , Marco Iansiti , Greg Richards

Teaching Computer Science (CS) students how to comprehend and maintain legacy code bases is a critical challenge in software engineering education. While Generative AI (GenAI) assistants like GitHub Copilot improve task completion speed and…

Software Engineering · Computer Science 2026-05-12 Yunhan Qiao , Md Istiak Hossain Shihab , Summit Haque , and Christopher Hundhausen

With the advances in machine learning, there is a growing interest in AI-enabled tools for autocompleting source code. GitHub Copilot has been trained on billions of lines of open source GitHub code, and is one of such tools that has been…

Software Engineering · Computer Science 2023-09-13 Beiqi Zhang , Peng Liang , Xiyu Zhou , Aakash Ahmad , Muhammad Waseem

GitHub's Copilot generates code quickly. We investigate whether it generates good code. Our approach is to identify a set of problems, ask Copilot to generate solutions, and attempt to formally verify these solutions with Dafny. Our formal…

Software Engineering · Computer Science 2022-10-28 Dakota Wong , Austin Kothig , Patrick Lam

Generative Artificial Intelligence (GenAI) has become a central component of many development tools (e.g., GitHub Copilot) that support software practitioners across multiple programming tasks, including code completion, documentation, and…

The software engineering community recently has witnessed widespread deployment of AI programming assistants, such as GitHub Copilot. However, in practice, developers do not accept AI programming assistants' initial suggestions at a high…

Software Engineering · Computer Science 2023-09-19 Jenny T. Liang , Chenyang Yang , Brad A. Myers

Our everyday lives now heavily rely on artificial intelligence (AI) powered large language models (LLMs). Like regular users, programmers are also benefiting from the newest large language models. In response to the critical role that AI…

Software Engineering · Computer Science 2024-11-15 Md Kamrul Siam , Huanying Gu , Jerry Q. Cheng

With the increasing adoption of AI-driven tools in software development, large language models (LLMs) have become essential for tasks like code generation, bug fixing, and optimization. Tools like ChatGPT, GitHub Copilot, and Codeium…

Software Engineering · Computer Science 2024-10-01 Md Sultanul Islam Ovi , Nafisa Anjum , Tasmina Haque Bithe , Md. Mahabubur Rahman , Mst. Shahnaj Akter Smrity

AI-supported programming has arrived, as shown by the introduction and successes of large language models for code, such as Copilot/Codex (Github/OpenAI) and AlphaCode (DeepMind). Above human average performance on programming challenges is…

Software Engineering · Computer Science 2023-03-08 Rohith Pudari , Neil A. Ernst

Motivation. Trust in generative AI programming assistants is a vital attitude that impacts how programmers use those programming assistants. Programmers that are over-trusting may be too reliant on their tools, leading to incorrect or…

Human-Computer Interaction · Computer Science 2025-09-17 Anshul Shah , Thomas Rexin , Elena Tomson , Leo Porter , William G. Griswold , Adalbert Gerald Soosai Raj

In software development there is a constant pressure to produce code faster and faster without compromising on quality. New tools supporting developers are created in response to this demand. Currently a new generation of such solutions is…

Software Engineering · Computer Science 2023-01-13 Mateusz Jaworski , Dariusz Piotrkowski

Powered by recent advances in code-generating models, AI assistants like Github Copilot promise to change the face of programming forever. But what is this new face of programming? We present the first grounded theory analysis of how…

Human-Computer Interaction · Computer Science 2022-11-01 Shraddha Barke , Michael B. James , Nadia Polikarpova

Artificial Intelligence (AI) tools such as GitHub Copilot and ChatGPT are increasingly used in software engineering (SE) for tasks such as code, test, and documentation generation. However, engineers often face uncertainty about when to…

Software Engineering · Computer Science 2026-03-24 Vahid Garousi , Zafar Jafarov , Aytan Mövsümova , Atif Namazov

Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers…

Software Engineering · Computer Science 2024-04-23 Hussein Mozannar , Gagan Bansal , Adam Fourney , Eric Horvitz

[Background/Context] AI assistants like GitHub Copilot are transforming software engineering; several studies have highlighted productivity improvements. However, their impact on code quality, particularly in terms of maintainability,…

Software Engineering · Computer Science 2024-08-21 Markus Borg , Dave Hewett , Donald Graham , Noric Couderc , Emma Söderberg , Luke Church , Dave Farley