English
Related papers

Related papers: Grounded Copilot: How Programmers Interact with Co…

200 papers

AI assistance tools such as ChatGPT, Copilot, and Gemini have dramatically impacted the nature of software development in recent years. Numerous studies have studied the positive benefits that practitioners have achieved from using these…

Software Engineering · Computer Science 2024-06-26 Ze Shi Li , Nowshin Nawar Arony , Ahmed Musa Awon , Daniela Damian , Bowen Xu

GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing…

Software Engineering · Computer Science 2024-12-13 Daniel Erhabor , Sreeharsha Udayashankar , Meiyappan Nagappan , Samer Al-Kiswany

Generative AI (GenAI) has fundamentally changed how knowledge workers, such as software developers, solve tasks and collaborate to build software products. Introducing innovative tools like ChatGPT and Copilot has created new opportunities…

Software Engineering · Computer Science 2024-05-06 Rasmus Ulfsnes , Nils Brede Moe , Viktoria Stray , Marianne Skarpen

This paper presents a comprehensive evaluation of GitHub Copilot's deployment and impact on developer productivity at Zoominfo, a leading Go-To-Market (GTM) Intelligence Platform. We describe our systematic four-phase approach to evaluating…

Software Engineering · Computer Science 2025-01-24 Gal Bakal , Ali Dasdan , Yaniv Katz , Michael Kaufman , Guy Levin

With generative AI becoming widespread, the existence of AI-based programming assistants for developers is no surprise. Developers increasingly use them for their work, including generating code to fulfil the data protection requirements…

Software Engineering · Computer Science 2025-06-17 Kashumi Madampe , John Grundy , Nalin Arachchilage

AI assistants for coding are on the rise. However one of the reasons developers and companies avoid harnessing their full potential is the questionable security of the generated code. This paper first reviews the current state-of-the-art…

Cryptography and Security · Computer Science 2024-03-20 Jakub Res , Ivan Homoliak , Martin Perešíni , Aleš Smrčka , Kamil Malinka , Petr Hanacek

The advent of Foundation Models (FMs) and AI-powered copilots has transformed the landscape of software development, offering unprecedented code completion capabilities and enhancing developer productivity. However, the current task-driven…

Software Engineering · Computer Science 2024-04-17 Ahmed E. Hassan , Gustavo A. Oliva , Dayi Lin , Boyuan Chen , Zhen Ming , Jiang

The increasing use of large language model (LLM)-powered code generation tools, such as GitHub Copilot, is transforming software engineering practices. This paper investigates how developers validate and repair code generated by Copilot and…

Software Engineering · Computer Science 2024-05-28 Ningzhi Tang , Meng Chen , Zheng Ning , Aakash Bansal , Yu Huang , Collin McMillan , Toby Jia-Jun Li

This paper aims to evaluate GitHub Copilot's generated code quality based on the LeetCode problem set using a custom automated framework. We evaluate the results of Copilot for 4 programming languages: Java, C++, Python3 and Rust. We aim to…

Software Engineering · Computer Science 2024-06-18 Ilja Siroš , Dave Singelée , Bart Preneel

This study investigates the real-world impact of the generative AI (GenAI) tool GitHub Copilot on developer activity and perceived productivity. We conducted a mixed-methods case study in NAV IT, a large public sector agile organization. We…

Software Engineering · Computer Science 2026-04-30 Viktoria Stray , Elias Goldmann Brandtzæg , Viggo Tellefsen Wivestad , Astri Barbala , Nils Brede Moe

Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support. While this holds clear promise, their influence on students' metacognitive processes remains underexplored.…

Human-Computer Interaction · Computer Science 2025-11-07 Boxuan Ma , Huiyong Li , Gen Li , Li Chen , Cheng Tang , Yinjie Xie , Chenghao Gu , Atsushi Shimada , Shin'ichi Konomi

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to…

Human-Computer Interaction · Computer Science 2025-02-18 Peya Mowar , Yi-Hao Peng , Jason Wu , Aaron Steinfeld , Jeffrey P. Bigham

The study on GitHub Copilot by GovTech Singapore's Engineering Productivity Programme (EPP) reveals significant potential for AI Code Assistant tools to boost developer productivity and improve application quality in the public sector.…

Software Engineering · Computer Science 2024-09-27 Kevin KB Ng , Liyana Fauzi , Leon Leow , Jaren Ng

IDE-integrated AI coding assistants, which operate conversationally within developers' working codebases with access to project context and multi-file editing, are rapidly reshaping software development. However, empirical investigation of…

Software Engineering · Computer Science 2026-04-02 Ningzhi Tang , Chaoran Chen , Zihan Fang , Gelei Xu , Maria Dhakal , Yiyu Shi , Collin McMillan , Yu Huang , Toby Jia-Jun Li

Generative AI is changing the way developers interact with software systems, providing services that can produce and deliver new content, crafted to satisfy the actual needs of developers. For instance, developers can ask for new code…

Software Engineering · Computer Science 2024-02-15 Ionut Daniel Fagadau , Leonardo Mariani , Daniela Micucci , Oliviero Riganelli

Context. AI-based development tools, such as GitHub Copilot, are transforming the software development process by offering real-time code suggestions. These tools promise to improve the productivity by reducing cognitive load and speeding…

Software Engineering · Computer Science 2025-04-10 Emanuela Guglielmi , Venera Arnoudova , Gabriele Bavota , Rocco Oliveto , Simone Scalabrino

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

Recent advancements in generative artificial intelligence (GenAI), particularly large language models, have introduced new possibilities for software development practices. In our paper we investigate the emerging Vibe Coding (VC) paradigm…

Software Engineering · Computer Science 2025-10-16 Kevin Krings , Nino S. Bohn , Thomas Ludwig

Large language models, such as OpenAI's codex and Deepmind's AlphaCode, can generate code to solve a variety of problems expressed in natural language. This technology has already been commercialised in at least one widely-used programming…

Human-Computer Interaction · Computer Science 2022-10-18 Advait Sarkar , Andrew D. Gordon , Carina Negreanu , Christian Poelitz , Sruti Srinivasa Ragavan , Ben Zorn

Code-generating Artificial Intelligence has gained popularity within both professional and educational programming settings over the past several years. While research and pedagogy are beginning to cope with this change, computing students…

Human-Computer Interaction · Computer Science 2026-04-21 Nicholas Gardella , James Prather , Juho Leinonen , Paul Denny , Raymond Pettit , Sara L. Riggs