English
Related papers

Related papers: Exploring the Verifiability of Code Generated by G…

200 papers

This paper aims to explore fundamental questions in the era when AI coding assistants like GitHub Copilot are widely adopted: what do developers truly value and criticize in AI coding assistants, and what does this reveal about their needs…

Software Engineering · Computer Science 2025-08-19 Yunbo Lyu , Zhou Yang , Jieke Shi , Jianming Chang , Yue Liu , David Lo

The rapid adoption of Artificial Intelligence(AI) programming assistants such as GitHub Copilot introduces new challenges in how these software tools address human needs. Many existing evaluation frameworks address technical aspects such as…

Software Engineering · Computer Science 2025-08-07 Soroush Heydari

This study examines the impact of GitHub Copilot on a large sample of Copilot users (n=934,533). The analysis shows that users on average accept nearly 30% of the suggested code, leading to increased productivity. Furthermore, our research…

General Economics · Economics 2023-06-28 Thomas Dohmke , Marco Iansiti , Greg Richards

This study investigates the real-world impact of the generative AI (GenAI) tool GitHub Copilot on developer activity and perceived productivity. We conducted a mixed-methods case study in NAV IT, a large public sector agile organization. We…

Software Engineering · Computer Science 2026-04-30 Viktoria Stray , Elias Goldmann Brandtzæg , Viggo Tellefsen Wivestad , Astri Barbala , Nils Brede Moe

Context: AI-assisted code generation tools have become increasingly prevalent in software engineering, offering the ability to generate code from natural language prompts or partial code inputs. Notable examples of these tools include…

Software Engineering · Computer Science 2023-10-24 Burak Yetiştiren , Işık Özsoy , Miray Ayerdem , Eray Tüzün

Large language models (LLMs), such as ChatGPT and Copilot, are transforming software development by automating code generation and, arguably, enable rapid prototyping, support education, and boost productivity. Therefore, correctness and…

Software Engineering · Computer Science 2024-08-30 Robin Beer , Alexander Feix , Tim Guttzeit , Tamara Muras , Vincent Müller , Maurice Rauscher , Florian Schäffler , Welf Löwe

Artificial intelligence (AI) tools based on large language models have acheived human-level performance on some computer programming tasks. We report several experiments using GPT-4 to generate computer code. These experiments demonstrate…

Artificial Intelligence · Computer Science 2023-04-27 Russell A Poldrack , Thomas Lu , Gašper Beguš

With the increasing utilization of large language models such as ChatGPT during software development, it has become crucial to verify the quality of code content it generates. Recent studies proposed utilizing ChatGPT as both a developer…

Software Engineering · Computer Science 2024-12-02 Xiao Yu , Lei Liu , Xing Hu , Jacky Wai Keung , Jin Liu , Xin Xia

Software quality is an important problem for technology companies, since it substantially impacts the efficiency, usefulness, and maintainability of the final product; hence, code review is a must-do activity for software developers. During…

Social and Information Networks · Computer Science 2022-10-11 Abduljaleel Al-Rubaye , Gita Sukthankar

With the increasing adoption of AI-driven tools in software development, large language models (LLMs) have become essential for tasks like code generation, bug fixing, and optimization. Tools like ChatGPT, GitHub Copilot, and Codeium…

Software Engineering · Computer Science 2024-10-01 Md Sultanul Islam Ovi , Nafisa Anjum , Tasmina Haque Bithe , Md. Mahabubur Rahman , Mst. Shahnaj Akter Smrity

Automatic programming has seen increasing popularity due to the emergence of tools like GitHub Copilot which rely on Large Language Models (LLMs). At the same time, automatically generated code faces challenges during deployment due to…

Software Engineering · Computer Science 2024-05-16 Michael R. Lyu , Baishakhi Ray , Abhik Roychoudhury , Shin Hwei Tan , Patanamon Thongtanunam

Context. AI-based development tools, such as GitHub Copilot, are transforming the software development process by offering real-time code suggestions. These tools promise to improve the productivity by reducing cognitive load and speeding…

Software Engineering · Computer Science 2025-04-10 Emanuela Guglielmi , Venera Arnoudova , Gabriele Bavota , Rocco Oliveto , Simone Scalabrino

AI assistants for coding are on the rise. However one of the reasons developers and companies avoid harnessing their full potential is the questionable security of the generated code. This paper first reviews the current state-of-the-art…

Cryptography and Security · Computer Science 2024-03-20 Jakub Res , Ivan Homoliak , Martin Perešíni , Aleš Smrčka , Kamil Malinka , Petr Hanacek

Recent advancements in large language models, including GPT-4 and its variants, and Generative AI-assisted coding tools like GitHub Copilot, ChatGPT, and Tabnine, have significantly transformed software development. This paper analyzes how…

Software Engineering · Computer Science 2024-11-05 Vijay Joshi , Iver Band

When graduates of computing degree programs enter the software industry, they will most likely join teams working on legacy code bases developed by people other than themselves. In these so-called brownfield software development settings,…

Software Engineering · Computer Science 2025-06-13 Md Istiak Hossain Shihab , Christopher Hundhausen , Ahsun Tariq , Summit Haque , Yunhan Qiao , Brian Mulanda

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to…

Human-Computer Interaction · Computer Science 2025-02-18 Peya Mowar , Yi-Hao Peng , Jason Wu , Aaron Steinfeld , Jeffrey P. Bigham

Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers…

Software Engineering · Computer Science 2024-04-23 Hussein Mozannar , Gagan Bansal , Adam Fourney , Eric Horvitz

As one of the most popular dynamic languages, Python experiences a decrease in readability and maintainability when code smells are present. Recent advancements in Large Language Models have sparked growing interest in AI-enabled tools for…

Software Engineering · Computer Science 2024-08-22 Beiqi Zhang , Peng Liang , Qiong Feng , Yujia Fu , Zengyang Li

Motivation. Trust in generative AI programming assistants is a vital attitude that impacts how programmers use those programming assistants. Programmers that are over-trusting may be too reliant on their tools, leading to incorrect or…

Human-Computer Interaction · Computer Science 2025-09-17 Anshul Shah , Thomas Rexin , Elena Tomson , Leo Porter , William G. Griswold , Adalbert Gerald Soosai Raj

Our everyday lives now heavily rely on artificial intelligence (AI) powered large language models (LLMs). Like regular users, programmers are also benefiting from the newest large language models. In response to the critical role that AI…

Software Engineering · Computer Science 2024-11-15 Md Kamrul Siam , Huanying Gu , Jerry Q. Cheng