English
Related papers

Related papers: Measuring the Runtime Performance of C++ Code Writ…

200 papers

AI assistants for coding are on the rise. However one of the reasons developers and companies avoid harnessing their full potential is the questionable security of the generated code. This paper first reviews the current state-of-the-art…

Cryptography and Security · Computer Science 2024-03-20 Jakub Res , Ivan Homoliak , Martin Perešíni , Aleš Smrčka , Kamil Malinka , Petr Hanacek

Context: AI-assisted code generation tools have become increasingly prevalent in software engineering, offering the ability to generate code from natural language prompts or partial code inputs. Notable examples of these tools include…

Software Engineering · Computer Science 2023-10-24 Burak Yetiştiren , Işık Özsoy , Miray Ayerdem , Eray Tüzün

As generative AI (GAI) tools become increasingly integrated into workplace environments, it is essential to measure their impact on productivity across specific domains. This study evaluates the effects of Microsoft's Security Copilot…

General Economics · Economics 2024-11-13 James Bono , Alec Xu

AI-based code assistants are increasingly popular as a means to enhance productivity and improve code quality. This study compares four AI-based code assistants, GitHub Copilot, Tabnine, ChatGPT, and Google Bard, in method generation tasks,…

Software Engineering · Computer Science 2024-02-15 Vincenzo Corso , Leonardo Mariani , Daniela Micucci , Oliviero Riganelli

Our everyday lives now heavily rely on artificial intelligence (AI) powered large language models (LLMs). Like regular users, programmers are also benefiting from the newest large language models. In response to the critical role that AI…

Software Engineering · Computer Science 2024-11-15 Md Kamrul Siam , Huanying Gu , Jerry Q. Cheng

Powered by recent advances in code-generating models, AI assistants like Github Copilot promise to change the face of programming forever. But what is this new face of programming? We present the first grounded theory analysis of how…

Human-Computer Interaction · Computer Science 2022-11-01 Shraddha Barke , Michael B. James , Nadia Polikarpova

Software engineering research has always being concerned with the improvement of code completion approaches, which suggest the next tokens a developer will likely type while coding. The release of GitHub Copilot constitutes a big step…

Artificial intelligence (AI) assistants such as GitHub Copilot and ChatGPT, built on large language models like GPT-4, are revolutionizing how programming tasks are performed, raising questions about whether code is authored by generative…

Software Engineering · Computer Science 2024-03-08 Oseremen Joy Idialu , Noble Saji Mathews , Rungroj Maipradit , Joanne M. Atlee , Mei Nagappan

GitHub Copilot is an AI-enabled tool that automates program synthesis. It has gained significant attention since its launch in 2021. Recent studies have extensively examined Copilot's capabilities in various programming tasks, as well as…

Software Engineering · Computer Science 2024-02-05 Kei Koyanagi , Dong Wang , Kotaro Noguchi , Masanari Kondo , Alexander Serebrenik , Yasutaka Kamei , Naoyasu Ubayashi

Recent developments in deep learning have resulted in code-generation models that produce source code from natural language and code-based prompts with high accuracy. This is likely to have profound effects in the classroom, where novices…

The increasing use of large language model (LLM)-powered code generation tools, such as GitHub Copilot, is transforming software engineering practices. This paper investigates how developers validate and repair code generated by Copilot and…

Software Engineering · Computer Science 2024-05-28 Ningzhi Tang , Meng Chen , Zheng Ning , Aakash Bansal , Yu Huang , Collin McMillan , Toby Jia-Jun Li

Knowledge transfer is fundamental to human collaboration and is therefore common in software engineering. Pair programming is a prominent instance. With the rise of AI coding assistants, developers now not only work with human partners but…

Software Engineering · Computer Science 2025-06-06 Alisa Welter , Niklas Schneider , Tobias Dick , Kallistos Weis , Christof Tinnes , Marvin Wyrich , Sven Apel

Recent In-IDE AI coding assistant tools (ACATs) like GitHub Copilot have significantly impacted developers' coding habits. While some studies have examined their effectiveness, there lacks in-depth investigation into the actual assistance…

Software Engineering · Computer Science 2024-04-25 Xin Tan , Xiao Long , Xianjun Ni , Yinghao Zhu , Jing Jiang , Li Zhang

Recent advancements in large language models, including GPT-4 and its variants, and Generative AI-assisted coding tools like GitHub Copilot, ChatGPT, and Tabnine, have significantly transformed software development. This paper analyzes how…

Software Engineering · Computer Science 2024-11-05 Vijay Joshi , Iver Band

Generative artificial intelligence (AI) facilitates content production and enhances ideation capabilities, which can significantly influence developer productivity and participation in software development. To explore its impact on…

Software Engineering · Computer Science 2026-05-15 Fangchen Song , Ashish Agarwal , Wen Wen

Background: Recent advancements in large language models have motivated the practical use of such models in code generation and program synthesis. However, little is known about the effects of such tools on code readability and visual…

Software Engineering · Computer Science 2022-09-02 Naser Al Madi

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to…

Human-Computer Interaction · Computer Science 2025-02-18 Peya Mowar , Yi-Hao Peng , Jason Wu , Aaron Steinfeld , Jeffrey P. Bigham

The increasing use of Large Language Models (LLMs) in software development has garnered significant attention from researchers evaluating the capabilities and limitations of LLMs for code generation. However, much of the research focuses on…

Software Engineering · Computer Science 2025-11-10 Xiao Yu , Lei Liu , Xing Hu , Jin Liu , Xin Xia

The availability of generative Artificial Intelligence (AI) tools such as ChatGPT or GitHub Copilot is reshaping the way in which software is developed, evolved, and maintained. Oftentimes, developers leave traces of such an usage in…

This study examines the impact of GitHub Copilot on a large sample of Copilot users (n=934,533). The analysis shows that users on average accept nearly 30% of the suggested code, leading to increased productivity. Furthermore, our research…

General Economics · Economics 2023-06-28 Thomas Dohmke , Marco Iansiti , Greg Richards