中文
相关论文

相关论文: Assessing AI-Based Code Assistants in Method Gener…

200 篇论文

Question-and-answer platforms such as Stack Overflow are an important way for software developers to share and retrieve knowledge. However, reusing poorly understood code can lead to serious problems, such as bugs or security…

软件工程 · 计算机科学 2025-09-16 Kathrin Figl , Maria Kirchner , Sebastian Baltes , Michael Felderer

As a research-product hybrid group in AI for Software Engineering (AI4SE), we present four key takeaways from our experience developing in-IDE AI coding assistants. AI coding assistants should set clear expectations for usage, integrate…

软件工程 · 计算机科学 2024-03-22 Khanh Nghiem , Anh Minh Nguyen , Nghi D. Q. Bui

With their exceptional natural language processing capabilities, tools based on Large Language Models (LLMs) like ChatGPT and Co-Pilot have swiftly become indispensable resources in the software developer's toolkit. While recent studies…

AI-powered coding assistants, like GitHub Copilot, are increasingly used to boost developers' productivity. However, their output quality hinges on the contextual richness of the prompts. Meanwhile, gaze behaviour carries rich cognitive…

人机交互 · 计算机科学 2025-11-12 Yasmine Elfares , Gül Çalikli , Mohamed Khamis

Large language models (LLMs), such as ChatGPT and Copilot, are transforming software development by automating code generation and, arguably, enable rapid prototyping, support education, and boost productivity. Therefore, correctness and…

Code-generating Artificial Intelligence has gained popularity within both professional and educational programming settings over the past several years. While research and pedagogy are beginning to cope with this change, computing students…

人机交互 · 计算机科学 2026-04-21 Nicholas Gardella , James Prather , Juho Leinonen , Paul Denny , Raymond Pettit , Sara L. Riggs

With the advances in machine learning, there is a growing interest in AI-enabled tools for autocompleting source code. GitHub Copilot has been trained on billions of lines of open source GitHub code, and is one of such tools that has been…

软件工程 · 计算机科学 2023-09-13 Beiqi Zhang , Peng Liang , Xiyu Zhou , Aakash Ahmad , Muhammad Waseem

Background: AI-powered code generation, fueled by Large Language Models (LLMs), is revolutionizing software development. Models like OpenAI's Codex and GPT-4, alongside DeepSeek, leverage vast code and natural language datasets. However,…

软件工程 · 计算机科学 2025-02-27 Md Motaleb Hossen Manik

This study investigates the real-world impact of the generative AI (GenAI) tool GitHub Copilot on developer activity and perceived productivity. We conducted a mixed-methods case study in NAV IT, a large public sector agile organization. We…

Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools,…

软件工程 · 计算机科学 2024-02-23 Muhammad Waseem , Teerath Das , Aakash Ahmad , Peng Liang , Mahdi Fehmideh , Tommi Mikkonen

Programming is essential to modern scientific research, yet most scientists report inadequate training for the software development their work demands. Generative AI tools capable of code generation may support scientific programmers, but…

软件工程 · 计算机科学 2026-04-13 Gabrielle O'Brien , Alexis Parker , Nasir Eisty , Jeffrey Carver

Developers now have access to a growing array of increasingly autonomous AI tools for software development. While many studies examine copilots that provide chat assistance or code completions, evaluations of coding agents -- which can…

软件工程 · 计算机科学 2025-09-16 Valerie Chen , Ameet Talwalkar , Robert Brennan , Graham Neubig

Evaluating the correctness of code generated by AI is a challenging open problem. In this paper, we propose a fully automated method, named ACCA, to evaluate the correctness of AI-generated code for security purposes. The method uses…

软件工程 · 计算机科学 2024-06-11 Domenico Cotroneo , Alessio Foggia , Cristina Improta , Pietro Liguori , Roberto Natella

As software development practices increasingly adopt AI-powered tools, ensuring that such tools can support secure coding has become critical. This study evaluates the effectiveness of GitHub Copilot's recently introduced code review…

软件工程 · 计算机科学 2025-09-18 Amena Amro , Manar H. Alalfi

Low-code programming allows citizen developers to create programs with minimal coding effort, typically via visual (e.g. drag-and-drop) interfaces. In parallel, recent AI-powered tools such as Copilot and ChatGPT generate programs from…

软件工程 · 计算机科学 2023-06-01 Nikitha Rao , Jason Tsay , Kiran Kate , Vincent J. Hellendoorn , Martin Hirzel

GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this…

软件工程 · 计算机科学 2024-02-15 Tao Xiao , Hideaki Hata , Christoph Treude , Kenichi Matsumoto

Systems like ChatGPT and Claude assist billions through proactive dialogue-offering unsolicited, task-relevant information. Drawing on Cognitive Load Theory, we study how cognitive load shapes performance in AI-assisted knowledge work. We…

人工智能 · 计算机科学 2026-03-10 Brandon Lepine , Juho Kim , Pamela Mishkin , Matthew Beane

AI-powered software tools are widely used to assist software engineers. However, there is still a need to understand the productivity benefits of such tools for software engineers. In addition to short-term benefits, there is a question of…

软件工程 · 计算机科学 2025-06-24 Giorgio Amasanti , Jasmin Jahic

AI coding assistants have become prolific in recent years. Through a longitudinal mixed-methods investigation, we examined how professional software engineers perceive the effects of AI coding assistants in regard to task focus, developer…

软件工程 · 计算机科学 2026-05-25 Annie Vella , Kelly Blincoe

Software engineers have historically relied on human-powered Q&A platforms like Stack Overflow (SO) as coding aids. With the rise of generative AI, developers have started to adopt AI chatbots, such as ChatGPT, in their software development…

人机交互 · 计算机科学 2025-02-24 Jiachen Li , Elizabeth Mynatt , Varun Mishra , Jonathan Bell