English
Related papers

Related papers: Evaluating the Code Quality of AI-Assisted Code Ge…

200 papers

While extensive research has focused on ChatGPT in recent years, very few studies have systematically quantified and compared linguistic features between human-written and artificial intelligence (AI)-generated language. This exploratory…

Computation and Language · Computer Science 2026-02-18 Georgios P. Georgiou

Deep Learning-based code generators have seen significant advancements in recent years. Tools such as GitHub Copilot are used by thousands of developers with the main promise of a boost in productivity. However, researchers have recently…

Software Engineering · Computer Science 2025-03-17 Cristina Improta , Rosalia Tufano , Pietro Liguori , Domenico Cotroneo , Gabriele Bavota

GitHub Copilot is transforming software development by automating tasks and boosting productivity through AI driven code generation. In this paper, we conduct a literature survey to synthesize insights on Copilot's impact on productivity…

Software Engineering · Computer Science 2025-05-06 Suresh Babu Nettur , Shanthi Karpurapu , Unnati Nettur , Likhit Sagar Gajja , Sravanthy Myneni , Akhil Dusi

Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both…

Other Quantitative Biology · Quantitative Biology 2024-01-02 Stephen R. Piccolo , Paul Denny , Andrew Luxton-Reilly , Samuel Payne , Perry G. Ridge

Research suggests that providing specific and timely feedback to human tutors enhances their performance. However, it presents challenges due to the time-consuming nature of assessing tutor performance by human evaluators. Large language…

Computation and Language · Computer Science 2023-07-06 Dollaya Hirunyasiri , Danielle R. Thomas , Jionghao Lin , Kenneth R. Koedinger , Vincent Aleven

Many people are interested in ChatGPT since it has become a prominent AIGC model that provides high-quality responses in various contexts, such as software development and maintenance. Misuse of ChatGPT might cause significant issues,…

Digital Libraries · Computer Science 2024-03-22 Arslan Akram

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

Computation and Language · Computer Science 2023-12-21 Elizaveta Kuznetsova , Mykola Makhortykh , Victoria Vziatysheva , Martha Stolze , Ani Baghumyan , Aleksandra Urman

With the rise of AI-powered coding assistants, firms and programmers are exploring how to optimize their interaction with them. Research has so far mainly focused on evaluating output quality and productivity gains, leaving aside the…

Human-Computer Interaction · Computer Science 2025-12-24 Charlotte Brandebusemeyer , Tobias Schimmer , Bert Arnrich

Generative AI and large language models hold great promise in enhancing computing education by powering next-generation educational technologies for introductory programming. Recent works have studied these models for different scenarios…

As generative AI (GAI) tools become increasingly integrated into workplace environments, it is essential to measure their impact on productivity across specific domains. This study evaluates the effects of Microsoft's Security Copilot…

General Economics · Economics 2024-11-13 James Bono , Alec Xu

Qualitative research delves deeply into individual complex perspectives on technology and various phenomena. However, a meticulous analysis of qualitative data often requires a significant amount of time, especially during the crucial…

Human-Computer Interaction · Computer Science 2023-10-12 He Zhang , Chuhao Wu , Jingyi Xie , ChanMin Kim , John M. Carroll

The rapid adoption of large language models (LLMs) like ChatGPT has introduced new dynamics in software development, particularly within pull request workflows. While prior research has examined the quality of AI-generated code, less is…

Software Engineering · Computer Science 2026-04-07 Daniel Ogenrwot , John Businge

Today, AI technology is showing its strengths in almost every industry and walks of life. From text generation, text summarization, chatbots, NLP is being used widely. One such paradigm is automatic code generation. An AI could be…

Artificial Intelligence · Computer Science 2021-08-24 Aishwarya Narasimhan , Krishna Prasad Agara Venkatesha Rao , Veena M B

Context: ChatGPT and other large language models (LLMs) are widely used across healthcare, business, economics, engineering, and software engineering (SE). Despite their popularity, concerns persist about their reliability, especially their…

Software Engineering · Computer Science 2025-04-29 Vahid Garousi

Web crawling is a critical technique for extracting online data, yet it poses challenges due to webpage diversity and anti-scraping mechanisms. This study investigates the integration of generative AI tools Claude AI (Sonnet 3.5) and…

Information Retrieval · Computer Science 2025-02-26 Chau-Jian Huang

ChatGPT is a large language model recently released by the OpenAI company. In this technical report, we explore for the first time the capability of ChatGPT for programming numerical algorithms. Specifically, we examine the capability of…

Machine Learning · Computer Science 2023-04-28 Ali Kashefi , Tapan Mukerji

This study analyzes the performance of eight generative artificial intelligence chatbots -- ChatGPT, Claude, Copilot, DeepSeek, Gemini, Grok, Le Chat, and Perplexity -- in their free versions, in the task of generating academic…

Information Retrieval · Computer Science 2026-05-20 Álvaro Cabezas-Clavijo , Pavel Sidorenko-Bautista

The launch of ChatGPT at the end of 2022 generated large interest into possible applications of artificial intelligence in STEM education and among STEM professions. As a result many questions surrounding the capabilities of generative AI…

Computers and Society · Computer Science 2023-09-29 Matthew Frenkel , Hebah Emara

AI-assisted programming tools are widely adopted, yet their practical utility is often undermined by undesired suggestions that interrupt developer workflows and cause frustration. While existing research has explored developer-AI…

Software Engineering · Computer Science 2026-01-30 Jing Jiang , Liehao Li , Jinyun Hou , Xin Tan , Li Zhang

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to…

Human-Computer Interaction · Computer Science 2025-02-18 Peya Mowar , Yi-Hao Peng , Jason Wu , Aaron Steinfeld , Jeffrey P. Bigham