English
Related papers

Related papers: Cracking CodeWhisperer: Analyzing Developers' Inte…

200 papers

The use of large language models (LLMs) for automated code generation has emerged as a significant focus within AI research. As these pretrained models continue to evolve, their ability to understand and generate complex code structures has…

Software Engineering · Computer Science 2025-05-06 Nazmus Ashrafi , Salah Bouktif , Mohammed Mediani

With the rise of AI-powered coding assistants, firms and programmers are exploring how to optimize their interaction with them. Research has so far mainly focused on evaluating output quality and productivity gains, leaving aside the…

Human-Computer Interaction · Computer Science 2025-12-24 Charlotte Brandebusemeyer , Tobias Schimmer , Bert Arnrich

Background: The increasing adoption of AI assistants in programming has led to numerous studies exploring their benefits. While developers consistently report significant productivity gains from these tools, empirical measurements often…

Human-Computer Interaction · Computer Science 2025-01-07 Ebtesam Al Haque , Chris Brown , Thomas D. LaToza , Brittany Johnson

The advancement of natural language processing (NLP) has been significantly boosted by the development of transformer-based large language models (LLMs). These models have revolutionized NLP tasks, particularly in code generation, aiding…

Computation and Language · Computer Science 2024-05-27 Dong Huang , Jie M. Zhang , Michael Luck , Qingwen Bu , Yuhao Qing , Heming Cui

Large Language Model (LLM) Agents are advancing quickly, with the increasing leveraging of LLM Agents to assist in development tasks such as code generation. While LLM Agents accelerate code generation, studies indicate they may introduce…

Software Engineering · Computer Science 2026-01-30 Haoming Huang , Pongchai Jaisri , Shota Shimizu , Lingfeng Chen , Sota Nakashima , Gema Rodríguez-Pérez

Large language models (LLMs) are increasingly acting as dynamic conversational interfaces, supporting multi-turn interactions that mimic human-like conversation and facilitate complex tasks like coding. While datasets such as LMSYS-Chat-1M…

Software Engineering · Computer Science 2025-12-15 Binquan Zhang , Li Zhang , Haoyuan Zhang , Fang Liu , Song Wang , Bo Shen , An Fu , Lin Shi

Timely, personalized feedback is essential for students learning programming. LLM-powered tools like ChatGPT offer instant support, but reveal direct answers with code, which may hinder deep conceptual engagement. We developed CodeAid, an…

Human-Computer Interaction · Computer Science 2024-02-27 Majeed Kazemitabaar , Runlong Ye , Xiaoning Wang , Austin Z. Henley , Paul Denny , Michelle Craig , Tovi Grossman

Code synthesis, which requires a deep understanding of complex natural language problem descriptions, generation of code instructions for complex algorithms and data structures, and the successful execution of comprehensive unit tests,…

Computation and Language · Computer Science 2024-05-21 Md. Ashraful Islam , Mohammed Eunus Ali , Md Rizwan Parvez

Generative AI models, specifically large language models (LLMs), have made strides towards the long-standing goal of text-to-code generation. This progress has invited numerous studies of user interaction. However, less is known about the…

Human-Computer Interaction · Computer Science 2024-07-09 Sydney Nguyen , Hannah McLean Babe , Yangtian Zi , Arjun Guha , Carolyn Jane Anderson , Molly Q Feldman

We examine "vibe coding": an emerging programming paradigm where developers primarily write code by interacting with code-generating large language models rather than writing code directly. We present the first empirical study of vibe…

Human-Computer Interaction · Computer Science 2025-10-06 Advait Sarkar , Ian Drosos

While AI programming tools hold the promise of increasing programmers' capabilities and productivity to a remarkable degree, they often exclude users from essential decision-making processes, causing many to effectively "turn off their…

Human-Computer Interaction · Computer Science 2025-06-03 Emmanuel Anaya González , Raven Rothkopf , Sorin Lerner , Nadia Polikarpova

Artificial Intelligence (AI)-driven code generation tools are increasingly used throughout the software development lifecycle to accelerate coding tasks. However, the security of AI-generated code using Large Language Models (LLMs) remains…

Cryptography and Security · Computer Science 2026-03-10 Mohammed Kharma , Soohyeon Choi , Mohammed AlKhanafseh , David Mohaisen

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

Utilizing Large Language Models (LLMs) for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-code LLM. It…

Computation and Language · Computer Science 2024-04-02 Yuzhe Cai , Shaoguang Mao , Wenshan Wu , Zehua Wang , Yaobo Liang , Tao Ge , Chenfei Wu , Wang You , Ting Song , Yan Xia , Jonathan Tien , Nan Duan , Furu Wei

LLMs are now embedded in a wide range of everyday scenarios. However, their inherent hallucinations risk hiding misinformation in fluent responses, raising concerns about overreliance on AI. Detecting overreliance is challenging, as it…

Human-Computer Interaction · Computer Science 2026-02-13 Chang Liu , Qinyi Zhou , Xinjie Shen , Xingyu Bruce Liu , Tongshuang Wu , Xiang 'Anthony' Chen

While revolutionary AI-powered code generation tools have been rising rapidly, we know little about how and how to help software developers form appropriate trust in those AI tools. Through a two-phase formative study, we investigate how…

Human-Computer Interaction · Computer Science 2023-03-30 Ruijia Cheng , Ruotong Wang , Thomas Zimmermann , Denae Ford

To evaluate how developers perform differently in solving programming tasks, i.e., which actions and behaviours are more beneficial to them than others and if there are any specific strategies and behaviours that may indicate good versus…

Software Engineering · Computer Science 2024-03-14 Martin Schröer , Rainer Koschke

Large Language Models (LLMs) have become powerful tools for automated code generation. However, these models often overlook critical security practices, which can result in the generation of insecure code that contains…

Software Engineering · Computer Science 2025-07-01 Hao Yan , Swapneel Suhas Vaidya , Xiaokuan Zhang , Ziyu Yao

Software development agents powered by large language models (LLMs) have shown great promise in automating tasks like environment setup, issue solving, and program repair. Unfortunately, understanding and debugging such agents remain…

Software Engineering · Computer Science 2026-02-09 Robert Hutter , Michael Pradel

Large Language Models (LLMs) are transforming programming practices, offering significant capabilities for code generation activities. While researchers have explored the potential of LLMs in various domains, this paper focuses on their use…

Software Engineering · Computer Science 2026-05-04 Deborah Etsenake , Meiyappan Nagappan