English
Related papers

Related papers: Analyzing Prompt Influence on Automated Method Gen…

200 papers

Generative pre-trained models power intelligent software features used by millions of users controlled by developer-written natural language prompts. Despite the impact of prompt-powered software, little is known about its development…

Software Engineering · Computer Science 2025-04-28 Jenny T. Liang , Melissa Lin , Nikitha Rao , Brad A. Myers

Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include…

Computation and Language · Computer Science 2023-10-17 Junxiao Shen , John J. Dudley , Jingyao Zheng , Bill Byrne , Per Ola Kristensson

Large Language Models (LLMs) are revolutionizing the field of computing education with their powerful code-generating capabilities. Traditional pedagogical practices have focused on code writing tasks, but there is now a shift in importance…

Human-Computer Interaction · Computer Science 2023-11-13 Paul Denny , Juho Leinonen , James Prather , Andrew Luxton-Reilly , Thezyrie Amarouche , Brett A. Becker , Brent N. Reeves

Generative AI, such as image generation models and large language models, stands to provide tremendous value to end-user programmers in creative and knowledge workflows. Current research methods struggle to engage end-users in a realistic…

Human-Computer Interaction · Computer Science 2023-12-29 Advait Sarkar , Ian Drosos , Rob Deline , Andrew D. Gordon , Carina Negreanu , Sean Rintel , Jack Williams , Benjamin Zorn

The availability of generative Artificial Intelligence (AI) tools such as ChatGPT or GitHub Copilot is reshaping the way in which software is developed, evolved, and maintained. Oftentimes, developers leave traces of such an usage in…

The field of prompt engineering is becoming an essential phenomenon in artificial intelligence. It is altering how data scientists interact with large language models (LLMs) for analytics applications. This research paper shares empirical…

Digital Libraries · Computer Science 2026-02-03 Snehasish Paul , Rohit Kumar , Laxman Das

Large Language Models (LLMs) have rapidly transformed software development, especially in code generation. However, their inconsistent performance, prone to hallucinations and quality issues, complicates program comprehension and hinders…

Software Engineering · Computer Science 2025-04-21 Antonio Della Porta , Stefano Lambiase , Fabio Palomba

Prompting foundation models (FMs) like large language models (LLMs) have enabled new AI-powered software features (e.g., text summarization) that previously were only possible by fine-tuning FMs. Now, developers are embedding prompts in…

Software Engineering · Computer Science 2025-07-24 Jenny T. Liang , Chenyang Yang , Agnia Sergeyuk , Travis D. Breaux , Brad A. Myers

The rapid advancements in Generative AI (GenAI) tools, such as ChatGPT and GitHub Copilot, are transforming software engineering by automating code generation tasks. While these tools improve developer productivity, they also present…

Software Engineering · Computer Science 2024-09-04 Alyssia Chen , Timothy Huo , Yunhee Nam , Dan Port , Anthony Peruma

The widespread adoption of large language models (LLMs) such as ChatGPT, Gemini, and DeepSeek has significantly changed how people approach tasks in education, professional work, and creative domains. This paper investigates how the…

Human-Computer Interaction · Computer Science 2025-08-29 Rizal Khoirul Anam

Prompt design plays a crucial role in shaping the efficacy of ChatGPT, influencing the model's ability to extract contextually accurate responses. Thus, optimal prompt construction is essential for maximizing the utility and performance of…

Software Engineering · Computer Science 2024-02-08 Saikat Mondal , Suborno Deb Bappon , Chanchal K. Roy

The rapid advancements in large language models (LLMs) have greatly expanded the potential for automated code-related tasks. Two primary methodologies are used in this domain: prompt engineering and fine-tuning. Prompt engineering involves…

Software Engineering · Computer Science 2025-02-21 Jiho Shin , Clark Tang , Tahmineh Mohati , Maleknaz Nayebi , Song Wang , Hadi Hemmati

Motivation. Trust in generative AI programming assistants is a vital attitude that impacts how programmers use those programming assistants. Programmers that are over-trusting may be too reliant on their tools, leading to incorrect or…

Human-Computer Interaction · Computer Science 2025-09-17 Anshul Shah , Thomas Rexin , Elena Tomson , Leo Porter , William G. Griswold , Adalbert Gerald Soosai Raj

Generative AI tools hold promise to increase human productivity. This paper presents results from a controlled experiment with GitHub Copilot, an AI pair programmer. Recruited software developers were asked to implement an HTTP server in…

Software Engineering · Computer Science 2023-02-14 Sida Peng , Eirini Kalliamvakou , Peter Cihon , Mert Demirer

Language models are promising solutions for tackling increasing complex problems. In software engineering, they recently gained attention in code assistants, which generate programs from a natural language task description (prompt). They…

Software Engineering · Computer Science 2025-09-09 Jean-Baptiste Döderlein , Nguessan Hermann Kouadio , Mathieu Acher , Djamel Eddine Khelladi , Benoit Combemale

AI coding assistants are reshaping software development by shifting focus from writing code to formulating prompts. In chat-focused approaches such as vibe coding, prompts become the primary arbiter between human intent and executable…

Software Engineering · Computer Science 2026-03-18 Shalini Chakraborty , Jan-Philipp Steghöfer

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

Powered by recent advances in code-generating models, AI assistants like Github Copilot promise to change the face of programming forever. But what is this new face of programming? We present the first grounded theory analysis of how…

Human-Computer Interaction · Computer Science 2022-11-01 Shraddha Barke , Michael B. James , Nadia Polikarpova

Creativity is a valuable human skill that has long been augmented through both analog and digital tools. Recent progress in generative AI, such as image generation, provides a disruptive technological solution to supporting human creativity…

Human-Computer Interaction · Computer Science 2025-06-05 Daniel Hove Paludan , Julie Fredsgård , Kasper Patrick Bährentz , Ilhan Aslan , Niels van Berkel

This study investigates the reliability of code generation by Large Language Models (LLMs), focusing on identifying and analyzing defects in the generated code. Despite the advanced capabilities of LLMs in automating code generation,…

Software Engineering · Computer Science 2024-08-27 Ali Mohammadi Esfahani , Nafiseh Kahani , Samuel A. Ajila