English
Related papers

Related papers: Using LLMs in Software Design: An Empirical Study …

200 papers

Large Language Models (LLMs) have taken the world by storm, demonstrating their ability not only to automate tedious tasks, but also to show some degree of proficiency in completing software engineering tasks. A key concern with LLMs is…

Software Engineering · Computer Science 2025-01-15 Takashi Nakano , Kazumasa Shimari , Raula Gaikovina Kula , Christoph Treude , Marc Cheong , Kenichi Matsumoto

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

Recent development of large language models (LLMs), such as ChatGPT has been widely applied to a wide range of software engineering tasks. Many papers have reported their analysis on the potential advantages and limitations of ChatGPT for…

Software Engineering · Computer Science 2023-09-18 Priyanka Mudgal , Rita Wouhaybi

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Generative Large Language Models (gLLMs), such as ChatGPT, are increasingly being used in communication research for content analysis. Studies show that gLLMs can outperform both crowd workers and trained coders, such as research…

Artificial Intelligence · Computer Science 2025-10-29 Daria Kravets-Meinke , Hannah Schmid-Petri , Sonja Niemann , Ute Schmid

Large Language Models (LLMs) are advanced Artificial Intelligence (AI) systems that have undergone extensive training using large datasets in order to understand and produce language that closely resembles that of humans. These models have…

Software Engineering · Computer Science 2023-08-10 Alessio Buscemi

Large Language Models (LLMs), such as ChatGPT, are increasingly leveraged for generating both traditional software code and spreadsheet logic. Despite their impressive generative capabilities, these models frequently exhibit critical issues…

Software Engineering · Computer Science 2025-11-27 Simon Thorne , Advait Sarkar

Large Language Models (LLMs), such as ChatGPT, have become widely popular and widely used in various software engineering tasks such as refactoring, testing, code review, and program comprehension. Although recent studies have examined the…

Software Engineering · Computer Science 2025-09-11 Eman Abdullah AlOmar , Luo Xu , Sofia Martinez , Anthony Peruma , Mohamed Wiem Mkaouer , Christian D. Newman , Ali Ouni

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

Large language models (LLMs) with chat-based capabilities, such as ChatGPT, are widely used in various workflows. However, due to a limited understanding of these large-scale models, users struggle to use this technology and experience…

Human-Computer Interaction · Computer Science 2024-06-21 Yoonsu Kim , Jueon Lee , Seoyoung Kim , Jaehyuk Park , Juho Kim

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

Artificial Intelligence · Computer Science 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

The use of large language models (LLMs) for qualitative analysis is gaining attention in various fields, including software engineering, where qualitative methods are essential for understanding human and social factors. This study aimed to…

Software Engineering · Computer Science 2025-03-11 Matheus de Morais Leça , Lucas Valença , Reydne Santos , Ronnie de Souza Santos

Large Language Models (LLMs) have emerged as coding assistants, capable of generating source code from natural language prompts. With the increasing adoption of LLMs in software development, academic research and industry based projects are…

Large language models (LLMs) like ChatGPT (i.e., gpt-3.5-turbo and gpt-4) exhibited remarkable advancement in a range of software engineering tasks associated with source code such as code review and code generation. In this paper, we…

Software Engineering · Computer Science 2023-10-17 Michael Fu , Chakkrit Tantithamthavorn , Van Nguyen , Trung Le

Large Language Models (LLMs) are becoming increasingly competent across various domains, educators are showing a growing interest in integrating these LLMs into the learning process. Especially in software engineering, LLMs have…

Software Engineering · Computer Science 2025-02-04 Agrawal Naman , Ridwan Shariffdeen , Guanlin Wang , Sanka Rasnayaka , Ganesh Neelakanta Iyer

The recent, widespread availability of Large Language Models (LLMs) like ChatGPT and GitHub Copilot may impact introductory programming courses (CS1) both in terms of what should be taught and how to teach it. Indeed, recent research has…

Computers and Society · Computer Science 2024-06-25 Annapurna Vadaparty , Daniel Zingaro , David H. Smith , Mounika Padala , Christine Alvarado , Jamie Gorson Benario , Leo Porter

With the rapid advance of machine learning (ML) technology, large language models (LLMs) are increasingly explored as an intelligent tool to generate program code from natural language specifications. However, existing evaluations of LLMs…

Software Engineering · Computer Science 2024-06-19 Tanha Miah , Hong Zhu

\textit{Background:} The use of large language models in software testing is growing fast as they support numerous tasks, from test case generation to automation, and documentation. However, their adoption often relies on informal…

Software Engineering · Computer Science 2025-10-21 Maria Deolinda Santana , Cleyton Magalhaes , Ronnie de Souza Santos

Large Language Models (LLMs) have seen rapid advancements in recent years, with models like ChatGPT and DeepSeek, showcasing their remarkable capabilities across diverse domains. While substantial research has been conducted on LLMs in…

Machine Learning · Computer Science 2026-03-31 Licheng Zhang , Bach Le , Naveed Akhtar , Siew-Kei Lam , Tuan Ngo

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

Software Engineering · Computer Science 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu