English
Related papers

Related papers: Selecting Source Code Generation Tools Based on Ba…

200 papers

The advent of automation in particular Software Engineering (SE) tasks has transitioned from theory to reality. Numerous scholarly articles have documented the successful application of Artificial Intelligence to address issues in areas…

Software Engineering · Computer Science 2023-05-26 Nathalia Nascimento , Paulo Alencar , Donald Cowan

In recent years, the rise of AI-assisted code-generation tools has significantly transformed software development. While code generators have mainly been used to support conventional software development, their use will be extended to…

Software Engineering · Computer Science 2024-12-17 Simon Torka , Sahin Albayrak

The task of generating code solutions for a given programming problem can benefit from the use of pre-trained language models such as Codex, which can produce multiple diverse samples. However, a major challenge for this task is to select…

Computation and Language · Computer Science 2022-11-24 Bei Chen , Fengji Zhang , Anh Nguyen , Daoguang Zan , Zeqi Lin , Jian-Guang Lou , Weizhu Chen

To support software developers in understanding and maintaining programs, various automatic code summarization techniques have been proposed to generate a concise natural language comment for a given code snippet. Recently, the emergence of…

Software Engineering · Computer Science 2023-05-23 Weisong Sun , Chunrong Fang , Yudu You , Yun Miao , Yi Liu , Yuekang Li , Gelei Deng , Shenghan Huang , Yuchen Chen , Quanjun Zhang , Hanwei Qian , Yang Liu , Zhenyu Chen

Context: Software code reviews are an important part of the development process, leading to better software quality and reduced overall costs. However, finding appropriate code reviewers is a complex and time-consuming task. Goals: In this…

Software Engineering · Computer Science 2018-10-29 Jakub Lipcak , Bruno Rossi

In this study, we assess the efficacy of employing the ChatGPT language model to generate solutions for coding exercises within an undergraduate Java programming course. ChatGPT, a large-scale, deep learning-driven natural language…

Software Engineering · Computer Science 2023-05-24 Eng Lieh Ouh , Benjamin Kok Siew Gan , Kyong Jin Shim , Swavek Wlodkowski

With the increasing utilization of large language models such as ChatGPT during software development, it has become crucial to verify the quality of code content it generates. Recent studies proposed utilizing ChatGPT as both a developer…

Software Engineering · Computer Science 2024-12-02 Xiao Yu , Lei Liu , Xing Hu , Jacky Wai Keung , Jin Liu , Xin Xia

In computer science, students are encouraged to learn various programming languages such as Python, C++, and Java, equipping them with a broad range of technical skills and problem-solving capabilities. Nevertheless, the design of objective…

Programming Languages · Computer Science 2026-03-17 Jongwook Si , Sungyoung Kim

Since its launch in November 2022, ChatGPT has gained popularity among users, especially programmers who use it as a tool to solve development problems. However, while offering a practical solution to programming problems, ChatGPT should be…

Software Engineering · Computer Science 2023-08-08 Phuong T. Nguyen , Juri Di Rocco , Claudio Di Sipio , Riccardo Rubei , Davide Di Ruscio , Massimiliano Di Penta

Evaluating the correctness of code generated by AI is a challenging open problem. In this paper, we propose a fully automated method, named ACCA, to evaluate the correctness of AI-generated code for security purposes. The method uses…

Software Engineering · Computer Science 2024-06-11 Domenico Cotroneo , Alessio Foggia , Cristina Improta , Pietro Liguori , Roberto Natella

Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools,…

Software Engineering · Computer Science 2024-02-23 Muhammad Waseem , Teerath Das , Aakash Ahmad , Peng Liang , Mahdi Fehmideh , Tommi Mikkonen

In recent times, large language models (LLMs) have made significant strides in generating computer code, blurring the lines between code created by humans and code produced by artificial intelligence (AI). As these technologies evolve…

Machine Learning · Computer Science 2024-07-04 Marc Oedingen , Raphael C. Engelhardt , Robin Denz , Maximilian Hammer , Wolfgang Konen

Qualitative research delves deeply into individual complex perspectives on technology and various phenomena. However, a meticulous analysis of qualitative data often requires a significant amount of time, especially during the crucial…

Human-Computer Interaction · Computer Science 2023-10-12 He Zhang , Chuhao Wu , Jingyi Xie , ChanMin Kim , John M. Carroll

AI-based code assistants are increasingly popular as a means to enhance productivity and improve code quality. This study compares four AI-based code assistants, GitHub Copilot, Tabnine, ChatGPT, and Google Bard, in method generation tasks,…

Software Engineering · Computer Science 2024-02-15 Vincenzo Corso , Leonardo Mariani , Daniela Micucci , Oliviero Riganelli

Existing frameworks for evaluating and comparing generative models consider an offline setting, where the evaluator has access to large batches of data produced by the models. However, in practical scenarios, the goal is often to identify…

Machine Learning · Computer Science 2025-03-12 Xiaoyan Hu , Ho-fung Leung , Farzan Farnia

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

Software Engineering · Computer Science 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin

Pre-trained code models have emerged as crucial tools in various code intelligence tasks. However, their effectiveness depends on the quality of the pre-training dataset, particularly the human reference comments, which serve as a bridge…

Software Engineering · Computer Science 2023-12-27 Kang Yang , Xinjun Mao , Shangwen Wang , Tanghaoran Zhang , Bo Lin , Yanlin Wang , Yihao Qin , Zhang Zhang , Xiaoguang Mao

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

Software Engineering · Computer Science 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user…

Machine Learning · Statistics 2022-08-23 Gi-Soo Kim , Hyun-Joon Yang , Jane P. Kim

The increasing demand for programming language education and growing class sizes require immediate and personalized feedback. However, traditional code review methods have limitations in providing this level of feedback. As the capabilities…

Software Engineering · Computer Science 2025-06-23 Lee Dong-Kyu