English
Related papers

Related papers: Evaluating GPT's Programming Capability through Co…

200 papers

Generative AI's rapid advancement sparks interest in its cognitive abilities, especially given its capacity for tasks like language understanding and code generation. This study explores how several recent GenAI models perform on the Clock…

Artificial Intelligence · Computer Science 2024-10-16 Isaac R. Galatzer-Levy , Jed McGiffin , David Munday , Xin Liu , Danny Karmon , Ilia Labzovsky , Rivka Moroshko , Amir Zait , Daniel McDuff

Generative artificial intelligence (GenAI) offers new possibilities for generating personalized programming exercises, addressing the need for individual practice. However, the task quality along with the student perspective on such…

Software Engineering · Computer Science 2025-09-15 Sven Jacobs , Henning Peters , Steffen Jaschke , Natalie Kiesler

Transformer-based models have demonstrated state-of-the-art performance in many intelligent coding tasks such as code comment generation and code completion. Previous studies show that deep learning models are sensitive to the input…

Software Engineering · Computer Science 2025-06-10 Yaoxian Li , Shiyi Qi , Cuiyun Gao , Yun Peng , David Lo , Zenglin Xu , Michael R. Lyu

This paper presents a novel approach named Persona-Grouping-Intelligence (PGI), which has been crafted to tackle the challenges posed by GPT models when applied to real-world business issues. PGI leverages the inherent capabilities of the…

Artificial Intelligence · Computer Science 2023-08-28 Aline Ioste

Regulators in the US and EU are using thresholds based on training compute--the number of computational operations used in training--to identify general-purpose artificial intelligence (GPAI) models that may pose risks of large-scale…

Computers and Society · Computer Science 2024-08-07 Lennart Heim , Leonie Koessler

The utilisation of AI-driven tools, notably ChatGPT, within academic research is increasingly debated from several perspectives including ease of implementation, and potential enhancements in research efficiency, as against ethical concerns…

Human-Computer Interaction · Computer Science 2024-05-16 Aleksei Turobov , Diane Coyle , Verity Harding

Spatial intelligence is important in Architecture, Construction, Science, Technology, Engineering, and Mathematics (STEM), and Medicine. Understanding three-dimensional (3D) spatial rotations can involve verbal descriptions and visual or…

Artificial Intelligence · Computer Science 2025-03-18 Uttamasha Monjoree , Wei Yan

Large language models (LLMs) and prompt engineering hold significant potential for advancing computer programming education through personalized instruction. This paper explores this potential by investigating three critical research…

Artificial Intelligence · Computer Science 2024-07-09 Tianyu Wang , Nianjun Zhou , Zhixiong Chen

In an era of widespread influence of Natural Language Processing (NLP), there have been multiple research efforts to supplant traditional manual coding techniques with automated systems capable of generating solutions autonomously. With…

Computation and Language · Computer Science 2024-12-10 Namrata Das , Rakshya Panta , Neelam Karki , Ruchi Manandhar , Dinesh Baniya Kshatri

Test Driven Development (TDD) is one of the major practices of Extreme Programming for which incremental testing and refactoring trigger the code development. TDD has limited adoption in the industry, as it requires more code to be…

Software Engineering · Computer Science 2025-01-15 Moritz Mock , Jorge Melegati , Barbara Russo

Grading programming assignments is a labor-intensive and time-consuming process that demands careful evaluation across multiple dimensions of the code. To overcome these challenges, automated grading systems are leveraged to enhance…

Software Engineering · Computer Science 2025-03-28 Mohammad Akyash , Kimia Zamiri Azar , Hadi Mardani Kamali

The dawn of Generative Artificial Intelligence (GAI), characterized by advanced models such as Generative Pre-trained Transformers (GPT) and other Large Language Models (LLMs), has been pivotal in reshaping the field of data analysis,…

Cryptography and Security · Computer Science 2024-05-06 Shivani Metta , Isaac Chang , Jack Parker , Michael P. Roman , Arturo F. Ehuan

Large Language Models (LLMs) are advanced Artificial Intelligence (AI) systems that have undergone extensive training using large datasets in order to understand and produce language that closely resembles that of humans. These models have…

Software Engineering · Computer Science 2023-08-10 Alessio Buscemi

Over the eight months since its release, ChatGPT and its underlying model, GPT3.5, have garnered massive attention, due to their potent mix of capability and accessibility. While a niche-industry of papers have emerged examining the scope…

Computation and Language · Computer Science 2024-02-07 David Bayani

The increasing demand for digital literacy and artificial intelligence (AI) fluency in the workforce has highlighted the need for scalable, efficient programming instruction. This study evaluates the effectiveness of integrating generative…

Computers and Society · Computer Science 2025-05-28 Ian McCulloh , Pedro Rodriguez , Srivaths Kumar , Manu Gupta , Viplove Raj Sharma , Benjamin Johnson , Anthony N. Johnson

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Large language models such as Open AI's Generative Pre-trained Transformer (GPT) models are proficient at answering questions, but their knowledge is confined to the information present in their training data. This limitation renders them…

Computation and Language · Computer Science 2023-08-24 Saba Rahimi , Tucker Balch , Manuela Veloso

While programming is one of the most broadly applicable skills in modern society, modern machine learning models still cannot code solutions to basic problems. Despite its importance, there has been surprisingly little work on evaluating…

In recent years, the rise of AI-assisted code-generation tools has significantly transformed software development. While code generators have mainly been used to support conventional software development, their use will be extended to…

Software Engineering · Computer Science 2024-12-17 Simon Torka , Sahin Albayrak

We examined the efficacy of AI-assisted learning in an introductory programming course at the university level by using a GPT-4 model to generate personalized hints for compiler errors within a platform for automated assessment of…

Software Engineering · Computer Science 2024-07-26 Maciej Pankiewicz , Ryan S. Baker