English
Related papers

Related papers: Can Generative Pre-trained Transformers (GPT) Pass…

200 papers

The rapid advancement of generative Artificial Intelligence (AI) technologies, particularly Generative Pre-trained Transformer (GPT) models such as ChatGPT, has the potential to significantly impact cybersecurity. In this study, we…

Computers and Society · Computer Science 2024-03-19 Raza Nowrozy , David Jam

Generative AI (GenAI) tools such as ChatGPT now provide novice programmers with instant, personalized support and are reshaping computing education. While a growing body of work examines AI's immediate impacts, longitudinal evidence remains…

Human-Computer Interaction · Computer Science 2026-03-25 Boxuan Ma , Huiyong Li , Gen Li , Li Chen , Cheng Tang , Atsushi Shimada , Shin'ichi Konomi

With recent advances in generative AI, conversational models like ChatGPT have become feasible candidates for TAs. We investigate the practicality of using generative AI as TAs in introductory programming education by examining novice…

Human-Computer Interaction · Computer Science 2023-09-20 Changyoon Lee , Junho Myung , Jieun Han , Jiho Jin , Alice Oh

This work presents a generative pre-trained transformer (GPT) designed for modeling financial time series. The GPT functions as an order generation engine within a discrete event simulator, enabling realistic replication of limit order book…

Trading and Market Microstructure · Quantitative Finance 2024-11-26 Aaron Wheeler , Jeffrey D. Varner

Generative Pre-trained Transformers (GPTs) have recently been scaled to unprecedented sizes in the history of machine learning. These models, solely trained on the language modeling objective, have been shown to exhibit outstanding few-shot…

Computation and Language · Computer Science 2021-08-31 Jordi Armengol-Estapé , Ona de Gibert Bonet , Maite Melero

This study investigates how LLMs, specifically GPT-3.5 and GPT-4, can develop tailored questions for Grade 9 math, aligning with active learning principles. By utilizing an iterative method, these models adjust questions based on difficulty…

Computation and Language · Computer Science 2024-06-21 Hamdireza Rouzegar , Masoud Makrehchi

Existing generative pre-trained language models (e.g., GPT) focus on modeling the language structure and semantics of general texts. However, those models do not consider the numerical properties of numbers and cannot perform robustly on…

Computation and Language · Computer Science 2021-10-14 Zhihua Jin , Xin Jiang , Xingbo Wang , Qun Liu , Yong Wang , Xiaozhe Ren , Huamin Qu

We evaluated the capability of generative pre-trained transformers~(GPT-4) in analysis of textual data in tasks that require highly specialized domain expertise. Specifically, we focused on the task of analyzing court opinions to interpret…

Computation and Language · Computer Science 2023-10-05 Jaromir Savelka , Kevin D. Ashley , Morgan A Gray , Hannes Westermann , Huihui Xu

In this study, we assess the efficacy of employing the ChatGPT language model to generate solutions for coding exercises within an undergraduate Java programming course. ChatGPT, a large-scale, deep learning-driven natural language…

Software Engineering · Computer Science 2023-05-24 Eng Lieh Ouh , Benjamin Kok Siew Gan , Kyong Jin Shim , Swavek Wlodkowski

We study Transformers on the task \emph{program trace generation} (PTG), where models produce step-by-step execution traces for synthetic programs. Unlike existing algorithmic problems, PTG externalizes reasoning through long traces where…

Computation and Language · Computer Science 2025-09-30 Simeng Sun

In recent years, advancements in artificial intelligence (AI) have led to the development of large language models like GPT-4, demonstrating potential applications in various fields, including education. This study investigates the…

Computers and Society · Computer Science 2023-04-25 Vinay Pursnani , Yusuf Sermet , Ibrahim Demir

Generative Artificial Intelligence (AI) has enabled the development of sophisticated models that are capable of producing high-caliber text, images, and other outputs through the utilization of large pre-trained models. Nevertheless,…

Computation and Language · Computer Science 2023-02-14 Jinlan Fu , See-Kiong Ng , Zhengbao Jiang , Pengfei Liu

The launch of ChatGPT at the end of 2022 generated large interest into possible applications of artificial intelligence in STEM education and among STEM professions. As a result many questions surrounding the capabilities of generative AI…

Computers and Society · Computer Science 2023-09-29 Matthew Frenkel , Hebah Emara

Large language models (LLMs) and prompt engineering hold significant potential for advancing computer programming education through personalized instruction. This paper explores this potential by investigating three critical research…

Artificial Intelligence · Computer Science 2024-07-09 Tianyu Wang , Nianjun Zhou , Zhixiong Chen

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

The size and complexity of software applications is increasing at an accelerating pace. Source code repositories (along with their dependencies) require vast amounts of labor to keep them tested, maintained, and up to date. As the…

Software Engineering · Computer Science 2024-06-14 Ivan R. Ivanov , Joachim Meyer , Aiden Grossman , William S. Moses , Johannes Doerfert

Generative, pre-trained transformers (GPTs, a.k.a. "Foundation Models") have reshaped natural language processing (NLP) through their versatility in diverse downstream tasks. However, their potential extends far beyond NLP. This paper…

Machine Learning · Computer Science 2023-06-22 Matthew B. A. McDermott , Bret Nestor , Peniel Argaw , Isaac Kohane

Generative models are now capable of producing natural language text that is, in some cases, comparable in quality to the text produced by people. In the computing education context, these models are being used to generate code, code…

Human-Computer Interaction · Computer Science 2023-08-09 Cynthia Zastudil , Magdalena Rogalska , Christine Kapp , Jennifer Vaughn , Stephen MacNeil