English
Related papers

Related papers: Generative AI for Programming Education: Benchmark…

200 papers

Generative AI tools such as ChatGPT have recently gained significant attention in higher education. This study aims to understand how universities establish policies regarding the use of AI tools and explore the factors that influence their…

Computers and Society · Computer Science 2023-05-31 Ping Xiao , Yuanyuan Chen , Weining Bao

AI-driven chatbots such as ChatGPT have caused a tremendous hype lately. For BPM applications, several applications for AI-driven chatbots have been identified to be promising to generate business value, including explanation of process…

Computation and Language · Computer Science 2024-01-19 Nataliia Klievtsova , Janik-Vasily Benzin , Timotheus Kampik , Juergen Mangler , Stefanie Rinderle-Ma

Generative Artificial Intelligence (GAI) models such as ChatGPT have experienced a surge in popularity, attracting 100 million active users in 2 months and generating an estimated 10 million daily queries. Despite this remarkable adoption,…

Artificial Intelligence · Computer Science 2024-04-17 Stefanie Krause , Bhumi Hitesh Panchal , Nikhil Ubhe

Learning new programming skills requires tailored guidance. With the emergence of advanced Natural Language Generation models like the ChatGPT API, there is now a possibility of creating a convenient and personalized tutoring system with AI…

Human-Computer Interaction · Computer Science 2023-06-16 Eason Chen , Ray Huang , Han-Shin Chen , Yuen-Hsien Tseng , Liang-Yi Li

Generative Pre-trained Transformer (GPT) models have exhibited exciting progress in their capabilities, capturing the interest of practitioners and the public alike. Yet, while the literature on the trustworthiness of GPT models remains…

ChatGPT is a groundbreaking ``chatbot"--an AI interface built on a large language model that was trained on an enormous corpus of human text to emulate human conversation. Beyond its ability to converse in a plausible way, it has attracted…

Physics Education · Physics 2023-03-28 Colin G. West

This study aimed to determine if ChatGPT's large language models could match the scoring accuracy of human and machine scores from the ASAP competition. The investigation focused on various prediction models, including linear regression,…

Computation and Language · Computer Science 2024-08-20 Mark D. Shermis

The software development industry is amid another disruptive paradigm change - adopting the use of generative AI (GAI) assistants for programming. Whilst AI is already used in various areas of software engineering, GAI technologies, such as…

Software Engineering · Computer Science 2023-08-21 Christopher Bull , Ahmed Kharrufa

The rapid advancements in large language models (LLMs) have greatly expanded the potential for automated code-related tasks. Two primary methodologies are used in this domain: prompt engineering and fine-tuning. Prompt engineering involves…

Software Engineering · Computer Science 2025-02-21 Jiho Shin , Clark Tang , Tahmineh Mohati , Maleknaz Nayebi , Song Wang , Hadi Hemmati

Background: AI-powered code generation, fueled by Large Language Models (LLMs), is revolutionizing software development. Models like OpenAI's Codex and GPT-4, alongside DeepSeek, leverage vast code and natural language datasets. However,…

Software Engineering · Computer Science 2025-02-27 Md Motaleb Hossen Manik

Equity is a core concern of learning analytics. However, applications that teach and assess equity skills, particularly at scale are lacking, often due to barriers in evaluating language. Advances in generative AI via large language models…

Human-Computer Interaction · Computer Science 2024-12-17 Danielle R. Thomas , Conrad Borchers , Sanjit Kakarla , Jionghao Lin , Shambhavi Bhushan , Boyuan Guo , Erin Gatz , Kenneth R. Koedinger

This research explores the opportunities of Generative AI (GenAI) in the realm of higher education through the design and development of a multimodal chatbot for an undergraduate course. Leveraging the ChatGPT API for nuanced text-based…

Human-Computer Interaction · Computer Science 2025-09-25 Johnny Chan , Yuming Li

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

Artificial Intelligence · Computer Science 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

The launch of ChatGPT at the end of 2022 generated large interest into possible applications of artificial intelligence in STEM education and among STEM professions. As a result many questions surrounding the capabilities of generative AI…

Computers and Society · Computer Science 2023-09-29 Matthew Frenkel , Hebah Emara

The success of ChatGPT has recently attracted numerous efforts to replicate it, with instruction-tuning strategies being a key factor in achieving remarkable results. Instruction-tuning not only significantly enhances the model's…

Computation and Language · Computer Science 2023-03-28 Yunjie Ji , Yong Deng , Yan Gong , Yiping Peng , Qiang Niu , Lei Zhang , Baochang Ma , Xiangang Li

Educators are increasingly concerned about the usage of Large Language Models (LLMs) such as ChatGPT in programming education, particularly regarding the potential exploitation of imperfections in Artificial Intelligence Generated Content…

This research introduces an innovative mathematical learning approach that integrates generative AI to cultivate a structured learning rather than quick solution. Our method combines chatbot capabilities and generative AI to offer…

Computers and Society · Computer Science 2024-07-23 Aditi Singh , Abul Ehtesham , Saket Kumar , Gaurav Kumar Gupta , Tala Talaei Khoei

We evaluate the effectiveness of LLM-Tutor, a large language model (LLM)-powered tutoring system that combines an AI-based proof-review tutor for real-time feedback on proof-writing and a chatbot for mathematics-related queries. Our…

Generative AI (GenAI) has fundamentally changed how knowledge workers, such as software developers, solve tasks and collaborate to build software products. Introducing innovative tools like ChatGPT and Copilot has created new opportunities…

Software Engineering · Computer Science 2024-05-06 Rasmus Ulfsnes , Nils Brede Moe , Viktoria Stray , Marianne Skarpen

The increasing use of Generative Artificial Intelligence (GAI) tools in education highlights the need to understand their influence on individuals' thinking processes and agency. This research explored 20 university students' interaction…

Human-Computer Interaction · Computer Science 2024-12-02 Tianlong Zhong , Gaoxia Zhu , Kang You Lim , Yew Soon Ong