中文
相关论文

相关论文: Evaluating GPT's Programming Capability through Co…

200 篇论文

We present the progress of the GPT family from GPT-3 through GPT-3.5, GPT-4, GPT-4 Turbo, GPT-4o, GPT-4.1, and the GPT-5 family. Our work is comparative rather than merely historical. We investigates how the family evolved in technical…

人工智能 · 计算机科学 2026-04-14 Hina Afridi , Habib Ullah , Sultan Daud Khan , Mohib Ullah

Generative artificial intelligence tools, like ChatGPT, are an increasingly utilized resource among computational social scientists. Nevertheless, there remains space for improved understanding of the performance of ChatGPT in complex tasks…

计算与语言 · 计算机科学 2025-12-02 Breanna E. Green , Ashley L. Shea , Pengfei Zhao , Drew B. Margolin

Lately, Large Language Models have been widely used in code generation. GPT4 is considered the most potent Large Language Model from Openai. In this paper, we examine GPT3.5 and GPT4 as coding assistants. More specifically, we have…

人工智能 · 计算机科学 2023-09-25 Lefteris Moussiades , George Zografos

Large language models (LLMs) have demonstrated impressive reasoning capabilities, yet there is ongoing debate about these abilities and the potential data contamination problem recently. This paper aims to evaluate the reasoning capacities…

计算与语言 · 计算机科学 2024-06-05 Yiming Huang , Zhenghao Lin , Xiao Liu , Yeyun Gong , Shuai Lu , Fangyu Lei , Yaobo Liang , Yelong Shen , Chen Lin , Nan Duan , Weizhu Chen

Generative Artificial Intelligence (GenAI) tools for source code generation have significantly boosted productivity in software development. However, they also raise concerns, particularly the risk that developers may rely heavily on these…

软件工程 · 计算机科学 2025-07-14 Otávio Cury , Guilherme Avelino

One of the most recent and fascinating breakthroughs in artificial intelligence is ChatGPT, a chatbot which can simulate human conversation. ChatGPT is an instance of GPT4, which is a language model based on generative gredictive…

机器学习 · 计算机科学 2024-06-21 Michael Kohler , Adam Krzyzak

As artificial intelligence (AI) technologies become increasingly powerful and prominent in society, their misuse is a growing concern. In educational settings, AI technologies could be used by students to cheat on assignments and exams. In…

计算与语言 · 计算机科学 2022-09-08 Stella Biderman , Edward Raff

Generative AI and large language models hold great promise in enhancing programming education by automatically generating individualized feedback for students. We investigate the role of generative AI models in providing human tutor-style…

Many Transformer-based pre-trained models for code have been developed and applied to code-related tasks. In this paper, we review the existing literature, examine the suitability of model architectures for different tasks, and look at the…

软件工程 · 计算机科学 2023-10-03 Yan Xiao , Xinyue Zuo , Lei Xue , Kailong Wang , Jin Song Dong , Ivan Beschastnikh

Recent progress in large-scale language models has enabled breakthroughs in previously intractable computer programming tasks. Prior work in meta-learning and neural architecture search has led to substantial successes across various task…

人工智能 · 计算机科学 2023-02-06 Alex Sheng , Shankar Padmanabhan

The rapid adoption of AI coding agents is fundamentally shifting software developers' roles from code authors to code reviewers. While developers spend a significant portion of their time reading and comprehending code, the linguistic…

This study aims to assess the performance of two advanced Large Language Models (LLMs), GPT-3.5 and GPT-4, in the task of code clone detection. The evaluation involves testing the models on a variety of code pairs of different clone types…

软件工程 · 计算机科学 2024-07-03 Zixian Zhang , Takfarinas Saber

As AI code assistants become increasingly integrated into software development workflows, understanding how their code compares to human-written programs is critical for ensuring reliability, maintainability, and security. In this paper, we…

软件工程 · 计算机科学 2025-09-01 Domenico Cotroneo , Cristina Improta , Pietro Liguori

In this study, we explored the progression trajectories of artificial intelligence (AI) systems through the lens of complexity theory. We challenged the conventional linear and exponential projections of AI advancement toward Artificial…

Introduction: Recently, the effectiveness of Large Language Models (LLMs) has increased rapidly, allowing them to be used in a great number of applications. However, the risks posed by the generation of false information through LLMs…

计算与语言 · 计算机科学 2024-05-10 Jakub Pokrywka , Jeremi Kaczmarek , Edward Gorzelańczyk

In this research, we explore the efficacy and potential of Generative AI models, specifically focusing on their application in role-playing simulations exemplified through Spyfall, a renowned mafia-style game. By leveraging GPT-4's advanced…

人工智能 · 计算机科学 2023-09-22 Munyeong Kim , Sungsu Kim

Security vulnerabilities present in a code that has been written in diverse programming languages are among the most critical yet complicated aspects of source code to detect. Static analysis tools based on rule-based patterns usually do…

密码学与安全 · 计算机科学 2025-08-19 Hael Abdulhakim Ali Humran , Ferdi Sonmez

The accelerated evolution of large language models has raised questions about their comparative performance across domains of practical importance. GPT-4 by OpenAI introduced advances in reasoning, multimodality, and task generalization,…

人机交互 · 计算机科学 2025-08-28 Georgios P. Georgiou

This study highlights the transparency and accuracy of GenAI's inductive thematic analysis, particularly using GPT-4 Turbo API integrated within a stepwise prompt-based Python script. This approach ensured a traceable and systematic coding…

人机交互 · 计算机科学 2025-03-25 Matthew Nyaaba , Min SungEun , Mary Abiswin Apam , Kwame Owoahene Acheampong , Emmanuel Dwamena

The rise of Generative AI (GenAI) tools like ChatGPT has created new opportunities and challenges for computing education. Existing research has primarily focused on GenAI's ability to complete educational tasks and its impact on student…

软件工程 · 计算机科学 2025-11-18 Rufeng Chen , Shuaishuai Jiang , Jiyun Shen , AJung Moon , Lili Wei