English
Related papers

Related papers: A Study on the Vulnerability of Test Questions aga…

200 papers

ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and engineers discuss the transformative effects of ChatGPT on…

As artificial intelligence technology continues to advance, chatbots are becoming increasingly powerful. Among them, ChatGPT, launched by OpenAI, has garnered widespread attention globally due to its powerful natural language processing…

Cryptography and Security · Computer Science 2026-02-03 Yushan Xiang , Zhongwen Li , Xiaoqi Li

Recently, ChatGPT has attracted great attention from the code analysis domain. Prior works show that ChatGPT has the capabilities of processing foundational code analysis tasks, such as abstract syntax tree generation, which indicates the…

Software Engineering · Computer Science 2024-06-21 Peiyu Liu , Junming Liu , Lirong Fu , Kangjie Lu , Yifan Xia , Xuhong Zhang , Wenzhi Chen , Haiqin Weng , Shouling Ji , Wenhai Wang

With ChatGPT under the spotlight, utilizing large language models (LLMs) to assist academic writing has drawn a significant amount of debate in the community. In this paper, we aim to present a comprehensive study of the detectability of…

Computation and Language · Computer Science 2024-03-19 Zeyan Liu , Zijun Yao , Fengjun Li , Bo Luo

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

With the increasing utilization of large language models such as ChatGPT during software development, it has become crucial to verify the quality of code content it generates. Recent studies proposed utilizing ChatGPT as both a developer…

Software Engineering · Computer Science 2024-12-02 Xiao Yu , Lei Liu , Xing Hu , Jacky Wai Keung , Jin Liu , Xin Xia

The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative…

Computation and Language · Computer Science 2023-08-11 Sakib Shahriar , Kadhim Hayawi

In this study, we assess the efficacy of employing the ChatGPT language model to generate solutions for coding exercises within an undergraduate Java programming course. ChatGPT, a large-scale, deep learning-driven natural language…

Software Engineering · Computer Science 2023-05-24 Eng Lieh Ouh , Benjamin Kok Siew Gan , Kyong Jin Shim , Swavek Wlodkowski

Educational chatbots come with a promise of interactive and personalized learning experiences, yet their development has been limited by the restricted free interaction capabilities of available platforms and the difficulty of encoding…

ChatGPT took the world by storm for its impressive abilities. Due to its release without documentation, scientists immediately attempted to identify its limits, mainly through its performance in natural language processing (NLP) tasks. This…

Computation and Language · Computer Science 2023-11-14 Martino Pelucchi , Matias Valdenegro-Toro

ChatGPT, an AI chatbot, has gained popularity for its capability in generating human-like responses. However, this feature carries several risks, most notably due to its deceptive behaviour such as offering users misleading or fabricated…

Computers and Society · Computer Science 2023-06-27 Xiao Zhan , Yifan Xu , Stefan Sarkadi

Q&A platforms have been crucial for the online help-seeking behavior of programmers. However, the recent popularity of ChatGPT is altering this trend. Despite this popularity, no comprehensive study has been conducted to evaluate the…

Software Engineering · Computer Science 2024-05-22 Samia Kabir , David N. Udo-Imeh , Bonan Kou , Tianyi Zhang

As a natural language assistant, ChatGPT is capable of performing various tasks, including but not limited to article generation, code completion, and data analysis. Furthermore, ChatGPT has consistently demonstrated a remarkable level of…

Computation and Language · Computer Science 2023-03-15 Yunjie Ji , Yan Gong , Yiping Peng , Chao Ni , Peiyan Sun , Dongyu Pan , Baochang Ma , Xiangang Li

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Chatbots have long been capable of answering basic questions and even responding to obscure prompts, but recently their improvements have been far more significant. Modern chatbots like Open AIs ChatGPT3 not only have the ability to answer…

Computation and Language · Computer Science 2023-03-22 Grant Rosario , David Noever

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great…

Computation and Language · Computer Science 2023-10-24 Arslan Akram

With the development of blockchain technology, smart contracts have become an important component of blockchain applications. Despite their crucial role, the development of smart contracts may introduce vulnerabilities and potentially lead…

Software Engineering · Computer Science 2025-07-14 Chong Chen , Jianzhong Su , Jiachi Chen , Yanlin Wang , Tingting Bi , Jianxing Yu , Yanli Wang , Xingwei Lin , Ting Chen , Zibin Zheng

ChatGPT (Chat Generative Pre-trained Transformer) is a chatbot launched by OpenAI on November 30, 2022. OpenAI's GPT-3 family of large language models serve as the foundation for ChatGPT. ChatGPT is fine-tuned with both supervised and…

Software Engineering · Computer Science 2023-05-29 Giriprasad Sridhara , Ranjani H. G. , Sourav Mazumdar

Can ChatGPT provide evidence to support its answers? Does the evidence it suggests actually exist and does it really support its answer? We investigate these questions using a collection of domain-specific knowledge-based questions,…

Artificial Intelligence · Computer Science 2023-09-19 Guido Zuccon , Bevan Koopman , Razia Shaik

Artificially intelligent chatbot, such as ChatGPT, represents a recent and powerful advancement in the AI domain. Users prefer them for obtaining quick and precise answers, avoiding the usual hassle of clicking through multiple links in…

Artificial Intelligence · Computer Science 2023-11-01 Seraj A. M. Mostafa , Md Z. Islam , Mohammad Z. Islam , Fairose Jeehan , Saujanna Jafreen , Raihan U. Islam