English
Related papers

Related papers: HC3 Plus: A Semantic-Invariant Human ChatGPT Compa…

200 papers

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

AI generated content (AIGC) presents considerable challenge to educators around the world. Instructors need to be able to detect such text generated by large language models, either with the naked eye or with the help of some tools. There…

Computation and Language · Computer Science 2023-09-26 Yikang Liu , Ziyin Zhang , Wanyang Zhang , Shisen Yue , Xiaojing Zhao , Xinyuan Cheng , Yiwen Zhang , Hai Hu

In this paper, we study how well humans can detect text generated by commercial LLMs (GPT-4o, Claude, o1). We hire annotators to read 300 non-fiction English articles, label them as either human-written or AI-generated, and provide…

Computation and Language · Computer Science 2025-05-21 Jenna Russell , Marzena Karpinska , Mohit Iyyer

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

Hate speech is a severe issue that affects many online platforms. So far, several studies have been performed to develop robust hate speech detection systems. Large language models like ChatGPT have recently shown a great promise in…

Computation and Language · Computer Science 2023-05-24 Mithun Das , Saurabh Kumar Pandey , Animesh Mukherjee

The rapid development of the Internet has profoundly changed human life. Humans are increasingly expressing themselves and interacting with others on social media platforms. However, although artificial intelligence technology has been…

Computation and Language · Computer Science 2024-07-11 Haochen Xue , Chong Zhang , Chengzhi Liu , Fangyu Wu , Xiaobo Jin

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

Recent advancements in large language models (LLMs) have led to the development of highly potent models like OpenAI's ChatGPT. These models have exhibited exceptional performance in a variety of tasks, such as question answering, essay…

Computation and Language · Computer Science 2023-04-12 Ruixiang Tang , Xiaotian Han , Xiaoqian Jiang , Xia Hu

ChatGPT brings revolutionary social value but also raises concerns about the misuse of AI-generated text. Consequently, an important question is how to detect whether texts are generated by ChatGPT or by human. Existing detectors are built…

Computation and Language · Computer Science 2023-10-16 Shuyang Cai , Wanyun Cui

The advent of generative AI models holds tremendous potential for aiding teachers in the generation of pedagogical materials. However, numerous knowledge gaps concerning the behavior of these models obfuscate the generation of…

Computers and Society · Computer Science 2024-07-16 Alex Dornburg , Kristin Davin

ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of…

Computation and Language · Computer Science 2023-09-20 Yucheng Shi , Hehuan Ma , Wenliang Zhong , Qiaoyu Tan , Gengchen Mai , Xiang Li , Tianming Liu , Junzhou Huang

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

This study explores the integration of a representative large language model, ChatGPT, into lending decision-making with a focus on credit default prediction. Specifically, we use ChatGPT to analyse and interpret loan assessments written by…

Risk Management · Quantitative Finance 2025-03-25 Zongxiao Wu , Yizhe Dong , Yaoyiran Li , Baofeng Shi

Generative Artificial Intelligence (AI) models such as OpenAI's ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and…

Machine Learning · Computer Science 2023-06-19 Fadel M. Megahed , Ying-Ju Chen , Joshua A. Ferris , Sven Knoth , L. Allison Jones-Farmer

The rapid adoption of large language models (LLMs) such as ChatGPT has blurred the line between human and AI-generated texts, raising urgent questions about academic integrity, intellectual property, and the spread of misinformation. Thus,…

Computation and Language · Computer Science 2025-09-26 Sharanya Parimanoharan , Ruwan D. Nawarathna

ChatGPT has enabled access to AI-generated writing for the masses, and within just a few months, this product has disrupted the knowledge economy, initiating a culture shift in the way people work, learn, and write. The need to discriminate…

Machine Learning · Computer Science 2023-03-30 Heather Desaire , Aleesa E. Chua , Madeline Isom , Romana Jarosova , David Hua

The recent large language models (LLMs), e.g., ChatGPT, have been able to generate human-like and fluent responses when provided with specific instructions. While admitting the convenience brought by technological advancement, educators…

Computation and Language · Computer Science 2023-12-27 Zijie Zeng , Lele Sha , Yuheng Li , Kaixun Yang , Dragan Gašević , Guanliang Chen

Gesture synthesis has gained significant attention as a critical research field, aiming to produce contextually appropriate and natural gestures corresponding to speech or textual input. Although deep learning-based approaches have achieved…

Computation and Language · Computer Science 2024-05-29 Nan Gao , Zeyu Zhao , Zhi Zeng , Shuwu Zhang , Dongdong Weng , Yihua Bao

ChatGPT has achieved great success and can be considered to have acquired an infrastructural status. There are abundant works for evaluating ChatGPT on benchmarks. However, existing benchmarks encounter two challenges: (1) Disregard for…

Computation and Language · Computer Science 2024-06-19 Shangqing Tu , Chunyang Li , Jifan Yu , Xiaozhi Wang , Lei Hou , Juanzi Li

Teamwork is a critical component of many academic and professional settings. In those contexts, feedback between team members is an important element to facilitate successful and sustainable teamwork. However, in the classroom, as the…

Human-Computer Interaction · Computer Science 2023-05-23 Andrew Katz , Siqing Wei , Gaurav Nanda , Christopher Brinton , Matthew Ohland