English
Related papers

Related papers: Fighting Fire with Fire: Can ChatGPT Detect AI-gen…

200 papers

Generative AIs, especially Large Language Models (LLMs) such as ChatGPT or Llama, have advanced significantly, positioning them as valuable tools for digital forensics. While initial studies have explored the potential of ChatGPT in the…

Cryptography and Security · Computer Science 2023-12-25 Gaëtan Michelet , Frank Breitinger

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

Large Language Models (LLMs) are gearing up to surpass human creativity. The veracity of the statement needs careful consideration. In recent developments, critical questions arise regarding the authenticity of human work and the…

Computation and Language · Computer Science 2025-09-29 Sai Teja Lekkala , Yadagiri Annepaka , Arun Kumar Challa , Samatha Reddy Machireddy , Partha Pakray , Chukhu Chunka

Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intelligence (AI) chatbots,…

Computation and Language · Computer Science 2025-02-25 Zhuoran Huang , Michael P. Berry , Christina Chwyl , Gary Hsieh , Jing Wei , Evan M. Forman

Evaluating the quality of generated text is a challenging task in NLP, due to the inherent complexity and diversity of text. Recently, large language models (LLMs) have garnered significant attention due to their impressive performance in…

Computation and Language · Computer Science 2023-09-19 Yi Chen , Rui Wang , Haiyun Jiang , Shuming Shi , Ruifeng Xu

This paper examines how individuals perceive the credibility of content originating from human authors versus content generated by large language models, like the GPT language model family that powers ChatGPT, in different user interface…

Human-Computer Interaction · Computer Science 2023-09-07 Martin Huschens , Martin Briesch , Dominik Sobania , Franz Rothlauf

In recent years, generative AI has undergone major advancements, demonstrating significant promise in augmenting human productivity. Notably, large language models (LLM), with ChatGPT-4 as an example, have drawn considerable attention.…

Human-Computer Interaction · Computer Science 2024-01-23 Sida Peng , Wojciech Swiatek , Allen Gao , Paul Cullivan , Haoge Chang

ChatGPT is a large language model (LLM) created by OpenAI that has been carefully trained on a large amount of data. It has revolutionized the field of natural language processing (NLP) and has pushed the boundaries of LLM capabilities.…

Computation and Language · Computer Science 2023-07-18 Salman Mohamadi , Ghulam Mujtaba , Ngan Le , Gianfranco Doretto , Donald A. Adjeroh

This study compares the performance of AI-generated and human-written product descriptions using a multifaceted evaluation model. We analyze descriptions for 100 products generated by four AI models (Gemma 2B, LLAMA, GPT2, and ChatGPT 4)…

Computation and Language · Computer Science 2024-12-30 Sanjukta Ghosh

This paper introduces DevGPT, a dataset curated to explore how software developers interact with ChatGPT, a prominent large language model (LLM). The dataset encompasses 29,778 prompts and responses from ChatGPT, including 19,106 code…

Software Engineering · Computer Science 2024-02-15 Tao Xiao , Christoph Treude , Hideaki Hata , Kenichi Matsumoto

As large language models (LLMs) advance and become widespread, students increasingly turn to systems like ChatGPT for assistance with writing tasks. Educators are concerned with students' usage of ChatGPT beyond cheating; using ChatGPT may…

Human-Computer Interaction · Computer Science 2026-04-23 Andrew Jelson , Daniel Manesh , Alice Jang , Daniel Dunlap , Young-Ho Kim , Sang Won Lee

Large Language Models (LLMs) have shown impressive performance across a variety of Artificial Intelligence (AI) and natural language processing tasks, such as content creation, report generation, etc. However, unregulated malign application…

Computation and Language · Computer Science 2023-09-15 Harika Abburi , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

Large Language Models (LLMs), such as ChatGPT, are reshaping content creation and academic writing. This study investigates the impact of AI-assisted generative revisions on research manuscripts, focusing on heterogeneous adoption patterns…

Computation and Language · Computer Science 2025-04-21 Cong William Lin , Wu Zhu

Recently large language models (LLMs) like ChatGPT have shown impressive performance on many natural language processing tasks with zero-shot. In this paper, we investigate the effectiveness of zero-shot LLMs in the financial domain. We…

Computation and Language · Computer Science 2023-05-29 Agam Shah , Sudheer Chava

The misuse of large language models (LLMs) poses potential risks, motivating the development of machine-generated text (MGT) detection. Existing literature primarily concentrates on binary, document-level detection, thereby neglecting texts…

Computation and Language · Computer Science 2025-06-04 Zhixiong Su , Yichen Wang , Herun Wan , Zhaohan Zhang , Minnan Luo

In this paper, we study the problem of detecting machine-generated text when the large language model (LLM) it is possibly derived from is unknown. We do so by apply ensembling methods to the outputs from DetectGPT classifiers (Mitchell et…

Computation and Language · Computer Science 2024-06-19 Ivan Ong , Boon King Quek

Following the universal availability of generative AI systems with the release of ChatGPT, automatic detection of deceptive text created by Large Language Models has focused on domains such as academic plagiarism and "fake news". However,…

Computation and Language · Computer Science 2024-12-23 Andrea Cristina McGlinchey , Peter J Barclay

The rapid advancement of large language models (LLMs) has made detecting AI-generated text an increasingly critical challenge. Traditional methods often fail to capture the nuanced semantic differences between human and machine-generated…

Computation and Language · Computer Science 2025-02-03 Lifu Gao , Ziwei Liu , Qi Zhang

ChatGPT, the first large language model (LLM) with mass adoption, has demonstrated remarkable performance in numerous natural language tasks. Despite its evident usefulness, evaluating ChatGPT's performance in diverse problem domains…

Computation and Language · Computer Science 2024-08-23 Rachith Aiyappa , Jisun An , Haewoon Kwak , Yong-Yeol Ahn