English
Related papers

Related papers: Distinguishing LLM-generated from Human-written Co…

200 papers

The potential of artificial intelligence (AI)-based large language models (LLMs) holds considerable promise in revolutionizing education, research, and practice. However, distinguishing between human-written and AI-generated text has become…

Computation and Language · Computer Science 2023-11-14 Kadhim Hayawi , Sakib Shahriar , Sujith Samuel Mathew

Program synthesis has been long studied with recent approaches focused on directly using the power of Large Language Models (LLMs) to generate code. Programming benchmarks, with curated synthesis problems and test-cases, are used to measure…

Software Engineering · Computer Science 2023-11-01 Jiawei Liu , Chunqiu Steven Xia , Yuyao Wang , Lingming Zhang

Artificial Intelligence Generated Content (AIGC) has garnered considerable attention for its impressive performance, with ChatGPT emerging as a leading AIGC model that produces high-quality responses across various applications, including…

Software Engineering · Computer Science 2023-04-12 Jian Wang , Shangqing Liu , Xiaofei Xie , Yi Li

The challenge of separating AI-generated text from human-authored content is becoming more urgent as generative AI technologies like ChatGPT become more widely available. In this work, we address this issue by looking at both the detection…

This study explores linguistic differences between human and LLM-generated dialogues, using 19.5K dialogues generated by ChatGPT-3.5 as a companion to the EmpathicDialogues dataset. The research employs Linguistic Inquiry and Word Count…

Computation and Language · Computer Science 2024-04-29 Morgan Sandler , Hyesun Choung , Arun Ross , Prabu David

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

Software Engineering · Computer Science 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

Our work addresses the critical issue of distinguishing text generated by Large Language Models (LLMs) from human-produced text, a task essential for numerous applications. Despite ongoing debate about the feasibility of such…

Computation and Language · Computer Science 2023-10-04 Souradip Chakraborty , Amrit Singh Bedi , Sicheng Zhu , Bang An , Dinesh Manocha , Furong Huang

Large language models (LLMs) have revolutionized code generation, automating programming with remarkable efficiency. However, these advancements challenge programming skills, ethics, and assessment integrity, making the detection of…

Computation and Language · Computer Science 2025-07-18 Daniil Orel , Dilshod Azizov , Preslav Nakov

Large language models (LLMs) have opened up enormous opportunities while simultaneously posing ethical dilemmas. One of the major concerns is their ability to create text that closely mimics human writing, which can lead to potential…

Computation and Language · Computer Science 2023-11-15 Zhen Guo , Shangdi Yu

Large language models (LLMs) such as GPT, Claude, Gemini, and Grok have been deeply integrated into our daily life. They now support a wide range of tasks -- from dialogue and email drafting to assisting with teaching and coding, serving as…

Computation and Language · Computer Science 2026-01-13 Hongyi Zhou , Jin Zhu , Ying Yang , Chengchun Shi

Widely applied large language models (LLMs) can generate human-like content, raising concerns about the abuse of LLMs. Therefore, it is important to build strong AI-generated text (AIGT) detectors. Current works only consider document-level…

Computation and Language · Computer Science 2023-12-18 Pengyu Wang , Linyang Li , Ke Ren , Botian Jiang , Dong Zhang , Xipeng Qiu

In recent years, large language models (LLMs) have emerged as powerful tools with potential applications in various fields, including software engineering. Within the scope of this research, we evaluate five different state-of-the-art LLMs…

Computation and Language · Computer Science 2024-09-09 Luis Mayer , Christian Heumann , Matthias Aßenmacher

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

Background: Large language models such as ChatGPT are capable of generating grammatically perfect and human-like text content, and a large number of ChatGPT-generated texts have appeared on the Internet. However, medical texts such as…

Computation and Language · Computer Science 2024-01-01 Wenxiong Liao , Zhengliang Liu , Haixing Dai , Shaochen Xu , Zihao Wu , Yiyang Zhang , Xiaoke Huang , Dajiang Zhu , Hongmin Cai , Tianming Liu , Xiang Li

With the rapid advance of machine learning (ML) technology, large language models (LLMs) are increasingly explored as an intelligent tool to generate program code from natural language specifications. However, existing evaluations of LLMs…

Software Engineering · Computer Science 2024-06-19 Tanha Miah , Hong Zhu

Recently, large language models (LLM) based generative AI has been gaining momentum for their impressive high-quality performances in multiple domains, particularly after the release of the ChatGPT. Many believe that they have the potential…

Software Engineering · Computer Science 2024-02-22 Wei Wang , Huilong Ning , Gaowei Zhang , Libo Liu , Yi Wang

With the increasing popularity of LLM-based code completers, like GitHub Copilot, the interest in automatically detecting AI-generated code is also increasing-in particular in contexts where the use of LLMs to program is forbidden by policy…

Software Engineering · Computer Science 2024-12-20 Andrea Gurioli , Maurizio Gabbrielli , Stefano Zacchiroli

There have been many recent advances in the fields of generative Artificial Intelligence (AI) and Large Language Models (LLM), with the Generative Pre-trained Transformer (GPT) model being a leading "chatbot." LLM-based chatbots have become…

Computation and Language · Computer Science 2024-08-12 Gauri Anil Godghase , Rishit Agrawal , Tanush Obili , Mark Stamp

Detecting texts generated by Large Language Models (LLMs) could cause grave mistakes due to incorrect decisions, such as undermining students' academic dignity. LLM text detection thus needs to ensure the interpretability of the decision,…

Computation and Language · Computer Science 2026-05-06 Ryuto Koike , Masahiro Kaneko , Ayana Niwa , Preslav Nakov , Naoaki Okazaki