English

Distinguishing Human Generated Text From ChatGPT Generated Text Using Machine Learning

Computation and Language 2023-06-06 v1 Artificial Intelligence Machine Learning

Abstract

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement learning so that it can produce text documents that seem to be written by natural intelligence. Although there are numerous advantages of this generative model, it comes with some reasonable concerns as well. This paper presents a machine learning-based solution that can identify the ChatGPT delivered text from the human written text along with the comparative analysis of a total of 11 machine learning and deep learning algorithms in the classification process. We have tested the proposed model on a Kaggle dataset consisting of 10,000 texts out of which 5,204 texts were written by humans and collected from news and social media. On the corpus generated by GPT-3.5, the proposed algorithm presents an accuracy of 77%.

Keywords

Cite

@article{arxiv.2306.01761,
  title  = {Distinguishing Human Generated Text From ChatGPT Generated Text Using Machine Learning},
  author = {Niful Islam and Debopom Sutradhar and Humaira Noor and Jarin Tasnim Raya and Monowara Tabassum Maisha and Dewan Md Farid},
  journal= {arXiv preprint arXiv:2306.01761},
  year   = {2023}
}
R2 v1 2026-06-28T10:54:55.214Z