English

StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis

Computation and Language 2024-05-17 v1 Artificial Intelligence

Abstract

The emergence of large language models (LLMs) capable of generating realistic texts and images has sparked ethical concerns across various sectors. In response, researchers in academia and industry are actively exploring methods to distinguish AI-generated content from human-authored material. However, a crucial question remains: What are the unique characteristics of AI-generated text? Addressing this gap, this study proposes StyloAI, a data-driven model that uses 31 stylometric features to identify AI-generated texts by applying a Random Forest classifier on two multi-domain datasets. StyloAI achieves accuracy rates of 81% and 98% on the test set of the AuTextification dataset and the Education dataset, respectively. This approach surpasses the performance of existing state-of-the-art models and provides valuable insights into the differences between AI-generated and human-authored texts.

Keywords

Cite

@article{arxiv.2405.10129,
  title  = {StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis},
  author = {Chidimma Opara},
  journal= {arXiv preprint arXiv:2405.10129},
  year   = {2024}
}

Comments

25th International Conference on Artificial on Artificial Intelligence in Education(AIED 2024)