English

AIDetx: a compression-based method for identification of machine-learning generated text

Computation and Language 2024-12-02 v1 Machine Learning

Abstract

This paper introduces AIDetx, a novel method for detecting machine-generated text using data compression techniques. Traditional approaches, such as deep learning classifiers, often suffer from high computational costs and limited interpretability. To address these limitations, we propose a compression-based classification framework that leverages finite-context models (FCMs). AIDetx constructs distinct compression models for human-written and AI-generated text, classifying new inputs based on which model achieves a higher compression ratio. We evaluated AIDetx on two benchmark datasets, achieving F1 scores exceeding 97% and 99%, respectively, highlighting its high accuracy. Compared to current methods, such as large language models (LLMs), AIDetx offers a more interpretable and computationally efficient solution, significantly reducing both training time and hardware requirements (e.g., no GPUs needed). The full implementation is publicly available at https://github.com/AIDetx/AIDetx.

Keywords

Cite

@article{arxiv.2411.19869,
  title  = {AIDetx: a compression-based method for identification of machine-learning generated text},
  author = {Leonardo Almeida and Pedro Rodrigues and Diogo Magalhães and Armando J. Pinho and Diogo Pratas},
  journal= {arXiv preprint arXiv:2411.19869},
  year   = {2024}
}
R2 v1 2026-06-28T20:17:07.863Z