English

DART: An AIGT Detector using AMR of Rephrased Text

Computation and Language 2025-02-05 v2 Artificial Intelligence

Abstract

As large language models (LLMs) generate more human-like texts, concerns about the side effects of AI-generated texts (AIGT) have grown. So, researchers have developed methods for detecting AIGT. However, two challenges remain. First, the performance of detecting black-box LLMs is low because existing models focus on probabilistic features. Second, most AIGT detectors have been tested on a single-candidate setting, which assumes that we know the origin of an AIGT and which may deviate from the real-world scenario. To resolve these challenges, we propose DART, which consists of four steps: rephrasing, semantic parsing, scoring, and multiclass classification. We conducted three experiments to test the performance of DART. The experimental result shows that DART can discriminate multiple black-box LLMs without probabilistic features and the origin of AIGT.

Keywords

Cite

@article{arxiv.2412.11517,
  title  = {DART: An AIGT Detector using AMR of Rephrased Text},
  author = {Hyeonchu Park and Byungjun Kim and Bugeun Kim},
  journal= {arXiv preprint arXiv:2412.11517},
  year   = {2025}
}

Comments

Presented in NAACL 2025