English

MGTEVAL: An Interactive Platform for Systemtic Evaluation of Machine-Generated Text Detectors

Cryptography and Security 2026-04-29 v1 Computation and Language

Abstract

We present MGTEVAL, an extensible platform for systematic evaluation of Machine-Generated Text (MGT) detectors. Despite rapid progress in MGT detection, existing evaluations are often fragmented across datasets, preprocessing, attacks, and metrics, making results hard to compare and reproduce. MGTEVAL organizes the workflow into four components: Dataset Building, Dataset Attack, Detector Training, and Performance Evaluation. It supports constructing custom benchmarks by generating MGT with configurable LLMs, applying 12 text attacks to test sets, training detectors via a unified interface, and reporting effectiveness, robustness, and efficiency. The platform provides both command-line and Web-based interfaces for user-friendly experimentation without code rewriting.

Keywords

Cite

@article{arxiv.2604.25152,
  title  = {MGTEVAL: An Interactive Platform for Systemtic Evaluation of Machine-Generated Text Detectors},
  author = {Yuanfan Li and Qi Zhou and Chengzhengxu Li and Zhaohan Zhang and Chenxu Zhao and Zepu Ruan and Chao Shen and Xiaoming Liu},
  journal= {arXiv preprint arXiv:2604.25152},
  year   = {2026}
}
R2 v1 2026-07-01T12:38:23.623Z