English

The Impact of Editorial Intervention on Detecting Native Language Traces

Computation and Language 2026-05-12 v1

Abstract

Native Language Identification (NLI) is the task of determining an author's native language (L1) from their non-native writings. With the advent of human-AI co-authorship, non-native texts are routinely corrected and rewritten by large language models, fundamentally altering the linguistic features NLI models depend on. In this paper, we investigate the robustness of L1 traces across increasing degrees of editorial intervention. By processing 450 essays from the Write & Improve 2024 corpus through varying levels of grammatical error correction (GEC) and paraphrasing, we demonstrate that L1 attribution does not entirely depend on surface-level errors. Instead, the detection models leverage deeper L1 features: unidiomatic lexico-semantic choices, pragmatic transfer, and the author's underlying cultural perspective. We find that minimal edits preserve these structural traces and maintain high profiling accuracy. In contrast, fluency edits and paraphrasing normalize these L1 features, leading to a severe degradation in performance.

Keywords

Cite

@article{arxiv.2605.10216,
  title  = {The Impact of Editorial Intervention on Detecting Native Language Traces},
  author = {Ahmet Yavuz Uluslu and Mark Gales and Kate Knill and Gerold Schneider},
  journal= {arXiv preprint arXiv:2605.10216},
  year   = {2026}
}