English

Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing

Cryptography and Security 2026-04-23 v1 Machine Learning

Abstract

Adversarial robustness evaluation underpins every claim of trustworthy ML deployment, yet the field suffers from fragmented protocols and undetected gradient masking. We make two contributions. (1) Structured synthesis. We analyze nine peer-reviewed corpus sources (2020--2026) through seven complementary protocols, producing the first end-to-end structured analysis of the field's consensus and unresolved challenges. (2) Auto-ART framework. We introduce Auto-ART, an open-source framework that operationalizes identified gaps: 50+ attacks, 28 defense modules, the Robustness Diagnostic Index (RDI), and gradient-masking detection. It supports multi-norm evaluation (l1/l2/linf/semantic/spatial) and compliance mapping to NIST AI RMF, OWASP LLM Top 10, and the EU AI Act. Empirical validation on RobustBench demonstrates that Auto-ART's pre-screening identifies gradient masking in 92% of flagged cases, and RDI rankings correlate highly with full AutoAttack. Multi-norm evaluation exposes a 23.5 pp gap between average and worst-case robustness on state-of-the-art models. No prior work combines such structured meta-scientific analysis with an executable evaluation framework bridging literature gaps into engineering.

Keywords

Cite

@article{arxiv.2604.20704,
  title  = {Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing},
  author = {Abhijit Talluri},
  journal= {arXiv preprint arXiv:2604.20704},
  year   = {2026}
}

Comments

NeurIPS 2026 Evaluations and Datasets Track Submission

R2 v1 2026-07-01T12:30:42.498Z