English

Unvalidated Trust: Cross-Stage Vulnerabilities in Large Language Model Architectures

Cryptography and Security 2025-11-03 v1 Artificial Intelligence

Abstract

As Large Language Models (LLMs) are increasingly integrated into automated, multi-stage pipelines, risk patterns that arise from unvalidated trust between processing stages become a practical concern. This paper presents a mechanism-centered taxonomy of 41 recurring risk patterns in commercial LLMs. The analysis shows that inputs are often interpreted non-neutrally and can trigger implementation-shaped responses or unintended state changes even without explicit commands. We argue that these behaviors constitute architectural failure modes and that string-level filtering alone is insufficient. To mitigate such cross-stage vulnerabilities, we recommend zero-trust architectural principles, including provenance enforcement, context sealing, and plan revalidation, and we introduce "Countermind" as a conceptual blueprint for implementing these defenses.

Keywords

Cite

@article{arxiv.2510.27190,
  title  = {Unvalidated Trust: Cross-Stage Vulnerabilities in Large Language Model Architectures},
  author = {Dominik Schwarz},
  journal= {arXiv preprint arXiv:2510.27190},
  year   = {2025}
}

Comments

178 pages, mechanism-centered taxonomy of 41 LLM risk patterns, extensive appendix with experiment prompts and consolidation tables. Full traces available to reviewers and affected providers

R2 v1 2026-07-01T07:15:07.840Z