English

Prompt Architecture Determines Reasoning Quality: A Variable Isolation Study on the Car Wash Problem

Artificial Intelligence 2026-03-20 v2 Computation and Language

Abstract

Large language models consistently fail the "car wash problem," a viral reasoning benchmark requiring implicit physical constraint inference. We present a variable isolation study (n=20 per condition, 6 conditions, 120 total trials) examining which prompt architecture layers in a production system enable correct reasoning. Using Claude 3.5 Sonnet with controlled hyperparameters (temperature 0.7, top_p 1.0), we find that the STAR (Situation-Task-Action-Result) reasoning framework alone raises accuracy from 0% to 85% (p=0.001, Fisher's exact test, odds ratio 13.22). Adding user profile context via vector database retrieval provides a further 10 percentage point gain, while RAG context contributes an additional 5 percentage points, achieving 100% accuracy in the full-stack condition. These results suggest that structured reasoning scaffolds -- specifically, forced goal articulation before inference -- matter substantially more than context injection for implicit constraint reasoning tasks.

Keywords

Cite

@article{arxiv.2602.21814,
  title  = {Prompt Architecture Determines Reasoning Quality: A Variable Isolation Study on the Car Wash Problem},
  author = {Heejin Jo},
  journal= {arXiv preprint arXiv:2602.21814},
  year   = {2026}
}

Comments

9 pages, 4 tables

R2 v1 2026-07-01T10:51:46.850Z