English

When Should Users Check? Modeling Confirmation Frequency inMulti-Step Agentic AI Tasks

Human-Computer Interaction 2026-05-08 v3

Abstract

Existing AI agents typically execute multi-step tasks autonomously and only allow user confirmation at the end. During execution, users have little control, making the confirm-at-end approach brittle: a single error can cascade and force a complete restart. Confirming every step avoids such failures, but imposes tedious overhead. Balancing excessive interruptions against costly rollbacks remains an open challenge. We address this problem by modeling confirmation as a minimum time scheduling problem. We conducted a formative study with eight participants, which revealed a recurring Confirmation-Diagnosis-Correction-Redo (CDCR) pattern in how users monitor errors. Based on this pattern, we developed a decision-theoretic model to determine time-efficient confirmation point placement. We then evaluated our approach using a within-subjects study where 48 participants monitored AI agents and repaired their mistakes while executing tasks. Results show that 81 percent of participants preferred our intermediate confirmation approach over the confirm-at-end approach used by existing systems, and task completion time was reduced by 13.54 percent.

Keywords

Cite

@article{arxiv.2510.05307,
  title  = {When Should Users Check? Modeling Confirmation Frequency inMulti-Step Agentic AI Tasks},
  author = {Jieyu Zhou and Aryan Roy and Sneh Gupta and Daniel Weitekamp and Christopher J. MacLellan},
  journal= {arXiv preprint arXiv:2510.05307},
  year   = {2026}
}

Comments

Accepted by Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26), April 13--17, 2026, Barcelona, Spain

R2 v1 2026-07-01T06:20:02.881Z