As companies enter the race for agentic AI adoption, fears surface around agentic autonomy and its subsequent risks. These fears compound as companies scale their agentic AI adoption with low-code applications, without a comparable scaling in their governance processes and expertise resulting in a phenomenon known as "Agent Sprawl". While shadow AI tools can help with agentic discovery and identification, few observability tools offer insights into the agents' configuration and settings or the decision-making process during agent-to-agent communication and orchestration. This paper explores AI governance professionals' concerns in enterprise settings, while offering design-time and runtime explainability techniques as suggested by AI governance experts for addressing those fears. Finally, we provide a preliminary prototype of an Agentic AI Card that can help companies feel at ease deploying agents at scale.
@article{arxiv.2604.14984,
title = {Agentic Explainability at Scale: Between Corporate Fears and XAI Needs},
author = {Yomna Elsayed and Cecily Jones},
journal= {arXiv preprint arXiv:2604.14984},
year = {2026}
}
Comments
Presented at Human-centered Explainable AI Workshop (HCXAI) @ CHI 2026, Barcelona, Spain, 2026