English

One Supervisor, Many Modalities: Adaptive Tool Orchestration for Autonomous Queries

Computation and Language 2026-03-16 v2 Artificial Intelligence Machine Learning

Abstract

We present an agentic AI framework for autonomous multimodal query processing that coordinates specialized tools across text, image, audio, video, and document modalities. A central Supervisor dynamically decomposes user queries, delegates subtasks to modality-appropriate tools (e.g., object detection, OCR, speech transcription), and synthesizes results through adaptive routing strategies rather than predetermined decision trees. For text-only queries, the framework uses learned routing via RouteLLM, while non-text paths use SLM-assisted modality decomposition. Evaluated on 2,847 queries across 15 task categories, our framework achieves 72% reduction in time-to-accurate-answer, 85% reduction in conversational rework, and 67% cost reduction compared to the matched hierarchical baseline while maintaining accuracy parity. These results demonstrate that intelligent centralized orchestration fundamentally improves multimodal AI deployment economics.

Keywords

Cite

@article{arxiv.2603.11545,
  title  = {One Supervisor, Many Modalities: Adaptive Tool Orchestration for Autonomous Queries},
  author = {Mayank Saini and Arit Kumar Bishwas},
  journal= {arXiv preprint arXiv:2603.11545},
  year   = {2026}
}

Comments

19 pages, 3 figures; v2: corrected author metadata

R2 v1 2026-07-01T11:15:57.554Z