English

Orion: A Unified Visual Agent for Multimodal Perception, Advanced Visual Reasoning and Execution

Computer Vision and Pattern Recognition 2025-11-21 v2 Artificial Intelligence Machine Learning

Abstract

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language models that generate descriptive outputs, Orion orchestrates a suite of specialized computer vision tools, including object detection, keypoint localization, panoptic segmentation, Optical Character Recognition (OCR), and geometric analysis, to execute complex multi-step visual workflows. The system achieves competitive performance across MMMU, MMBench, DocVQA, and MMLongBench while extending monolithic VLM capabilities to production-grade visual intelligence. Through its agentic, tool-augmented approach, Orion enables autonomous visual reasoning that bridges neural perception with symbolic execution, marking the transition from passive visual understanding to active, tool-driven visual intelligence. Try Orion for free at: https://chat.vlm.run Learn more at: https://www.vlm.run/orion

Keywords

Cite

@article{arxiv.2511.14210,
  title  = {Orion: A Unified Visual Agent for Multimodal Perception, Advanced Visual Reasoning and Execution},
  author = {N Dinesh Reddy and Dylan Snyder and Lona Kiragu and Mirajul Mohin and Shahrear Bin Amin and Sudeep Pillai},
  journal= {arXiv preprint arXiv:2511.14210},
  year   = {2025}
}
R2 v1 2026-07-01T07:42:45.097Z