English

IMAIA: Interactive Maps AI Assistant for Travel Planning and Geo-Spatial Intelligence

Artificial Intelligence 2026-03-18 v4 Computer Vision and Pattern Recognition

Abstract

Map applications are still largely point-and-click, making it difficult to ask map-centric questions or connect what a camera sees to the surrounding geospatial context with view-conditioned inputs. We introduce IMAIA, an interactive Maps AI Assistant that enables natural-language interaction with both vector (street) maps and satellite imagery, and augments camera inputs with geospatial intelligence to help users understand the world. IMAIA comprises two complementary components. Maps Plus treats the map as first-class context by parsing tiled vector/satellite views into a grid-aligned representation that a language model can query to resolve deictic references (e.g., ``the flower-shaped building next to the park in the top-right''). Places AI Smart Assistant (PAISA) performs camera-aware place understanding by fusing image--place embeddings with geospatial signals (location, heading, proximity) to ground a scene, surface salient attributes, and generate concise explanations. A lightweight multi-agent design keeps latency low and exposes interpretable intermediate decisions. Across map-centric QA and camera-to-place grounding tasks, IMAIA improves accuracy and responsiveness over strong baselines while remaining practical for user-facing deployments. By unifying language, maps, and geospatial cues, IMAIA moves beyond scripted tools toward conversational mapping that is both spatially grounded and broadly usable.

Cite

@article{arxiv.2507.06993,
  title  = {IMAIA: Interactive Maps AI Assistant for Travel Planning and Geo-Spatial Intelligence},
  author = {Jieren Deng and Zhizhang Hu and Ziyan He and Aleksandar Cvetkovic and Pak Kiu Chung and Dragomir Yankov and Chiqun Zhang},
  journal= {arXiv preprint arXiv:2507.06993},
  year   = {2026}
}

Comments

Accepted to The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026

R2 v1 2026-07-01T03:53:27.851Z