OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction
Abstract
Drones in human environments often lack spatially grounded in- terfaces for situated communication. We present OmniAI, an em- bodied aerial agent that supports surface-adaptive interaction by switching projection between an onboard screen and nearby en- vironmental surfaces. A servo-actuated MEMS laser projector renders text-and-image responses from a web-augmented LLM pipeline. Projection surfaces are detected online using RGB-D sensing and RANSAC plane fitting, without pre-mapped geometry. OmniAI provides functionally equivalent voice and gesture con- trol for both drone motion and projected content. By combining speech, mid-air gestures, adaptive projection, and aerial mobility, OmniAI demonstrates a mobile spatial AR interface for context- aware human-drone interaction.
Cite
@article{arxiv.2608.00721,
title = {OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction},
author = {Nikita Kuzmin and Yuhua Jin and Georgii Demianchuk and Mariya Lezina and Fawad Mehboob and Ivan Valuev and Nikolai Lutsenko and Miguel Altamirano Cabrera and Dzmitry Tsetserukou},
journal= {arXiv preprint arXiv:2608.00721},
year = {2026}
}