English
Related papers

Related papers: SpatialFly: Geometry-Guided Representation Alignme…

200 papers

Aerial robots play a vital role in various applications where the situational awareness of the robots concerning the environment is a fundamental demand. As one such use case, drones in GPS-denied environments require equipping with…

Robotics · Computer Science 2024-06-24 Ahmed Radwan , Ali Tourani , Hriday Bavle , Holger Voos , Jose Luis Sanchez-Lopez

Inspection of confined infrastructure such as culverts often requires accessing hidden spaces whose entrances are reachable primarily from elevated viewpoints. Aerial-ground cooperation enables a UAV to deploy a compact UGV for interior…

Robotics · Computer Science 2026-03-17 Seoyoung Lee , Shaekh Mohammad Shithil , Durgakant Pushp , Lantao Liu , Zhangyang Wang

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

Robotics · Computer Science 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

Despite recent advances on multi-modal models, 3D spatial reasoning remains a challenging task for state-of-the-art open-source and proprietary models. Recent studies explore data-driven approaches and achieve enhanced spatial reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wufei Ma , Yu-Cheng Chou , Qihao Liu , Xingrui Wang , Celso de Melo , Jianwen Xie , Alan Yuille

Empowered by large-scale training, vision-language models (VLMs) achieve strong image and video understanding, yet their ability to perform spatial reasoning in both static scenes and dynamic videos remains limited. Recent advances try to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shihua Zhang , Qiuhong Shen , Shizun Wang , Tianbo Pan , Xinchao Wang

Accurate perception of UAVs in complex low-altitude environments is critical for airspace security and related intelligent systems. Developing reliable solutions requires large-scale, accurately annotated, and multimodal data. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Longkun Zou , Jiale Wang , Rongqin Liang , Hai Wu , Ke Chen , Yaowei Wang

Existing Vision-Language Navigation (VLN) task requires agents to follow verbose instructions, ignoring some potentially useful global spatial priors, limiting their capability to reason about spatial structures. Although human-readable…

Robotics · Computer Science 2026-03-19 Kehan Chen , Yan Huang , Dong An , Jiawei He , Yifei Su , Jing Liu , Nianfeng Liu , Liang Wang

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiwen Zhang , Zejun Li , Siyuan Wang , Xiangyu Shi , Zhongyu Wei , Qi Wu

Spatial intelligence in vision-language models (VLMs) attracts research interest with the practical demand to reason in the 3D world.Despite promising results, most existing methods follow the conventional 2D pipeline in VLMs and use…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jerry Jiang , Haowen Sun , Denis Gudovskiy , Yohei Nakata , Tomoyuki Okuno , Kurt Keutzer , Wenzhao Zheng

Multimodal Large Language Models (MLLMs) demonstrate exceptional semantic reasoning but struggle with 3D spatial perception when restricted to pure RGB inputs. Despite leveraging implicit geometric priors from 3D reconstruction models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiaxin Zhang , Junjun Jiang , Haijie Li , Youyu Chen , Kui Jiang , Dave Zhenyu Chen

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Illumination inconsistency is a fundamental challenge in multi-view 3D reconstruction. Variations in sunlight direction, cloud cover, and shadows break the constant-lighting assumption underlying both classical multi-view stereo (MVS) and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Kang Du , Xue Liao , Junpeng Xia , Chaozheng Guo , Yi Gu , Yirui Guan , Duotun Wang , Sheng Huang , Zeyu Wang

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive…

Robotics · Computer Science 2026-05-19 Qianzhong Chen , Naixiang Gao , Suning Huang , JunEn Low , Timothy Chen , Jiankai Sun , Mac Schwager

Recent Vision-and-Language Navigation (VLN) advancements are promising, but their idealized assumptions about robot movement and control fail to reflect physically embodied deployment challenges. To bridge this gap, we introduce VLN-PE, a…

Robotics · Computer Science 2025-09-29 Liuyi Wang , Xinyuan Xia , Hui Zhao , Hanqing Wang , Tai Wang , Yilun Chen , Chengju Liu , Qijun Chen , Jiangmiao Pang

Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization -- the problem of predicting executable 3D points conditioned on visual observations and…

Robotics · Computer Science 2026-03-31 Qiming Zhu , Zhirui Fang , Tianming Zhang , Chuanxiu Liu , Xiaoke Jiang , Lei Zhang

Zero-Shot Object Navigation in unknown environments poses significant challenges for Unmanned Aerial Vehicles (UAVs) due to the conflict between high-level semantic reasoning requirements and limited onboard computational resources. To…

Robotics · Computer Science 2026-02-04 Weiqi Gai , Yuman Gao , Yuan Zhou , Yufan Xie , Zhiyang Liu , Yuze Wu , Xin Zhou , Fei Gao , Zhijun Meng

The capabilities of autonomous flight with unmanned aerial vehicles (UAVs) have significantly increased in recent times. However, basic problems such as fast and robust geo-localization in GPS-denied environments still remain unsolved.…

Robotics · Computer Science 2021-08-10 Shuxiao Chen , Xiangyu Wu , Mark W. Mueller , Koushil Sreenath

Reliable real-time 3D localization is essential for multi-UAV navigation, collision avoidance, and coordinated flight, yet onboard estimates can degrade under GNSS multipath, non-line-of-sight reception, vertical drift, and intentional…

Robotics · Computer Science 2026-05-14 Hosam Alamleh , Damir Pulatov

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Aerial Vision-and-Language Navigation (VLN) is an emerging task that enables Unmanned Aerial Vehicles (UAVs) to navigate outdoor environments using natural language instructions and visual cues. However, due to the extended trajectories and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Ruipu Wu , Yige Zhang , Jinyu Chen , Linjiang Huang , Shifeng Zhang , Xu Zhou , Liang Wang , Si Liu