English
Related papers

Related papers: ReasonNavi: Human-Inspired Global Map Reasoning fo…

200 papers

This paper advances motion agents empowered by large language models (LLMs) toward autonomous navigation in dynamic and cluttered environments, significantly surpassing first and recent seminal but limited studies on LLM's spatial…

Artificial Intelligence · Computer Science 2025-06-06 Yubo Zhao , Qi Wu , Yifan Wang , Yu-Wing Tai , Chi-Keung Tang

While Vision-Language Models (VLMs) can solve complex tasks through agentic reasoning, their capabilities remain largely constrained to text-oriented chain-of-thought or isolated tool invocation. They fail to exhibit the human-like…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yong Xien Chng , Tao Hu , Wenwen Tong , Xueheng Li , Jiandong Chen , Haojia Yu , Jiefan Lu , Hewei Guo , Hanming Deng , Chengjun Xie , Gao Huang , Dahua Lin , Lewei Lu

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Embodied exploration is a target-driven process that requires embodied agents to possess fine-grained perception and knowledge-enhanced decision making. While recent attempts leverage MLLMs for exploration due to their strong perceptual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Gengyuan Zhang , Mingcong Ding , Jingpei Wu , Ruotong Liao , Volker Tresp

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

Artificial Intelligence · Computer Science 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

The image geolocalization task aims to predict the location where an image was taken anywhere on Earth using visual clues. Existing large vision-language model (LVLM) approaches leverage world knowledge, chain-of-thought reasoning, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yuxiang Ji , Yong Wang , Ziyu Ma , Yiming Hu , Hailang Huang , Xuecai Hu , Guanhua Chen , Liaoni Wu , Xiangxiang Chu

Vision-language models (VLMs) and generative world models are opening new opportunities for embodied navigation. VLMs are increasingly used as direct planners or trajectory predictors, while world models support look-ahead reasoning by…

Artificial Intelligence · Computer Science 2026-04-10 Hongjin Chen , Shangyun Jiang , Tonghua Su , Chen Gao , Xinlei Chen , Yong Li , Zhibo Chen

Object-goal navigation (Object-nav) entails searching, recognizing and navigating to a target object. Object-nav has been extensively studied by the Embodied-AI community, but most solutions are often restricted to considering static…

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text…

Artificial Intelligence · Computer Science 2026-04-14 Hongyu Chen , Liang Lin , Guangrun Wang

Although learning-based vision-and-language navigation (VLN) agents can learn spatial knowledge implicitly from large-scale training data, zero-shot VLN agents lack this process, relying primarily on local observations for navigation, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiwen Zhang , Zejun Li , Siyuan Wang , Xiangyu Shi , Zhongyu Wei , Qi Wu

This study focuses on using large language models (LLMs) as a planner for embodied agents that can follow natural language instructions to complete complex tasks in a visually-perceived environment. The high data cost and poor sample…

Artificial Intelligence · Computer Science 2023-09-08 Chan Hee Song , Jiaman Wu , Clayton Washington , Brian M. Sadler , Wei-Lun Chao , Yu Su

Embodied visual navigation remains a challenging task, as agents must explore unknown environments with limited knowledge. Existing zero-shot studies have shown that incorporating memory mechanisms to support goal-directed behavior can…

Robotics · Computer Science 2026-03-24 Ningnan Wang , Weihuang Chen , Liming Chen , Haoxuan Ji , Zhongyu Guo , Xuchong Zhang , Hongbin Sun

Spatial reasoning is an essential problem in embodied AI research. Efforts to enhance spatial reasoning abilities through supplementary spatial data and fine-tuning have proven limited and ineffective when addressing complex embodied tasks,…

Vision-Language Navigation aims to enable agents to understand natural language instructions and carry out appropriate navigation actions in real-world environments. Most work focuses on indoor settings, with little research in complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jiaxu Zhou , Shaobo Wang , Zhiyuan Yang , Zhenjun Yu , Tao Li

Multimodal Large Language Models (MLLMs) have shown impressive reasoning abilities and general intelligence in various domains. It inspires researchers to train end-to-end MLLMs or utilize large models to generate policies with…

Robotics · Computer Science 2024-07-31 Qi Lv , Hao Li , Xiang Deng , Rui Shao , Michael Yu Wang , Liqiang Nie

Vision-language models (VLMs) have emerged as a promising direction for end-to-end autonomous driving (AD) by jointly modeling visual observations, driving context, and language-based reasoning. However, existing VLM-based systems face a…

Robotics · Computer Science 2026-03-10 Ximeng Tao , Pardis Taghavi , Dimitar Filev , Reza Langari , Gaurav Pandey

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

Zero-shot navigation is a critical challenge in Vision-Language Navigation (VLN) tasks, where the ability to adapt to unfamiliar instructions and to act in unknown environments is essential. Existing supervised learning-based models,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Dingbang Li , Wenzhou Chen , Xin Lin

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved 2D visual understanding, prompting interest in their application to complex 3D reasoning tasks. However, it remains unclear whether these models can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaoyu Zhan , Wenxuan Huang , Hao Sun , Xinyu Fu , Changfeng Ma , Shaosheng Cao , Bohan Jia , Shaohui Lin , Zhenfei Yin , Lei Bai , Wanli Ouyang , Yuanqi Li , Jie Guo , Yanwen Guo

Spatial reasoning in partially observable environments has often been approached through passive predictive models, yet theories of embodied cognition suggest that genuinely useful representations arise only when perception is tightly…

Artificial Intelligence · Computer Science 2025-04-29 Li Jin , Liu Jia