English
Related papers

Related papers: APEX: A Decoupled Memory-based Explorer for Asynch…

200 papers

Object Goal Navigation (ObjectNav) challenges robots to find objects in unseen environments, demanding sophisticated reasoning. While Vision-Language Models (VLMs) show potential, current ObjectNav methods often employ them superficially,…

Robotics · Computer Science 2025-06-23 Mobin Habibpour , Fatemeh Afghah

Visual navigation in unknown environments based solely on natural language descriptions is a key capability for intelligent robots. In this work, we propose a navigation framework built upon off-the-shelf Visual Language Models (VLMs),…

Robotics · Computer Science 2025-08-08 Weifan Zhang , Tingguang Li , Yuzhen Liu

A navigable agent needs to understand both high-level semantic instructions and precise spatial perceptions. Building navigation agents centered on Multimodal Large Language Models (MLLMs) demonstrates a promising solution due to their…

Robotics · Computer Science 2026-02-18 Zerui Li , Hongpei Zheng , Fangguo Zhao , Aidan Chan , Jian Zhou , Sihao Lin , Shijie Li , Qi Wu

Embodied visual navigation remains a challenging task, as agents must explore unknown environments with limited knowledge. Existing zero-shot studies have shown that incorporating memory mechanisms to support goal-directed behavior can…

Robotics · Computer Science 2026-03-24 Ningnan Wang , Weihuang Chen , Liming Chen , Haoxuan Ji , Zhongyu Guo , Xuchong Zhang , Hongbin Sun

Visual prompting has emerged as a powerful method for adapting pre-trained models to new domains without updating model parameters. However, existing prompting methods typically optimize a single prompt per domain and apply it uniformly to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Evren Çetinkaya , Sangmin Lee , Jung Uk Kim , Hong Joo Lee , Nassir Navab

This paper addresses the Object Goal Navigation problem, where a robot must efficiently find a target object in an unknown environment. Existing implicit memory-based methods struggle with long-term memory retention and planning, while…

Robotics · Computer Science 2025-12-02 Thomas Chabal , Shizhe Chen , Jean Ponce , Cordelia Schmid

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated data or require…

Robotics · Computer Science 2025-06-05 Arnab Debnath , Gregory J. Stein , Jana Kosecka

We consider the problem of object goal navigation in unseen environments. Solving this problem requires learning of contextual semantic priors, a challenging endeavour given the spatial and semantic variability of indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Georgios Georgakis , Bernadette Bucher , Karl Schmeckpeper , Siddharth Singh , Kostas Daniilidis

As a specific semantic segmentation task, aerial imagery segmentation has been widely employed in high spatial resolution (HSR) remote sensing images understanding. Besides common issues (e.g. large scale variation) faced by general…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Lin Huang , Qiyuan Dong , Lijun Wu , Jia Zhang , Jiang Bian , Tie-Yan Liu

To autonomously navigate in real-world environments, special in search and rescue operations, Unmanned Aerial Vehicles (UAVs) necessitate comprehensive maps to ensure safety. However, the prevalent metric map often lacks semantic…

Robotics · Computer Science 2024-01-17 Thanh Nguyen Canh , Armagan Elibol , Nak Young Chong , Xiem HoangVan

Embodied exploration is a target-driven process that requires embodied agents to possess fine-grained perception and knowledge-enhanced decision making. While recent attempts leverage MLLMs for exploration due to their strong perceptual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Gengyuan Zhang , Mingcong Ding , Jingpei Wu , Ruotong Liao , Volker Tresp

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

AI agents, autonomous digital actors, need agent-native protocols; existing methods include GUI automation and MCP-based skills, with defects of high token consumption, fragmented interaction, inadequate security, due to lacking a unified…

Artificial Intelligence · Computer Science 2026-04-07 Xu Mingze

Multi-objective alignment for text-to-image generation is commonly implemented via static linear scalarization, but fixed weights often fail under heterogeneous rewards, leading to optimization imbalance where models overfit high-variance,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Dongliang Chen , Xinlin Zhuang , Junjie Xu , Luojian Xie , Zehui Wang , Jiaxi Zhuang , Haolin Yang , Liang Dou , Xiao He , Xingjiao Wu , Ying Qian

The Zero-Shot Object Navigation (ZSON) task requires embodied agents to find a previously unseen object by navigating in unfamiliar environments. Such a goal-oriented exploration heavily relies on the ability to perceive, understand, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Linqing Zhong , Chen Gao , Zihan Ding , Yue Liao , Huimin Ma , Shifeng Zhang , Xu Zhou , Si Liu

Embodied navigation for long-horizon tasks, guided by complex natural language instructions, remains a formidable challenge in artificial intelligence. Existing agents often struggle with robust long-term planning about unseen environments,…

Robotics · Computer Science 2026-03-16 Fei Liu , Shichao Xie , Minghua Luo , Zedong Chu , Junjun Hu , Xiaolong Wu , Mu Xu

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Recently emerged Vision-and-Language Navigation (VLN) tasks have drawn significant attention in both computer vision and natural language processing communities. Existing VLN tasks are built for agents that navigate on the ground, either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shubo Liu , Hongsheng Zhang , Yuankai Qi , Peng Wang , Yaning Zhang , Qi Wu

While unmanned aerial vehicles (UAVs) offer wide-area, high-altitude coverage for anomaly detection, they face challenges such as dynamic viewpoints, scale variations, and complex scenes. Existing datasets and methods, mainly designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Mengjingcheng Mo , Xinyang Tong , Mingpi Tan , Jiaxu Leng , Jiankang Zheng , Yiran Liu , Haosheng Chen , Ji Gan , Weisheng Li , Xinbo Gao

Autonomous path planning requires a synergy between global reasoning and geometric precision, especially in complex or cluttered environments. While classical A* is valued for its optimality, it incurs prohibitive computational and memory…

Artificial Intelligence · Computer Science 2026-01-23 Minh Hieu Ha , Khanh Ly Ta , Hung Phan , Tung Doan , Tung Dao , Dao Tran , Huynh Thi Thanh Binh