English
Related papers

Related papers: SSR-ZSON: Zero-Shot Object Navigation via Spatial-…

200 papers

Object Goal Navigation (ObjectNav) challenges robots to find objects in unseen environments, demanding sophisticated reasoning. While Vision-Language Models (VLMs) show potential, current ObjectNav methods often employ them superficially,…

Robotics · Computer Science 2025-06-23 Mobin Habibpour , Fatemeh Afghah

In this paper, we propose a new framework for zero-shot object navigation. Existing zero-shot object navigation methods prompt LLM with the text of spatially closed objects, which lacks enough scene context for in-depth reasoning. To better…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Hang Yin , Xiuwei Xu , Zhenyu Wu , Jie Zhou , Jiwen Lu

Zero-Shot Object Navigation (ZSON) enables agents to navigate towards open-vocabulary objects in unknown environments. The existing works of ZSON mainly focus on following individual instructions to find generic object classes, neglecting…

Robotics · Computer Science 2024-05-31 Yinpei Dai , Run Peng , Sikai Li , Joyce Chai

Vision-and-Language Navigation (VLN) has recently benefited from Multimodal Large Language Models (MLLMs), enabling zero-shot navigation. While recent exploration-based zero-shot methods have shown promising results by leveraging global…

Robotics · Computer Science 2026-03-31 Jiwen Zhang , Xiangyu Shi , Siyuan Wang , Zerui Li , Zhongyu Wei , Qi Wu

The Zero-shot Vision-and-Language Navigation in Continuous Environments (VLN-CE) task requires agents to navigate previously unseen 3D environments using natural language instructions, without any scene-specific training. A critical…

Robotics · Computer Science 2025-11-04 Diqi He , Xuehao Gao , Hao Li , Junwei Han , Dingwen Zhang

Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wen Tang , Ashkan Panahi , Hamid Krim

Zero-Shot Object Goal Navigation (ZS-OGN) enables robots or agents to navigate toward objects of unseen categories without object-specific training. Traditional approaches often leverage categorical semantic information for navigation…

Robotics · Computer Science 2024-11-01 Shuaihang Yuan , Hao Huang , Yu Hao , Congcong Wen , Anthony Tzes , Yi Fang

Zero-shot object navigation requires agents to locate unseen target objects in unfamiliar environments without prior maps or task-specific training which remains a significant challenge. Although recent advancements in vision-language…

Robotics · Computer Science 2026-04-08 Feng Wu , Wei Zuo , Wenliang Yang , Jun Xiao , Yang Liu , Xinhua Zeng

Generalized Zero-Shot Learning (GZSL) and Open-Set Recognition (OSR) are two mainstream settings that greatly extend conventional visual object recognition. However, the limitations of their problem settings are not negligible. The novel…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Zhaonan Li , Hongfu Liu

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

In most recent years, zero-shot recognition (ZSR) has gained increasing attention in machine learning and image processing fields. It aims at recognizing unseen class instances with knowledge transferred from seen classes. This is typically…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Jingcai Guo , Song Guo

Zero-shot learning (ZSL) aims to recognize unseen classes based on the knowledge of seen classes. Previous methods focused on learning direct embeddings from global features to the semantic space in hope of knowledge transfer from seen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Ziyang Wang , Yunhao Gou , Jingjing Li , Yu Zhang , Yang Yang

Object Navigation (ObjectNav) is a fundamental task in embodied artificial intelligence. Although significant progress has been made in semantic map construction and target direction prediction in current research, redundant exploration and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Junjie Li , Nan Zhang , Xiaoyang Qu , Kai Lu , Guokuan Li , Jiguang Wan , Jianzong Wang

Zero-Shot Object Navigation (ZSON) requires agents to autonomously locate and approach unseen objects in unfamiliar environments and has emerged as a particularly challenging task within the domain of Embodied AI. Existing datasets for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ji Ma , Hongming Dai , Yao Mu , Pengying Wu , Hao Wang , Xiaowei Chi , Yang Fei , Shanghang Zhang , Chang Liu

Zero-shot recognition (ZSR) aims to recognize target-domain data instances of unseen classes based on the models learned from associated pairs of seen-class source and target domain data. One of the key challenges in ZSR is the relative…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Ziming Zhang , Venkatesh Saligrama

With the rapid progress of foundation models and robotics, vision-language navigation (VLN) has emerged as a key task for embodied agents with broad practical applications. We address VLN in continuous environments, a particularly…

Robotics · Computer Science 2025-09-26 Boqi Li , Siyuan Li , Weiyi Wang , Anran Li , Zhong Cao , Henry X. Liu

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Debasmit Das , C. S. George Lee

Zero-Shot Learning (ZSL) aims at classifying unlabeled objects by leveraging auxiliary knowledge, such as semantic representations. A limitation of previous approaches is that only intrinsic properties of objects, e.g. their visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Eloi Zablocki , Patrick Bordes , Benjamin Piwowarski , Laure Soulier , Patrick Gallinari

Adaptive navigation in unfamiliar environments is crucial for household service robots but remains challenging due to the need for both low-level path planning and high-level scene understanding. While recent vision-language model (VLM)…

Robotics · Computer Science 2025-09-29 Tianjun Gu , Linfeng Li , Xuhong Wang , Chenghua Gong , Jingyu Gong , Zhizhong Zhang , Yuan Xie , Lizhuang Ma , Xin Tan

Vision-and-Language Navigation (VLN) in continuous environments requires agents to interpret natural language instructions while navigating unconstrained 3D spaces. Existing VLN-CE frameworks rely on a two-stage approach: a waypoint…

Robotics · Computer Science 2025-06-18 Xiangyu Shi , Zerui Li , Wenqi Lyu , Jiatong Xia , Feras Dayoub , Yanyuan Qiao , Qi Wu