English
Related papers

Related papers: SSR-ZSON: Zero-Shot Object Navigation via Spatial-…

200 papers

Zero-Shot Action Recognition (ZSAR) aims to recognize video actions that have never been seen during training. Most existing methods assume a shared semantic space between seen and unseen actions and intend to directly learn a mapping from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Zhiyi Gao , Yonghong Hou , Wanqing Li , Zihui Guo , Bin Yu

This work studies the problem of object goal navigation which involves navigating to an instance of the given object category in unseen environments. End-to-end learning-based navigation methods struggle at this task as they are ineffective…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Devendra Singh Chaplot , Dhiraj Gandhi , Abhinav Gupta , Ruslan Salakhutdinov

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

Robotics · Computer Science 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

Zero-shot vision-and-language navigation (VLN) has gained significant attention due to its minimal data collection costs and inherent generalization. This paradigm is typically driven by the integration of pre-trained Vision-Language Models…

Robotics · Computer Science 2026-05-15 Ziyi Xia , Chaoran Xiong , Litao Wei , Xinhao Hu , Ling Pei

Zero-shot learning (ZSL) aims to recognize unseen classes by transferring semantic knowledge from seen classes to unseen ones, guided by semantic information. To this end, existing works have demonstrated remarkable performance by utilizing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Wenjin Hou , Dingjie Fu , Kun Li , Shiming Chen , Hehe Fan , Yi Yang

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka

Navigating to a specified object in an unknown environment is a fundamental yet challenging capability of embodied intelligence. However, current methods struggle to balance decision frequency with intelligence, resulting in decisions…

Zero-Shot Learning (ZSL) focuses on classifying samples of unseen classes with only their side semantic information presented during training. It cannot handle real-life, open-world scenarios where there are test samples of unknown classes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Tianqi Li , Guansong Pang , Xiao Bai , Jin Zheng , Lei Zhou , Xin Ning

Zero-shot learning deals with the ability to recognize objects without any visual training sample. To counterbalance this lack of visual data, each class to recognize is associated with a semantic prototype that reflects the essential…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Zero-shot Learning (ZSL) classification categorizes or predicts classes (labels) that are not included in the training set (unseen classes). Recent works proposed different semantic autoencoder (SAE) models where the encoder embeds a visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 William Heyden , Habib Ullah , M. Salman Siddiqui , Fadi Al Machot

Zero-shot learning (ZSL) aims to recognize novel classes through transferring shared semantic knowledge (e.g., attributes) from seen classes to unseen classes. Recently, attention-based methods have exhibited significant progress which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinwei Han , Yingguo Gao , Zhiwen Lin , Ke Yan , Shouhong Ding , Yuan Gao , Gui-Song Xia

Vision-Language Models (VLMs) have been increasingly integrated into object navigation tasks for their rich prior knowledge and strong reasoning abilities. However, applying VLMs to navigation poses two key challenges: effectively…

Robotics · Computer Science 2025-09-17 Haokun Zhu , Zongtai Li , Zhixuan Liu , Wenshan Wang , Ji Zhang , Jonathan Francis , Jean Oh

In this paper, we present a novel method for reliable frontier selection in Zero-Shot Object Goal Navigation (ZS-OGN), enhancing robotic navigation systems with foundation models to improve commonsense reasoning in indoor environments. Our…

Robotics · Computer Science 2024-10-29 Shuaihang Yuan , Halil Utku Unlu , Hao Huang , Congcong Wen , Anthony Tzes , Yi Fang

Zero-shot classification is a promising paradigm to solve an applicable problem when the training classes and test classes are disjoint. Achieving this usually needs experts to externalize their domain knowledge by manually specifying a…

Human-Computer Interaction · Computer Science 2021-08-17 Shichao Jia , Zeyu Li , Nuo Chen , Jiawan Zhang

Recent open-vocabulary robot mapping methods enrich dense geometric maps with pre-trained visual-language features, achieving a high level of detail and guiding robots to find objects specified by open-vocabulary language queries. While the…

Robotics · Computer Science 2026-03-04 Fujing Xie , Sören Schwertfeger , Hermann Blum

Visual navigation in robotics traditionally relies on globally-consistent 3D maps or learned controllers, which can be computationally expensive and difficult to generalize across diverse environments. In this work, we present a novel…

Robotics · Computer Science 2025-09-11 Stefan Podgorski , Sourav Garg , Mehdi Hosseinzadeh , Lachlan Mares , Feras Dayoub , Ian Reid

Given the semantic descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen classes without labeled training data by exploiting semantic information, which contains knowledge between seen and unseen classes. Existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Vivek Chalumuri , Bac Nguyen

We propose a novel Generalized Zero-Shot learning (GZSL) method that is agnostic to both unseen images and unseen semantic vectors during training. Prior works in this context propose to map high-dimensional visual features to the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

Zero-shot learning, which aims to recognize new categories that are not included in the training set, has gained popularity owing to its potential ability in the real-word applications. Zero-shot learning models rely on learning an…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Xinsheng Wang , Shanmin Pang , Jihua Zhu , Zhongyu Li , Zhiqiang Tian , Yaochen Li

In this paper, we propose a training-free framework for vision-and-language navigation (VLN). Existing zero-shot VLN methods are mainly designed for discrete environments or involve unsupervised training in continuous simulator…

Robotics · Computer Science 2025-09-15 Hang Yin , Haoyu Wei , Xiuwei Xu , Wenxuan Guo , Jie Zhou , Jiwen Lu