English
Related papers

Related papers: DOZE: A Dataset for Open-Vocabulary Zero-Shot Obje…

200 papers

Zero-Shot Object Navigation (ZSON) enables agents to navigate towards open-vocabulary objects in unknown environments. The existing works of ZSON mainly focus on following individual instructions to find generic object classes, neglecting…

Robotics · Computer Science 2024-05-31 Yinpei Dai , Run Peng , Sikai Li , Joyce Chai

Navigating toward specific objects in unknown environments without additional training, known as Zero-Shot object navigation, poses a significant challenge in the field of robotics, which demands high levels of auxiliary information and…

Robotics · Computer Science 2024-03-25 Lingfeng Zhang , Qiang Zhang , Hao Wang , Erjia Xiao , Zixuan Jiang , Honglei Chen , Renjing Xu

We present a scalable approach for learning open-world object-goal navigation (ObjectNav) -- the task of asking a virtual robot (agent) to find any instance of an object in an unexplored environment (e.g., "find a sink"). Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Arjun Majumdar , Gunjan Aggarwal , Bhavika Devnani , Judy Hoffman , Dhruv Batra

Object navigation is crucial for robots, but traditional methods require substantial training data and cannot be generalized to unknown environments. Zero-shot object navigation (ZSON) aims to address this challenge, allowing robots to…

Robotics · Computer Science 2024-10-25 Congcong Wen , Yisiyuan Huang , Hao Huang , Yanjia Huang , Shuaihang Yuan , Yu Hao , Hui Lin , Yu-Shen Liu , Yi Fang

Human-interactive robotic systems, particularly autonomous vehicles (AVs), must effectively integrate human instructions into their motion planning. This paper introduces doScenes, a novel dataset designed to facilitate research on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Parthib Roy , Srinivasa Perisetla , Shashank Shriram , Harsha Krishnaswamy , Aryan Keskar , Ross Greer

In this paper, we present LOC-ZSON, a novel Language-driven Object-Centric image representation for object navigation task within complex scenes. We propose an object-centric image representation and corresponding losses for visual-language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Tianrui Guan , Yurou Yang , Harry Cheng , Muyuan Lin , Richard Kim , Rajasimman Madhivanan , Arnie Sen , Dinesh Manocha

Zero-shot object navigation (ZSON) in large-scale outdoor environments faces many challenges; we specifically address a coupled one: long-range targets that reduce to tiny projections and intermittent visibility due to partial or complete…

Robotics · Computer Science 2025-09-18 Tianle Zeng , Jianwei Peng , Hanjing Ye , Guangcheng Chen , Senzi Luo , Hong Zhang

Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well…

Robotics · Computer Science 2026-03-25 Yu He , Da Huang , Zhenyang Liu , Zixiao Gu , Qiang Sun , Guangnan Ye , Yanwei Fu , Yu-Gang Jiang

Zero-Shot Object Navigation (ZSON) in unknown multi-floor environments presents a significant challenge. Recent methods, mostly based on semantic value greedy waypoint selection, spatial topology-enhanced memory, and Multimodal Large…

Robotics · Computer Science 2026-03-19 Jingzhi Huang , Junkai Huang , Haoyang Yang , Haoang Li , Yi Wang

Zero-shot object-goal navigation (ZSON) is a challenging problem in robotics that requires a comprehensive understanding of both language and visual observations. Contextual cues from rooms and objects are critical, but their relative…

Robotics · Computer Science 2026-05-20 Taeyun Kim , Alvin Jinsung Choi , Dasol Hong , Hyun Myung

The task of Visual Object Navigation (VON) involves an agent's ability to locate a particular object within a given scene. In order to successfully accomplish the VON task, two essential conditions must be fulfilled:1) the user must know…

Robotics · Computer Science 2023-11-07 Hongcheng Wang , Andy Guan Hong Chen , Xiaoqi Li , Mingdong Wu , Hao Dong

Zero-Shot Object Navigation (ZSON) requires agents to navigate to objects specified via open-ended natural language without predefined categories or prior environmental knowledge. While recent methods leverage foundation models or…

Robotics · Computer Science 2025-09-19 Ruimeng Liu , Xinhang Xu , Shenghai Yuan , Lihua Xie

Existing datasets for autonomous driving (AD) often lack diversity and long-range capabilities, focusing instead on 360{\deg} perception and temporal reasoning. To address this gap, we introduce Zenseact Open Dataset (ZOD), a large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Mina Alibeigi , William Ljungbergh , Adam Tonderski , Georg Hess , Adam Lilja , Carl Lindstrom , Daria Motorniuk , Junsheng Fu , Jenny Widahl , Christoffer Petersson

Zero-shot object navigation in unknown environments presents significant challenges, mainly due to two key limitations: insufficient semantic guidance leads to inefficient exploration, while limited spatial memory resulting from…

Robotics · Computer Science 2025-09-30 Xiangyi Meng , Delun Li , Zihao Mao , Yi Yang , Wenjie Song

Open-Vocabulary Object Navigation (OVON) requires an embodied agent to locate a language-specified target in unknown environments. Existing zero-shot methods often reason over dense frontier points under incomplete observations, causing…

Robotics · Computer Science 2026-03-31 Maoguo Gao , Zejun Zhu , Zhiming Sun , Zhengwei Ma , Longze Yuan , Zhongjing Ma , Zhigang Gao , Jinhui Zhang , Suli Zou

Zero-shot object navigation (ZSON) in unseen environments remains a challenging problem for household robots, requiring strong perceptual understanding and decision-making capabilities. While recent methods leverage metric maps and Large…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Qunchao Jin , Yilin Wu , Changhao Chen

We present the Semantics-aware Dataset and Benchmark Generation Pipeline for Open-vocabulary Object Navigation in Dynamic Scenes (SD-OVON). It utilizes pretraining multimodal foundation models to generate infinite unique photo-realistic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Dicong Qiu , Jiadi You , Zeying Gong , Ronghe Qiu , Hui Xiong , Junwei Liang

Adaptive navigation in unfamiliar environments is crucial for household service robots but remains challenging due to the need for both low-level path planning and high-level scene understanding. While recent vision-language model (VLM)…

Robotics · Computer Science 2025-09-29 Tianjun Gu , Linfeng Li , Xuhong Wang , Chenghua Gong , Jingyu Gong , Zhizhong Zhang , Yuan Xie , Lizhuang Ma , Xin Tan

In the realm of household robotics, the Zero-Shot Object Navigation (ZSON) task empowers agents to adeptly traverse unfamiliar environments and locate objects from novel categories without prior explicit training. This paper introduces…

Robotics · Computer Science 2024-02-07 Pengying Wu , Yao Mu , Bingxian Wu , Yi Hou , Ji Ma , Shanghang Zhang , Chang Liu

Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding. However, their potential to comprehend embodied environments and navigate within them remains…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhaowei Wang , Hongming Zhang , Tianqing Fang , Ye Tian , Yue Yang , Kaixin Ma , Xiaoman Pan , Yangqiu Song , Dong Yu
‹ Prev 1 2 3 10 Next ›