English
Related papers

Related papers: Multi-Object Navigation in real environments using…

200 papers

Autonomous navigation in congested maritime environments is a critical capability for a wide range of real-world applications. However, it remains an unresolved challenge due to complex vessel interactions and significant environmental…

Robotics · Computer Science 2026-03-05 Xinyu Cui , Xuanfa Jin , Xue Yan , Yongcheng Zeng , Luoyang Sun , Siying Wei , Ruizhi Zhang , Jian Zhao , Haifeng Zhang , Jun Wang

Simulation to real (Sim-to-Real) is an attractive approach to construct controllers for robotic tasks that are easier to simulate than to analytically solve. Working Sim-to-Real solutions have been demonstrated for tasks with a clear single…

Goal-oriented navigation presents a fundamental challenge for autonomous systems, requiring agents to navigate complex environments to reach designated targets. This survey offers a comprehensive analysis of multimodal navigation approaches…

Robotics · Computer Science 2025-04-23 I-Tak Ieong , Hao Tang

Multi-robot control in cluttered environments is a challenging problem that involves complex physical constraints, including robot-robot collisions, robot-obstacle collisions, and unreachable motions. Successful planning in such settings…

Robotics · Computer Science 2026-04-24 Jiabao Ji , Yongchao Chen , Yang Zhang , Ramana Rao Kompella , Chuchu Fan , Gaowen Liu , Shiyu Chang

Vision-and-language navigation (VLN) enables the agent to navigate to a remote location in 3D environments following the natural language instruction. In this field, the agent is usually trained and evaluated in the navigation simulators,…

Robotics · Computer Science 2024-10-15 Zihan Wang , Xiangyang Li , Jiahao Yang , Yeqi Liu , Shuqiang Jiang

This paper presents a reinforcement learning method for object goal navigation (ObjNav) where an agent navigates in 3D indoor environments to reach a target object based on long-term observations of objects and scenes. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Rui Fukushima , Kei Ota , Asako Kanezaki , Yoko Sasaki , Yusuke Yoshiyasu

Visual navigation models based on deep learning can learn effective policies when trained on large amounts of visual observations through reinforcement learning. Unfortunately, collecting the required experience in the real world requires…

Robotics · Computer Science 2020-10-27 Marco Rosano , Antonino Furnari , Luigi Gulino , Giovanni Maria Farinella

This paper presents a Sim2Real (Simulation to Reality) approach to bridge the gap between a trained agent in a simulated environment and its real-world implementation in navigating a robot in a similar setting. Specifically, we focus on…

Robotics · Computer Science 2025-01-07 Murad Mehrab Abrar , Souryadeep Mondal , Michelle Hickner

This work studies the problem of object goal navigation which involves navigating to an instance of the given object category in unseen environments. End-to-end learning-based navigation methods struggle at this task as they are ineffective…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Devendra Singh Chaplot , Dhiraj Gandhi , Abhinav Gupta , Ruslan Salakhutdinov

Autonomously navigating a robot in everyday crowded spaces requires solving complex perception and planning challenges. When using only monocular image sensor data as input, classical two-dimensional planning approaches cannot be used.…

Robotics · Computer Science 2022-03-24 Daniel Dugas , Olov Andersson , Roland Siegwart , Jen Jen Chung

Simultaneous localization and mapping (SLAM) remains challenging for a number of downstream applications, such as visual robot navigation, because of rapid turns, featureless walls, and poor camera quality. We introduce the Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Peter Karkus , Shaojun Cai , David Hsu

Object-goal navigation is a crucial engineering task for the community of embodied navigation; it involves navigating to an instance of a specified object category within unseen environments. Although extensive investigations have been…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Asako Kanezaki , Guillaume Caron , Yusuke Yoshiyasu

Navigating in unseen environments is crucial for mobile robots. Enhancing them with the ability to follow instructions in natural language will further improve navigation efficiency in unseen cases. However, state-of-the-art (SOTA)…

Robotics · Computer Science 2023-10-18 Chengguang Xu , Hieu T. Nguyen , Christopher Amato , Lawson L. S. Wong

We present SGoLAM, short for simultaneous goal localization and mapping, which is a simple and efficient algorithm for Multi-Object Goal navigation. Given an agent equipped with an RGB-D camera and a GPS/Compass sensor, our objective is to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Junho Kim , Eun Sun Lee , Mingi Lee , Donsu Zhang , Young Min Kim

Simultaneous Localization and Mapping (SLAM) is one of the most essential techniques in many real-world robotic applications. The assumption of static environments is common in most SLAM algorithms, which however, is not the case for most…

Robotics · Computer Science 2022-05-17 Han Wang , Jing Ying Ko , Lihua Xie

Realistic long-horizon tasks like image-goal navigation involve exploratory and exploitative phases. Assigned with an image of the goal, an embodied agent must explore to discover the goal, i.e., search efficiently using learned priors.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Justin Wasserman , Karmesh Yadav , Girish Chowdhary , Abhinav Gupta , Unnat Jain

The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guiding. However, a prominent gap persists: in Human-Robot…

Robotics · Computer Science 2024-03-22 Weiqin Zu , Wenbin Song , Ruiqing Chen , Ze Guo , Fanglei Sun , Zheng Tian , Wei Pan , Jun Wang

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

Vision-Language Models (VLMs) have been increasingly integrated into object navigation tasks for their rich prior knowledge and strong reasoning abilities. However, applying VLMs to navigation poses two key challenges: effectively…

Robotics · Computer Science 2025-09-17 Haokun Zhu , Zongtai Li , Zhixuan Liu , Wenshan Wang , Ji Zhang , Jonathan Francis , Jean Oh

What is a good visual representation for autonomous agents? We address this question in the context of semantic visual navigation, which is the problem of a robot finding its way through a complex environment to a target object, e.g. go to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Arsalan Mousavian , Alexander Toshev , Marek Fiser , Jana Kosecka , Ayzaan Wahid , James Davidson