English
Related papers

Related papers: Navigating to Objects in the Real World

200 papers

We consider the problem of object goal navigation in unseen environments. Solving this problem requires learning of contextual semantic priors, a challenging endeavour given the spatial and semantic variability of indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Georgios Georgakis , Bernadette Bucher , Karl Schmeckpeper , Siddharth Singh , Kostas Daniilidis

Most prior methods for learning navigation policies require access to simulation environments, as they need online policy interaction and rely on ground-truth maps for rewards. However, building simulators is expensive (requires manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Meera Hahn , Devendra Chaplot , Shubham Tulsiani , Mustafa Mukadam , James M. Rehg , Abhinav Gupta

This paper presents a study on the development of an obstacle-avoidance navigation system for autonomous navigation in home environments. The system utilizes vision-based techniques and advanced path-planning algorithms to enable the robot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Sagar Manglani

Conventional navigation pipelines for legged robots remain largely geometry-centric, relying on dense SLAM representations that are fragile under rapid motion and offer limited support for semantic decision making in open-world exploration.…

Robotics · Computer Science 2026-03-09 Guoyang Zhao , Yudong Li , Weiqing Qi , Kai Zhang , Bonan Liu , Kai Chen , Haoang Li , Jun Ma

This work provides a complete framework for the simulation, co-optimization, and sim-to-real transfer of the design and control of soft legged robots. The compliance of soft robots provides a form of "mechanical intelligence" -- the ability…

Robotics · Computer Science 2022-02-10 Charles Schaff , Audrey Sedal , Matthew R. Walter

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots, with recent deep reinforcement learning approaches showing promising results. However, the complexity of the real world makes it infeasible…

Robotics · Computer Science 2025-04-29 Diego Martinez-Baselga , Luis Riazuelo , Luis Montano

Mobile robots exploring indoor environments increasingly rely on vision-language models to perceive high-level semantic cues in camera images, such as object categories. Such models offer the potential to substantially advance robot…

Robotics · Computer Science 2025-10-09 Utkarsh Bajpai , Julius Rückin , Cyrill Stachniss , Marija Popović

Enabling robotic assistants to navigate complex environments and locate objects described in free-form language is a critical capability for real-world deployment. While foundation models, particularly Vision-Language Models (VLMs), offer…

Robotics · Computer Science 2026-04-16 Naoki Yokoyama , Sehoon Ha

Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent…

Robotics · Computer Science 2026-03-10 Haokun Zhu , Zongtai Li , Zihan Liu , Kevin Guo , Zhengzhi Lin , Yuxin Cai , Guofei Chen , Chen Lv , Wenshan Wang , Jean Oh , Ji Zhang

Object goal navigation is an important problem in Embodied AI that involves guiding the agent to navigate to an instance of the object category in an unknown environment -- typically an indoor scene. Unfortunately, current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Junting Chen , Guohao Li , Suryansh Kumar , Bernard Ghanem , Fisher Yu

Service and assistive robots are increasingly being deployed in dynamic social environments; however, ensuring transparent and explainable interactions remains a significant challenge. This paper presents a multimodal explainability module…

Robotics · Computer Science 2026-04-09 Oluwadamilola Sotomi , Devika Kodi , Aliasghar Arab

Does progress in simulation translate to progress on robots? If one method outperforms another in simulation, how likely is that trend to hold in reality on a robot? We examine this question for embodied PointGoal navigation, developing…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Abhishek Kadian , Joanne Truong , Aaron Gokaslan , Alexander Clegg , Erik Wijmans , Stefan Lee , Manolis Savva , Sonia Chernova , Dhruv Batra

End-to-end learning for autonomous navigation has received substantial attention recently as a promising method for reducing modeling error. However, its data complexity, especially around generalization to unseen environments, is high. We…

Robotics · Computer Science 2019-04-04 Xiangyun Meng , Nathan Ratliff , Yu Xiang , Dieter Fox

Inspired by research in psychology, we introduce a behavioral approach for visual navigation using topological maps. Our goal is to enable a robot to navigate from one location to another, relying only on its visual input and the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Kevin Chen , Juan Pablo de Vicente , Gabriel Sepulveda , Fei Xia , Alvaro Soto , Marynel Vazquez , Silvio Savarese

For autonomous robots navigating in urban environments, it is important for the robot to stay on the designated path of travel (i.e., the footpath), and avoid areas such as grass and garden beds, for safety and social conformity…

We consider an autonomous navigation robot that can accept human commands through natural language to provide services in an indoor environment. These natural language commands may include time, position, object, and action components.…

Robotics · Computer Science 2024-10-18 Kuan-Lin Chen , Tzu-Ti Wei , Li-Tzu Yeh , Elaine Kao , Yu-Chee Tseng , Jen-Jee Chen

In this paper we focus on the challenging problem of place categorization and semantic mapping on a robot without environment-specific training. Motivated by their ongoing success in various visual recognition tasks, we build our system…

Autonomous navigation is a long-standing field of robotics research, which provides an essential capability for mobile robots to execute a series of tasks on the same environments performed by human everyday. In this chapter, we present a…

Robotics · Computer Science 2020-12-08 Anh Nguyen , Quang Tran

Learning from demonstration for motion planning is an ongoing research topic. In this paper we present a model that is able to learn the complex mapping from raw 2D-laser range findings and a target position to the required steering…

Robotics · Computer Science 2018-11-07 Mark Pfeiffer , Michael Schaeuble , Juan Nieto , Roland Siegwart , Cesar Cadena

One of the major challenges of a real-time autonomous robotic system for construction monitoring is to simultaneously localize, map, and navigate over the lifetime of the robot, with little or no human intervention. Past research on…