English
Related papers

Related papers: Scene Action Maps: Behavioural Maps for Navigation…

200 papers

Semantic navigation requires an agent to navigate toward a specified target in an unseen environment. Employing an imaginative navigation strategy that predicts future scenes before taking action, can empower the agent to find target…

Robotics · Computer Science 2025-08-12 Yue Hu , Junzhe Wu , Ruihan Xu , Hang Liu , Avery Xi , Henry X. Liu , Ram Vasudevan , Maani Ghaffari

Navigation in complex 3D scenarios requires appropriate environment representation for efficient scene understanding and trajectory generation. We propose a highly efficient and extensible global navigation framework based on a tomographic…

Robotics · Computer Science 2024-03-13 Bowen Yang , Jie Cheng , Bohuan Xue , Jianhao Jiao , Ming Liu

Recent literature in the robotics community has focused on learning robot behaviors that abstract out lower-level details of robot control. To fully leverage the efficacy of such behaviors, it is necessary to select and sequence them to…

A cognitive map is an internal model which encodes the abstract relationships among entities in the world, giving humans and animals the flexibility to adapt to new situations, with a strong out-of-distribution (OOD) generalization that…

Machine Learning · Computer Science 2026-05-12 Victor Rambaud , Salvador Mascarenhas , Yair Lakretz

The static world assumption is standard in most simultaneous localisation and mapping (SLAM) algorithms. Increased deployment of autonomous systems to unstructured dynamic environments is driving a need to identify moving objects and…

Robotics · Computer Science 2020-02-25 Mina Henein , Jun Zhang , Robert Mahony , Viorela Ila

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

Robots are increasingly operating in indoor environments designed for and shared with people. However, robots working safely and autonomously in uneven and unstructured environments still face great challenges. Many modern indoor…

To autonomously navigate and plan interactions in real-world environments, robots require the ability to robustly perceive and map complex, unstructured surrounding scenes. Besides building an internal representation of the observed scene…

Semantic maps allow a robot to reason about its surroundings to fulfill tasks such as navigating known environments, finding specific objects, and exploring unmapped areas. Traditional mapping approaches provide accurate geometric…

Robotics · Computer Science 2026-02-03 Felix Igelbrink , Lennart Niecksch , Marian Renz , Martin Günther , Martin Atzmueller

Robots are often required to operate in environments where humans are not present, but yet require the human context information for better human-robot interaction. Even when humans are present in the environment, detecting their presence…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Lasitha Piyathilaka , Sarath Kodagoda

Can an autonomous agent navigate in a new environment without building an explicit map? For the task of PointGoal navigation ('Go to $\Delta x$, $\Delta y$') under idealized settings (no RGB-D and actuation noise, perfect GPS+Compass), the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Ruslan Partsey , Erik Wijmans , Naoki Yokoyama , Oles Dobosevych , Dhruv Batra , Oleksandr Maksymets

Pre-explored Semantic Maps, constructed through prior exploration using visual language models (VLMs), have proven effective as foundational elements for training-free robotic applications. However, existing approaches assume the map's…

Robotics · Computer Science 2024-11-05 Po-Chen Ko , Hung-Ting Su , Ching-Yuan Chen , Jia-Fong Yeh , Min Sun , Winston H. Hsu

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

Ambient sensor-based human activity recognition (HAR) in smart homes remains challenging due to the need for real-time inference, spatially grounded reasoning, and context-aware temporal modeling. Existing approaches often rely on…

Machine Learning · Computer Science 2025-11-11 Zishuai Liu , Weihang You , Jin Lu , Fei Dou

3D situational awareness is critical for any autonomous system. However, when operating underwater, environmental conditions often dictate the use of acoustic sensors. These acoustic sensors are plagued by high noise and a lack of 3D…

Robotics · Computer Science 2024-12-06 John McConnell , Ivana Collado-Gonzalez , Paul Szenher , Brendan Englot

Humans exhibit incredibly high levels of multi-modal understanding - combining visual cues with read, or heard knowledge comes easy to us and allows for very accurate interaction with the surrounding environment. Various simulation…

Robotics · Computer Science 2022-06-22 Michal Nazarczuk , Tony Ng , Krystian Mikolajczyk

Most computational accounts of cognitive maps assume that stability is achieved primarily through sensory anchoring, with self-motion contributing to incremental positional updates only. However, biological spatial representations often…

Neurons and Cognition · Quantitative Biology 2025-12-24 Yingchao Yu , Pengfei Sun , Yaochu Jin , Kuangrong Hao , Hao Zhang , Yifeng Zhang , Wenxuan Pan , Wei Chen , Danyal Akarca , Yuchen Xiao

Various robot navigation methods have been developed, but they are mainly based on Simultaneous Localization and Mapping (SLAM), reinforcement learning, etc., which require prior map construction or learning. In this study, we consider the…

Commonly, learning-based topological navigation approaches produce a local policy while preserving some loose connectivity of the space through a topological map. Nevertheless, spurious or missing edges in the topological graph often lead…

Robotics · Computer Science 2022-07-12 Rey Reza Wiyatno , Anqi Xu , Liam Paull

Being able to perceive the semantics and the spatial structure of the environment is essential for visual navigation of a household robot. However, most existing works only employ visual backbones pre-trained either with independent images…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yicong Hong , Yang Zhou , Ruiyi Zhang , Franck Dernoncourt , Trung Bui , Stephen Gould , Hao Tan