English
Related papers

Related papers: SocialNav: Training Human-Inspired Foundation Mode…

200 papers

To navigate safely and efficiently in crowded spaces, robots should not only perceive the current state of the environment but also anticipate future human movements. In this paper, we propose a reinforcement learning architecture, namely…

Robotics · Computer Science 2025-02-11 Zeying Gong , Tianshuai Hu , Ronghe Qiu , Junwei Liang

It is essential for autonomous robots to be socially compliant while navigating in human-populated environments. Machine Learning and, especially, Deep Reinforcement Learning have recently gained considerable traction in the field of Social…

Robotics · Computer Science 2023-07-10 Aditya Kapoor , Sushant Swamy , Luis Manso , Pilar Bachiller

Recent embodied navigation approaches leveraging Vision-Language Models (VLMs) demonstrate strong generalization in versatile Vision-Language Navigation (VLN). However, reliable path planning in complex environments remains challenging due…

Current datasets to train social behaviors are usually borrowed from surveillance applications that capture visual data from a bird's-eye perspective. This leaves aside precious relationships and visual cues that could be captured through a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Juan Pablo de Vicente , Alvaro Soto

The success of collaboration between humans and robots in shared environments relies on the robot's real-time adaptation to human motion. Specifically, in Social Navigation, the agent should be close enough to assist but ready to back up to…

Visual navigation is fundamental to autonomous systems, yet generating reliable trajectories in cluttered and uncertain environments remains a core challenge. Recent generative models promise end-to-end synthesis, but their reliance on…

Robotics · Computer Science 2026-02-04 Xubo Luo , Aodi Wu , Haodong Han , Xue Wan , Wei Zhang , Leizheng Shu , Ruisuo Wang

Existing language-driven embodied navigation paradigms face challenges in functional buildings (FBs) with highly similar features, as they lack the ability to effectively utilize priori spatial knowledge. To tackle this issue, we propose a…

Robotics · Computer Science 2026-03-11 Jiang Gao , Xiangyu Dong , Haozhou Li , Haoran Zhao , Yaoming Zhou , Xiaoguang Ma

Spatial cognition enables adaptive goal-directed behavior by constructing internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: \textit{landmarks} for salient cues, \textit{route…

Artificial Intelligence · Computer Science 2025-08-26 Shouwei Ruan , Liyuan Wang , Caixin Kang , Qihui Zhu , Songming Liu , Xingxing Wei , Hang Su

Autonomous navigation is a key skill for assistive and service robots. To be successful, robots have to navigate avoiding going through the personal spaces of the people surrounding them. Complying with social rules such as not getting in…

Robotics · Computer Science 2020-09-11 Luis J. Manso , Ronit R. Jorvekar , Diego R. Faria , Pablo Bustos , Pilar Bachiller

Enabling robots to navigate open-world environments via natural language is critical for general-purpose autonomy. Yet, Vision-Language Navigation has relied on end-to-end policies trained on expensive, embodiment-specific robot data. While…

Robotics · Computer Science 2026-03-17 Jie Chen , Yuxin Cai , Yizhuo Wang , Ruofei Bai , Yuhong Cao , Jun Li , Yau Wei Yun , Guillaume Sartoretti

Navigating dynamic urban environments presents significant challenges for embodied agents, requiring advanced spatial reasoning and adherence to common-sense norms. Despite progress, existing visual navigation methods struggle in map-free…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Xinhao Liu , Jintong Li , Yicheng Jiang , Niranjan Sujay , Zhicheng Yang , Juexiao Zhang , John Abanes , Jing Zhang , Chen Feng

Instruction-following navigation is a key step toward embodied intelligence. Prior benchmarks mainly focus on semantic understanding but overlook systematically evaluating navigation agents' spatial perception and reasoning capabilities. In…

Social robot navigation is an evolving research field that aims to find efficient strategies to safely navigate dynamic environments populated by humans. A critical challenge in this domain is the accurate modeling of human motion, which…

Human-Computer Interaction · Computer Science 2025-07-01 Tommaso Van Der Meer , Andrea Garulli , Antonio Giannitrapani , Renato Quartullo

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

As large language models (LLMs) continue to advance and gain influence, the development of embodied AI has accelerated, drawing significant attention, particularly in navigation scenarios. Embodied navigation requires an agent to perceive,…

Artificial Intelligence · Computer Science 2025-08-11 Zixia Wang , Jia Hu , Ronghui Mu

Embodied navigation in open, dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time. We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jintao Chen , Junjun Hu , Haochen Bai , Minghua Luo , Xinda Xue , Botao Ren , Chengyu Bai , Shichao Xie , Ziyi Chen , Fei Liu , Zedong Chu , Xiaolong Wu , Mu Xu , Shanghang Zhang

Learning how to navigate among humans in an occluded and spatially constrained indoor environment, is a key ability required to embodied agent to be integrated into our society. In this paper, we propose an end-to-end architecture that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Enrico Cancelli , Tommaso Campari , Luciano Serafini , Angel X. Chang , Lamberto Ballan

Socially compliant navigation requires structured reasoning over dynamic pedestrians and physical constraints to ensure safe and interpretable decisions. However, existing social navigation datasets often lack explicit reasoning supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhuonan Liu , Xinyu Zhang , Zishuo Wang , Tomohito Kawabata , Xuesu Xiao , Ling Xiao

Human-robot collaboration, in which the robot intelligently assists the human with the upcoming task, is an appealing objective. To achieve this goal, the agent needs to be equipped with a fundamental collaborative navigation ability, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Changhao Li , Xinyu Sun , Peihao Chen , Jugang Fan , Zixu Wang , Yanxia Liu , Jinhui Zhu , Chuang Gan , Mingkui Tan

Foundation models trained on web-scale data have revolutionized robotics, but their application to low-level control remains largely limited to behavioral cloning. Drawing inspiration from the success of the reinforcement learning stage in…

Machine Learning · Computer Science 2025-09-19 Seyed Kamyar Seyed Ghasemipour , Ayzaan Wahid , Jonathan Tompson , Pannag Sanketi , Igor Mordatch