中文
相关论文

相关论文: LISN: Language-Instructed Social Navigation with V…

200 篇论文

Little inquiry has explicitly addressed the role of action spaces in language-guided visual navigation -- either in terms of its effect on navigation success or the efficiency with which a robotic agent could execute the resulting…

计算机视觉与模式识别 · 计算机科学 2021-10-06 Jacob Krantz , Aaron Gokaslan , Dhruv Batra , Stefan Lee , Oleksandr Maksymets

Vision-and-language navigation (VLN) is a trending topic which aims to navigate an intelligent agent to an expected position through natural language instructions. This work addresses the task of VLN from a previously-ignored aspect, namely…

计算机视觉与模式识别 · 计算机科学 2021-10-13 Xinzhe Zhou , Wei Liu , Yadong Mu

Conventional Vision-and-Language Navigation (VLN) benchmarks assume instructions are feasible and the referenced target exists, leaving agents ill-equipped to handle false-premise goals. We introduce VLN-NF, a benchmark with false-premise…

机器人学 · 计算机科学 2026-04-21 Hung-Ting Su , Ting-Jun Wang , Jia-Fong Yeh , Min Sun , Winston H. Hsu

The human-robot interaction (HRI) community has developed many methods for robots to navigate safely and socially alongside humans. However, experimental procedures to evaluate these works are usually constructed on a per-method basis. Such…

机器人学 · 计算机科学 2021-07-29 Abhijat Biswas , Allan Wang , Gustavo Silvera , Aaron Steinfeld , Henny Admoni

Social navigation in densely populated dynamic environments poses a significant challenge for autonomous mobile robots, requiring advanced strategies for safe interaction. Existing reinforcement learning (RL)-based methods require over…

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

机器人学 · 计算机科学 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Socially compliant navigation requires structured reasoning over dynamic pedestrians and physical constraints to ensure safe and interpretable decisions. However, existing social navigation datasets often lack explicit reasoning supervision…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Zhuonan Liu , Xinyu Zhang , Zishuo Wang , Tomohito Kawabata , Xuesu Xiao , Ling Xiao

The Visual-and-Language Navigation (VLN) task requires understanding a textual instruction to navigate a natural indoor environment using only visual information. While this is a trivial task for most humans, it is still an open problem for…

计算机视觉与模式识别 · 计算机科学 2022-10-28 Joaquin Ossandón , Benjamin Earle , Álvaro Soto

Social robot navigation increasingly relies on large language models for reasoning, path planning, and enabling movement in dynamic human spaces. However, relying solely on LLMs for planning often leads to unpredictable and unsafe…

机器人学 · 计算机科学 2026-05-26 Weizheng Wang , Obi Ike , Soyun Choi , Sungeun Hong , Aniket Bera , Byung-Cheol Min

This paper presents the framework for a novel Unified Socially-Aware Navigation (USAN) architecture and explains its need in Socially Assistive Robotics (SAR) applications. Our approach emphasizes interpersonal distance and how spatial…

机器人学 · 计算机科学 2018-10-15 Santosh Balajee Banisetty , David Feil-Seifer

We propose an architecture for integrating high-level, human-provided safety rules and operator-aligned semantic preferences into autonomous robot navigation in unstructured outdoor environments. In our approach, natural-language rules are…

机器人学 · 计算机科学 2026-05-07 Kristy Sakano , Kalonji Harrington , Mumu Xu

Service robots are increasingly deployed in diverse and dynamic environments, where both physical layouts and social contexts change over time and across locations. In these unstructured settings, conventional navigation systems that rely…

机器人学 · 计算机科学 2025-07-16 Yanbo Wang , Zipeng Fang , Lei Zhao , Weidong Chen

We investigate the Vision-and-Language Navigation (VLN) problem in the context of autonomous driving in outdoor settings. We solve the problem by explicitly grounding the navigable regions corresponding to the textual command. At each…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Kanishk Jain , Varun Chhangani , Amogh Tiwari , K. Madhava Krishna , Vineet Gandhi

Social navigation research is performed on a variety of robotic platforms, scenarios, and environments. Making comparisons between navigation algorithms is challenging because of the effort involved in building these systems and the…

机器人学 · 计算机科学 2020-09-10 Nathan Tsoi , Mohamed Hussein , Jeacy Espinoza , Xavier Ruiz , Marynel Vázquez

Enabling robotic assistants to navigate complex environments and locate objects described in free-form language is a critical capability for real-world deployment. While foundation models, particularly Vision-Language Models (VLMs), offer…

机器人学 · 计算机科学 2026-04-16 Naoki Yokoyama , Sehoon Ha

Traditional robot navigation systems primarily utilize occupancy grid maps and laser-based sensing technologies, as demonstrated by the popular move_base package in ROS. Unlike robots, humans navigate not only through spatial awareness and…

机器人学 · 计算机科学 2025-07-22 Fujing Xie , Jiajie Zhang , Sören Schwertfeger

Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in…

机器人学 · 计算机科学 2026-05-13 Tharun Sethuraman , Subham Agrawal , Nils Dengler , Jorge de Heuvel , Teena Hassan , Maren Bennewitz

Vision-and-language navigation (VLN), a frontier study aiming to pave the way for general-purpose robots, has been a hot topic in the computer vision and natural language processing community. The VLN task requires an agent to navigate to a…

计算机视觉与模式识别 · 计算机科学 2022-06-23 Yifeng Zhuang , Qiang Sun , Yanwei Fu , Lifeng Chen , Xiangyang Xue

This work proposes a novel approach to social robot navigation by learning to generate robot controls from a social motion latent space. By leveraging this social motion latent space, the proposed method achieves significant improvements in…

机器人学 · 计算机科学 2023-10-12 Junaid Ahmed Ansari , Satyajit Tourani , Gourav Kumar , Brojeshwar Bhowmick

Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures or…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Wanrong Zhu , Yuankai Qi , Pradyumna Narayana , Kazoo Sone , Sugato Basu , Xin Eric Wang , Qi Wu , Miguel Eckstein , William Yang Wang