中文
相关论文

相关论文: On Evaluation of Embodied Navigation Agents

200 篇论文

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

人工智能 · 计算机科学 2026-01-06 Bin Xu

The academic field of learning instruction-guided visual navigation can be generally categorized into high-level category-specific search and low-level language-guided navigation, depending on the granularity of language instruction, in…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Gengze Zhou , Yicong Hong , Zun Wang , Chongyang Zhao , Mohit Bansal , Qi Wu

Autonomous navigation consists in an agent being able to navigate without human intervention or supervision, it affects both high level planning and low level control. Navigation is at the crossroad of multiple disciplines, it combines…

机器人学 · 计算机科学 2020-11-24 Maxime Pietrantoni , Boris Chidlovskii , Tomi Silander

Embodied AI is a prominent research topic in both academia and industry. Current research centers on completing tasks based on explicit user instructions. However, for robots to integrate into human society, they must understand which…

We have observed significant progress in visual navigation for embodied agents. A common assumption in studying visual navigation is that the environments are static; this is a limiting assumption. Intelligent navigation may involve…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Kuo-Hao Zeng , Luca Weihs , Ali Farhadi , Roozbeh Mottaghi

Consider an assistive system that guides visually impaired users through speech and haptic feedback to their destination. Existing robotic and ubiquitous navigation technologies (e.g., portable, ground, or wearable systems) often operate in…

机器学习 · 计算机科学 2018-10-09 Eshed Ohn-Bar , Kris Kitani , Chieko Asakawa

As full AI-based automation remains out of reach in most real-world applications, the focus has instead shifted to leveraging the strengths of both human and AI agents, creating effective collaborative systems. The rapid advances in this…

人机交互 · 计算机科学 2024-04-19 Steffen Holter , Mennatallah El-Assady

Spatial reasoning in partially observable environments has often been approached through passive predictive models, yet theories of embodied cognition suggest that genuinely useful representations arise only when perception is tightly…

人工智能 · 计算机科学 2025-04-29 Li Jin , Liu Jia

Network visualizations are commonly used to analyze relationships in various contexts. To efficiently explore a network visualization, the user needs to quickly navigate to different parts of the network and analyze local details. Recent…

人机交互 · 计算机科学 2023-03-29 Helen H. Huang , Hanspeter Pfister , Yalong Yang

This technical report presents the construction and analysis of polynomial navigation functions for motion planning in 3-D workspaces populated by spherical and cylindrical obstacles. The workspace is modeled as a bounded spherical region,…

机器人学 · 计算机科学 2026-01-15 Ro'i Lang , Elon Rimon

We develop a language-guided navigation task set in a continuous 3D environment where agents must execute low-level actions to follow natural language navigation directions. By being situated in continuous environments, this setting lifts a…

计算机视觉与模式识别 · 计算机科学 2020-05-05 Jacob Krantz , Erik Wijmans , Arjun Majumdar , Dhruv Batra , Stefan Lee

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

机器人学 · 计算机科学 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

Moving in complex environments is an essential capability of intelligent mobile robots. Decades of research and engineering have been dedicated to developing sophisticated navigation systems to move mobile robots from one point to another.…

机器人学 · 计算机科学 2022-03-01 Xuesu Xiao , Bo Liu , Garrett Warnell , Peter Stone

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

We are witnessing significant progress on perception models, specifically those trained on large-scale internet images. However, efficiently generalizing these perception models to unseen embodied tasks is insufficiently studied, which will…

机器人学 · 计算机科学 2023-03-21 Ya Jing , Tao Kong

Place recognition, the ability to identify previously visited locations, is critical for both biological navigation and autonomous systems. This review synthesizes findings from robotic systems, animal studies, and human research to explore…

机器人学 · 计算机科学 2025-11-19 Michael Milford , Tobias Fischer

Human-robot collaboration, in which the robot intelligently assists the human with the upcoming task, is an appealing objective. To achieve this goal, the agent needs to be equipped with a fundamental collaborative navigation ability, where…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Changhao Li , Xinyu Sun , Peihao Chen , Jugang Fan , Zixu Wang , Yanxia Liu , Jinhui Zhu , Chuang Gan , Mingkui Tan

The pursuit of artificial general intelligence (AGI) has placed embodied intelligence at the forefront of robotics research. Embodied intelligence focuses on agents capable of perceiving, reasoning, and acting within the physical world.…

We introduce DialNav, a novel collaborative embodied dialog task, where a navigation agent (Navigator) and a remote guide (Guide) engage in multi-turn dialog to reach a goal location. Unlike prior work, DialNav aims for holistic evaluation…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Leekyeung Han , Hyunji Min , Gyeom Hwangbo , Jonghyun Choi , Paul Hongsuck Seo

Interacting with human agents in complex scenarios presents a significant challenge for robotic navigation, particularly in environments that necessitate both collision avoidance and collaborative interaction, such as indoor spaces. Unlike…

机器人学 · 计算机科学 2024-11-07 Lingfeng Sun , Yixiao Wang , Pin-Yun Hung , Changhao Wang , Xiang Zhang , Zhuo Xu , Masayoshi Tomizuka