English
Related papers

Related papers: On Evaluation of Embodied Navigation Agents

200 papers

The purpose of navigation is to determine the position, velocity, and orientation of manned and autonomous platforms, humans, and animals. Obtaining accurate navigation commonly requires fusion between several sensors, such as inertial…

Robotics · Computer Science 2022-11-28 Itzik Klein

Goal-directed interactive agents, which autonomously complete tasks through interactions with their environment, can assist humans in various domains of their daily lives. Recent advances in large language models (LLMs) led to a surge of…

Computation and Language · Computer Science 2024-09-30 Mareike Hartmann , Alexander Koller

Embodiment is an important characteristic for all intelligent agents (creatures and robots), while existing scene description tasks mainly focus on analyzing images passively and the semantic understanding of the scenario is separated from…

Robotics · Computer Science 2020-05-08 Sinan Tan , Huaping Liu , Di Guo , Xinyu Zhang , Fuchun Sun

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

This paper presents a framework for training an agent to actively request help in object-goal navigation tasks, with feedback indicating the location of the target object in its field of view. To make the agent more robust in scenarios…

Machine Learning · Computer Science 2023-03-29 Jenny Zhang , Samson Yu , Jiafei Duan , Cheston Tan

As the power of Artificial Intelligence (AI) continues to advance, there is increased interest in how best to combine AI-based agents with humans to achieve mission effectiveness. Three perspectives have emerged. The first stems from more…

Human-Computer Interaction · Computer Science 2024-02-21 James E. McCarthy

LLM-based agents represent a paradigm shift in AI, enabling autonomous systems to plan, reason, and use tools while interacting with dynamic environments. This paper provides the first comprehensive survey of evaluation methods for these…

Artificial Intelligence · Computer Science 2026-04-24 Asaf Yehudai , Lilach Eden , Alan Li , Guy Uziel , Yilun Zhao , Roy Bar-Haim , Arman Cohan , Michal Shmueli-Scheuer

A longstanding goal of artificial intelligence is to create artificial agents capable of learning to perform tasks that require sequential decision making. Importantly, while it is the artificial agent that learns and acts, it is still up…

Artificial Intelligence · Computer Science 2021-07-14 Ruohan Zhang , Faraz Torabi , Garrett Warnell , Peter Stone

In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals. This ability can be associated with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence, juxtaposing it against current AI advancements, particularly Large Language Models. We traverse the evolution of the embodiment concept…

Artificial Intelligence · Computer Science 2024-09-16 Giuseppe Paolo , Jonas Gonzalez-Billandon , Balázs Kégl

The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models…

An open problem in autonomous driving research is modeling human driving behavior, which is needed for the planning component of the autonomy stack, safety validation through traffic simulation, and causal inference for generating…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Raunak P. Bhattacharyya , Kyle Brown , Juanran Wang , Katherine Driggs-Campbell , Mykel J. Kochenderfer

We study the optimization of navigational graph queries, i.e., queries which combine recursive and pattern-matching fragments. Current approaches to their evaluation are not effective in practice. Towards addressing this, we present a…

Databases · Computer Science 2026-05-21 Thomas Mulder , George Fletcher , Nikolay Yakovets

Navigation is a fundamental capability in embodied AI, representing the intelligence required to perceive and interact within physical environments following language instructions. Despite significant progress in large Vision-Language…

The rapid developments of Artificial Intelligence in the last decade are influencing Aerospace Engineering to a great extent and research in this context is proliferating. We share our observations on the recent developments in the area of…

Neural and Evolutionary Computing · Computer Science 2018-12-10 Dario Izzo , Marcus Märtens , Binfeng Pan

Navigation is a rich and well-grounded problem domain that drives progress in many different areas of research: perception, planning, memory, exploration, and optimisation in particular. Historically these challenges have been separately…

A key challenge on the path to developing agents that learn complex human-like behavior is the need to quickly and accurately quantify human-likeness. While human assessments of such behavior can be highly accurate, speed and scalability…

Artificial Intelligence · Computer Science 2021-07-29 Sam Devlin , Raluca Georgescu , Ida Momennejad , Jaroslaw Rzepecki , Evelyn Zuniga , Gavin Costello , Guy Leroy , Ali Shaw , Katja Hofmann

Recent advances in Graphical User Interface (GUI) and embodied navigation have driven progress, yet these domains have largely evolved in isolation, with disparate datasets and training paradigms. In this paper, we observe that both tasks…

Robotics · Computer Science 2026-05-05 Zhihao Luo , Wentao Yan , Jingyu Gong , Min Wang , Zhizhong Zhang , Xuhong Wang , Yuan Xie , Xin Tan

Embodied systems, where generative autonomous agents engage with the physical world through integrated perception, cognition, action, and advanced reasoning powered by large language models (LLMs), hold immense potential for addressing…

Multimodal Large Language Models (MLLMs) have shown significant advancements, providing a promising future for embodied agents. Existing benchmarks for evaluating MLLMs primarily utilize static images or videos, limiting assessments to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Zhili Cheng , Yuge Tu , Ran Li , Shiqi Dai , Jinyi Hu , Shengding Hu , Jiahao Li , Yang Shi , Tianyu Yu , Weize Chen , Lei Shi , Maosong Sun