中文
相关论文

相关论文: Advancing Object Goal Navigation Through LLM-enhan…

200 篇论文

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

Recent large language models (LLMs) have demonstrated remarkable performance on a variety of natural language processing (NLP) tasks, leading to intense excitement about their applicability across various domains. Unfortunately, recent work…

计算与语言 · 计算机科学 2023-02-13 Yaqi Xie , Chen Yu , Tongyao Zhu , Jinbin Bai , Ze Gong , Harold Soh

Home-assistant robots have been a long-standing research topic, and one of the biggest challenges is searching for required objects in housing environments. Previous object-goal navigation requires the robot to search for a target object…

机器人学 · 计算机科学 2023-03-14 Hongyi Chen , Ruinian Xu , Shuo Cheng , Patricio A. Vela , Danfei Xu

Object-goal navigation (ObjNav) tasks an agent with navigating to the location of a specific object in an unseen environment. Embodied agents equipped with large language models (LLMs) and online constructed navigation maps can perform…

机器人学 · 计算机科学 2026-03-18 Zebin Yang , Sunjian Zheng , Tong Xie , Tianshi Xu , Bo Yu , Fan Wang , Jie Tang , Shaoshan Liu , Meng Li

The zero-shot object navigation (ZSON) in unknown open-ended environments coupled with semantically novel target often suffers from the significant decline in performance due to the neglect of high-dimensional implicit scene information and…

机器人学 · 计算机科学 2025-06-09 Chongshang Yan , Jiaxuan He , Delun Li , Yi Yang , Wenjie Song

In recent years, the rapid advancement of Large Language Models (LLMs) such as the Generative Pre-trained Transformer (GPT) has attracted increasing attention due to their potential in a variety of practical applications. The application of…

人工智能 · 计算机科学 2025-04-24 Jinzhou Lin , Han Gao , Xuxiang Feng , Rongtao Xu , Changwei Wang , Man Zhang , Li Guo , Shibiao Xu

Object-Goal Navigation (ObjectNav) is a critical component toward deploying mobile robots in everyday, uncontrolled environments such as homes, schools, and workplaces. In this context, a robot must locate target objects in previously…

机器人学 · 计算机科学 2025-10-03 Hongze Wang , Boyang Sun , Jiaxu Xing , Fan Yang , Marco Hutter , Dhruv Shah , Davide Scaramuzza , Marc Pollefeys

Indoor navigation remains a complex challenge due to the absence of reliable GPS signals and the architectural intricacies of large enclosed environments. This study presents an indoor localization and navigation approach that integrates…

机器学习 · 计算机科学 2025-08-12 Keyan Rahimi , Md. Wasiul Haque , Sagar Dasgupta , Mizanur Rahman

Large Language Models (LLM) and Vision Language Models (VLM) enable robots to ground natural language prompts into control actions to achieve tasks in an open world. However, when applied to a long-horizon collaborative task, this…

机器人学 · 计算机科学 2024-06-21 Zhe Huang , John Pohovey , Ananya Yammanuru , Katherine Driggs-Campbell

Object goal navigation (ObjectNav) is a fundamental task in embodied AI, requiring an agent to locate a target object in previously unseen environments. This task is particularly challenging because it requires both perceptual and cognitive…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Yihan Cao , Jiazhao Zhang , Zhinan Yu , Shuzhen Liu , Zheng Qin , Qin Zou , Bo Du , Kai Xu

Zero-shot object-goal navigation (ZSON) is a challenging problem in robotics that requires a comprehensive understanding of both language and visual observations. Contextual cues from rooms and objects are critical, but their relative…

机器人学 · 计算机科学 2026-05-20 Taeyun Kim , Alvin Jinsung Choi , Dasol Hong , Hyun Myung

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

The control of robots for manipulation tasks generally relies on visual input. Recent advances in vision-language models (VLMs) enable the use of natural language instructions to condition visual input and control robots in a wider range of…

机器人学 · 计算机科学 2025-08-05 Chenglin Cui , Chaoran Zhu , Changjae Oh , Andrea Cavallaro

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated data or require…

机器人学 · 计算机科学 2025-06-05 Arnab Debnath , Gregory J. Stein , Jana Kosecka

Enabling robots to understand the world in terms of objects is a critical building block towards higher level autonomy. The success of foundation models in vision has created the ability to segment and identify nearly all objects in the…

机器人学 · 计算机科学 2024-04-09 Kurran Singh , Tim Magoun , John J. Leonard

Task-oriented grasping (TOG) is more challenging than simple object grasping because it requires precise identification of object parts and careful selection of grasping areas to ensure effective and robust manipulation. While recent…

机器人学 · 计算机科学 2026-03-30 Hao Chen , Takuya Kiyokawa , Weiwei Wan , Kensuke Harada

Effective human-robot collaboration depends on task-oriented handovers, where robots present objects in ways that support the partners intended use. However, many existing approaches neglect the humans post-handover action, relying on…

机器人学 · 计算机科学 2025-09-30 Andreea Tulbure , Rene Zurbruegg , Timm Grigat , Marco Hutter

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

机器人学 · 计算机科学 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

The widespread adoption of location-based services has led to the generation of vast amounts of mobility data, providing significant opportunities to model user movement dynamics within urban environments. Recent advancements have focused…

计算与语言 · 计算机科学 2025-06-16 Yile Chen , Yicheng Tao , Yue Jiang , Shuai Liu , Han Yu , Gao Cong

Navigating to out-of-sight targets from human instructions in unfamiliar environments is a core capability for service robots. Despite substantial progress, most approaches underutilize reusable, persistent memory, constraining performance…

机器人学 · 计算机科学 2026-03-03 Haochen Niu , Lantao Zhang , Xingwu Ji , Rendong Ying , Peilin Liu , Fei Wen