English
Related papers

Related papers: Constructing coherent spatial memory in LLM agents…

200 papers

The Zero-Shot Object Navigation (ZSON) task requires embodied agents to find a previously unseen object by navigating in unfamiliar environments. Such a goal-oriented exploration heavily relies on the ability to perceive, understand, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Linqing Zhong , Chen Gao , Zihan Ding , Yue Liao , Huimin Ma , Shifeng Zhang , Xu Zhou , Si Liu

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

The adoption of Large Language Models (LLMs) is rapidly expanding across various tasks that involve inherent graphical structures. Graphs are integral to a wide range of applications, including motion planning for autonomous vehicles,…

Artificial Intelligence · Computer Science 2025-03-17 Piyush Gupta , Sangjae Bae , David Isele

The widespread application of Large Language Models (LLMs) has motivated a growing interest in their capacity for processing dynamic graphs. Temporal motifs, as an elementary unit and important local property of dynamic graphs which can…

Machine Learning · Computer Science 2026-03-09 Bing Hao , Minglai Shao , Zengyi Wo , Yunlong Chu , Yuhang Liu , Ruijie Wang

We present LOOM (Line-Ordering Optimized Maps), a fully automatic generator of geographically accurate transit maps. The input to LOOM is data about the lines of a given transit network, namely for each line, the sequence of stations it…

Computational Geometry · Computer Science 2017-10-09 Hannah Bast , Patrick Brosi , Sabine Storandt

In this paper, we propose an integrated framework for the autonomous robotic exploration in indoor environments. Specially, we present a hybrid map, named Semantic Road Map (SRM), to represent the topological structure of the explored…

Robotics · Computer Science 2018-12-27 Chaoqun Wang , Delong Zhu , Teng Li , Max Q. -H. Meng , Clarence De. Silva

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

Artificial Intelligence · Computer Science 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

Autonomous exploration requires a robot to explore an unknown environment while constructing an accurate map using Simultaneous Localization and Mapping (SLAM) techniques. Without prior information, the exploration performance is usually…

Robotics · Computer Science 2024-07-02 Ruofei Bai , Hongliang Guo , Wei-Yun Yau , Lihua Xie

Methods that use Large Language Models (LLM) as planners for embodied instruction following tasks have become widespread. To successfully complete tasks, the LLM must be grounded in the environment in which the robot operates. One solution…

Robotics · Computer Science 2025-12-25 Anatoly O. Onishchenko , Alexey K. Kovalev , Aleksandr I. Panov

Multi-Agent Path Finding (MAPF) is a critical component of logistics and warehouse management, which focuses on planning collision-free paths for a team of robots in a known environment. Recent work introduced a novel MAPF approach, LNS2,…

Robotics · Computer Science 2025-02-03 Yutong Wang , Tanishq Duhan , Jiaoyang Li , Guillaume Sartoretti

Next-token prediction is the fundamental principle for training large language models (LLMs), and reinforcement learning (RL) further enhances their reasoning performance. As an effective way to model language, image, video, and other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Marc Pollefeys , Chang Wen Chen

Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2)…

Artificial Intelligence · Computer Science 2026-05-12 Doga Kerestecioglu , Alexei Robsky , Clemens Vasters , Anshul Sharma , Yitzhak Kesselman

We introduce LLM x MapReduce-V3, a hierarchically modular agent system designed for long-form survey generation. Building on the prior work, LLM x MapReduce-V2, this version incorporates a multi-agent architecture where individual…

Computation and Language · Computer Science 2026-01-30 Yu Chao , Siyu Lin , xiaorong wang , Zhu Zhang , Zihan Zhou , Haoyu Wang , Shuo Wang , Jie Zhou , Zhiyuan Liu , Maosong Sun

Recent advancements in robot navigation, particularly with end-to-end learning approaches such as reinforcement learning (RL), have demonstrated strong performance. However, successful navigation still depends on two key capabilities:…

Robotics · Computer Science 2025-09-05 Fan Yang , Per Frivik , David Hoeller , Chen Wang , Cesar Cadena , Marco Hutter

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

Robotics · Computer Science 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

Vision-language model (VLM) fine-tuning for application-specific visual grounding based on natural language instructions has become one of the most popular approaches for learning-enabled autonomous systems. However, such fine-tuning relies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Joshua R. Waite , Md. Zahid Hasan , Qisai Liu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar

Conventional algorithms in autonomous exploration face challenges due to their inability to accurately and efficiently identify the spatial distribution of convex regions in the real-time map. These methods often prioritize navigation…

Robotics · Computer Science 2025-03-18 Qiming Wang , Yulong Gao , Yang Wang , Xiongwei Zhao , Yijiao Sun , Xiangyan Kong

Animal navigation research posits that organisms build and maintain internal spatial representations, or maps, of their environment. We ask if machines -- specifically, artificial intelligence (AI) navigation agents -- also build implicit…

Artificial Intelligence · Computer Science 2023-02-01 Erik Wijmans , Manolis Savva , Irfan Essa , Stefan Lee , Ari S. Morcos , Dhruv Batra

There is a rapidly growing interest in using Large Language Models (LLMs) to automate complex network operations, but their reliable adoption requires rigorous assessment of their effectiveness and safety. Existing benchmarks do not address…

Networking and Internet Architecture · Computer Science 2026-04-27 Ioannis Protogeros , Rufat Asadli , Benjamin Hoffman , Laurent Vanbever

The rapid advancement of Large Language Models (LLMs) has enabled them to generate complex, multi-step plans and itineraries. However, these generated plans often lack temporal and spatial consistency, particularly in scenarios involving…

Computation and Language · Computer Science 2025-10-30 Shravan Gadbail , Masumi Desai , Kamalakar Karlapalem