中文
相关论文

相关论文: Constructing coherent spatial memory in LLM agents…

200 篇论文

Although large language models (LLMs) have advanced rapidly, robust automation of complex software workflows remains an open problem. In long-horizon settings, agents frequently suffer from cascading errors and environmental stochasticity;…

人工智能 · 计算机科学 2026-03-30 Yenchia Feng , Chirag Sharma , Karime Maamari

Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates…

计算与语言 · 计算机科学 2025-05-28 Sirui Xia , Aili Chen , Xintao Wang , Tinghui Zhu , Yikai Zhang , Jiangjie Chen , Yanghua Xiao

Humans build viewpoint-independent cognitive maps through navigation, enabling intuitive reasoning about object permanence and spatial relations. We argue that multimodal large language models (MLLMs), despite extensive video training, lack…

机器学习 · 计算机科学 2025-12-02 Jacob Thompson , Emiliano Garcia-Lopez , Yonatan Bisk

Object Navigation (ObjectNav) has made great progress with large language models (LLMs), but still faces challenges in memory management, especially in long-horizon tasks and dynamic scenes. To address this, we propose TopoNav, a new…

机器人学 · 计算机科学 2025-09-03 Peiran Liu , Qiang Zhang , Daojie Peng , Lingfeng Zhang , Yihao Qin , Hang Zhou , Jun Ma , Renjing Xu , Yiding Ji

Graph recommendation methods, representing a connected interaction perspective, reformulate user-item interactions as graphs to leverage graph structure and topology to recommend and have proved practical effectiveness at scale. Large…

人工智能 · 计算机科学 2025-07-18 Xinyuan Wang , Liang Wu , Liangjie Hong , Hao Liu , Yanjie Fu

Graph-based representations such as Scene Graphs enable localization in structured indoor environments by matching a locally observed graph, constructed from sensor data, to a prior map. This process is particularly challenging in…

Object-Goal Navigation (ObjectNav) requires an agent to find and navigate to a target object category in unknown environments. While recent Large Language Model (LLM)-based agents exhibit zero-shot reasoning, they often rely on a "reactive"…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yudai Noda , Kanji Tanaka

Understanding how large language models (LLMs) represent and reason about spatial information is crucial for building robust agentic systems that can navigate real and simulated environments. In this work, we investigate the influence of…

人工智能 · 计算机科学 2025-02-25 Nicolas Martorell

Foundation models are increasingly used to personalize learning, yet many systems still assume fixed curricula or coarse progress signals, limiting alignment with learners' day-to-day needs. At the other extreme, lightweight incidental…

人机交互 · 计算机科学 2025-11-27 Justin Cui , Kevin Pu , Tovi Grossman

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

人工智能 · 计算机科学 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

Automatically generating interactive 3D indoor scenes from natural language is crucial for virtual reality, gaming, and embodied AI. However, existing LLM-based approaches often suffer from spatial errors and collisions, in part because…

人工智能 · 计算机科学 2026-05-01 Song Tang , Kaiyong Zhao , Yuliang Li , Qingsong Yan , Penglei Sun , Junyi Zou , Qiang Wang , Xiaowen Chu

Indoor navigation presents unique challenges due to complex layouts and the unavailability of GNSS signals. Existing solutions often struggle with contextual adaptation, and typically require dedicated hardware. In this work, we explore the…

人工智能 · 计算机科学 2025-06-23 Alberto Coffrini , Paolo Barsocchi , Francesco Furfari , Antonino Crivello , Alessio Ferrari

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Haoyu Zhen , Xiaolong Li , Yilin Zhao , Han Zhang , Sifei Liu , Kaichun Mo , Chuang Gan , Subhashree Radhakrishnan

Tool-using LLM agents face a reliability-cost tradeoff: routing every decision through the LLM improves correctness but incurs high latency and inference cost, while pre-coded workflow graphs reduce cost but become brittle under…

人工智能 · 计算机科学 2026-03-03 Neeraj Bholani

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

In recent years, the field of indoor navigation has witnessed groundbreaking advancements through the integration of Large Language Models (LLMs). Traditional navigation approaches relying on pre-built maps or reinforcement learning exhibit…

机器人学 · 计算机科学 2025-04-23 Anlong Zhang , Jianmin Ji

We introduce MapStory, an LLM-powered animation prototyping tool that generates editable map animation sequences directly from natural language text by leveraging a dual-agent LLM architecture. Given a user written script, MapStory…

人机交互 · 计算机科学 2025-08-14 Aditya Gunturu , Ben Pearman , Keiichi Ihara , Morteza Faraji , Bryan Wang , Rubaiat Habib Kazi , Ryo Suzuki

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

机器学习 · 计算机科学 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

Long-horizon applications increasingly require large language models (LLMs) to answer queries when relevant evidence is sparse and dispersed across very long contexts. Existing memory systems largely follow two paradigms: explicit…

计算与语言 · 计算机科学 2026-01-08 Xin Zhang , Kailai Yang , Hao Li , Chenyue Li , Qiyu Wei , Sophia Ananiadou