English
Related papers

Related papers: WorldMem: Long-term Consistent World Simulation wi…

200 papers

World models have recently re-emerged as a central paradigm for embodied intelligence, robotics, autonomous driving, and model-based reinforcement learning. However, current world model research is often dominated by three partially…

Artificial Intelligence · Computer Science 2026-05-27 Sen Cui , Jingheng Ma

Long-term memory is fundamental for personalized agents capable of accumulating knowledge, reasoning over user experiences, and adapting across time. However, existing memory benchmarks primarily target declarative memory, specifically…

Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing approaches, including…

Artificial Intelligence · Computer Science 2026-02-03 Ao Tian , Yunfeng Lu , Xinxin Fan , Changhao Wang , Lanzhi Zhou , Yeyao Zhang , Yanfang Liu

Video world models have shown immense promise for interactive simulation and entertainment, but current systems still struggle with two important aspects of interactivity: user control over the environment for reproducible, editable…

Artificial Intelligence · Computer Science 2026-04-01 Ryan Po , David Junhao Zhang , Amir Hertz , Gordon Wetzstein , Neal Wadhwa , Nataniel Ruiz

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Hanqing Wang , Wenguan Wang , Wei Liang , Caiming Xiong , Jianbing Shen

Humans share a strong tendency to memorize/forget some of the visual information they encounter. This paper focuses on providing computational models for the prediction of the intrinsic memorability of visual content. To address this new…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Romain Cohendet , Claire-Hélène Demarty , Ngoc Q. K. Duong , Martin Engilberge

World Models have emerged as a powerful paradigm for learning compact, predictive representations of environment dynamics, enabling agents to reason, plan, and generalize beyond direct experience. Despite recent interest in World Models,…

Artificial Intelligence · Computer Science 2026-02-18 Lucas Maes , Quentin Le Lidec , Dan Haramati , Nassim Massaudi , Damien Scieur , Yann LeCun , Randall Balestriero

State space models (SSMs) have recently emerged as a powerful framework for long sequence processing, outperforming traditional methods on diverse benchmarks. Fundamentally, SSMs can generalize both recurrent and convolutional networks and…

Signal Processing · Electrical Eng. & Systems 2025-12-24 Xiaoyu Zhang , Mingtao Hu , Sen Lu , Soohyeon Kim , Eric Yeu-Jer Lee , Yuyang Liu , Wei D. Lu

Persistent memory can fail after successful admission: a premise is written, then becomes a silent assumption, and later maintenance treats it as ordinary residue to be compressed, demoted, or evicted. We study this post-admission failure…

Computation and Language · Computer Science 2026-05-28 Jiarui Han

Continual learning refers to the ability of humans and animals to incrementally learn over time in a given environment. Trying to simulate this learning process in machines is a challenging task, also due to the inherent difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Enrico Meloni , Alessandro Betti , Lapo Faggi , Simone Marullo , Matteo Tiezzi , Stefano Melacci

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

Long-horizon interactive agents often accumulate large trajectory histories yet still fail to answer questions about earlier events reliably. We argue that the main bottleneck is not context length alone, but the trajectory-to-answer…

Computation and Language · Computer Science 2026-05-29 Encheng Su , Jinouwen Zhang , Jianyu Wu , Qiucheng Yu , Chen Tang , Pengze Li , Lintao Wang , Yizhou Wang , Xinzhu Ma , Shixiang Tang , Aoran Wang

Current approaches to memory in Large Language Models (LLMs) predominantly rely on static Retrieval-Augmented Generation (RAG), which often results in scattered retrieval and fails to capture the structural dependencies required for complex…

Computation and Language · Computer Science 2026-02-11 Zhengxuan Lu , Dongfang Li , Yukun Shi , Beilun Wang , Longyue Wang , Baotian Hu

Long-term memory is increasingly important for personalized AI agents, yet existing benchmarks and methods remain largely text-centric. Even when images are included, the user-specific information needed for later questions is typically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Viet Nguyen , Thao Nguyen , Vishal M. Patel , Yuheng Li

Many large language model applications require conditioning on long contexts. Transformers typically support this by storing a large per-layer KV-cache of past activations, which incurs substantial memory overhead. A desirable alternative…

Computation and Language · Computer Science 2026-03-17 Yuri Kuratov , Matvey Kairov , Aydar Bulatov , Ivan Rodkin , Mikhail Burtsev

Long-term memory (LTM) is essential for large language models (LLMs) to achieve autonomous intelligence in complex, evolving environments. Despite increasing efforts in memory-augmented and retrieval-based architectures, there remains a…

Computation and Language · Computer Science 2025-06-17 Luanbo Wan , Weizhi Ma

Modeling long-range dependencies in sequential data remains a central challenge in machine learning. Transformers address this challenge through attention mechanisms, but their quadratic complexity with respect to sequence length limits…

Machine Learning · Computer Science 2026-05-14 Hoang-Quan Nguyen , Sankalp Pandey , Khoa Luu

World models serve as essential building blocks toward Artificial General Intelligence (AGI), enabling intelligent agents to predict future states and plan actions by simulating complex physical interactions. However, existing interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junyi Chen , Haoyi Zhu , Xianglong He , Yifan Wang , Jianjun Zhou , Wenzheng Chang , Yang Zhou , Zizun Li , Zhoujie Fu , Jiangmiao Pang , Tong He

Traditionally, 3d indoor datasets have generally prioritized scale over ground-truth accuracy in order to obtain improved generalization. However, using these datasets to evaluate dense geometry tasks, such as depth rendering, can be…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 HyunJun Jung , Weihang Li , Shun-Cheng Wu , William Bittner , Nikolas Brasch , Jifei Song , Eduardo Pérez-Pellitero , Zhensong Zhang , Arthur Moreau , Nassir Navab , Benjamin Busam

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…