English
Related papers

Related papers: SuperLocalMemory V3: Information-Geometric Foundat…

200 papers

Long-term memory is essential for persistent LLM agents, yet prevailing architectures store historical interactions as unstructured, flat text. This unconstrained storage induces provenance-role collapse, a critical failure mode where…

Computation and Language · Computer Science 2026-05-26 Zhengda Jin , Bingbing Wang , Jing Li , Ruifeng Xu , Min Zhang

Continual post-training aims to extend large language models (LLMs) with new knowledge, skills, and behaviors, yet it remains unclear when sequential updates enable capability transfer and when they cause catastrophic forgetting. Existing…

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying

We present the first distributed optimization algorithm with lazy communication for collaborative geometric estimation, the backbone of modern collaborative simultaneous localization and mapping (SLAM) and structure-from-motion (SfM)…

Memory-augmented LLM agents offer an appealing shortcut to continual learning: rather than updating model parameters, they accumulate experience in external memory, seemingly sidestepping the stability-plasticity dilemma of parametric…

Machine Learning · Computer Science 2026-05-01 Qisheng Hu , Quanyu Long , Wenya Wang

Geospatial reasoning is essential for real-world applications such as urban analytics, transportation planning, and disaster response. However, existing LLM-based agents often fail at genuine geospatial computation, relying instead on web…

Artificial Intelligence · Computer Science 2026-01-26 Riyang Bao , Cheng Yang , Dazhou Yu , Zhexiang Tang , Gengchen Mai , Liang Zhao

We study the solution of symmetric positive-definite linear systems by way of families of full- and limited-memory methods. Our contributions are threefold. We first derive new relationships between the conjugate-gradient method (CG) and…

Optimization and Control · Mathematics 2026-05-25 Johann Bourhis , Oihan Cordelier , Jean-Pierre Dussault , Oussama Mouhtal , Dominique Orban

Large language models (LLMs) like GPTs, trained on vast datasets, have demonstrated impressive capabilities in language understanding, reasoning, and planning, achieving human-level performance in various tasks. Most studies focus on…

Artificial Intelligence · Computer Science 2025-05-13 Xun Jiang , Feng Li , Han Zhao , Jiahao Qiu , Jiaying Wang , Jun Shao , Shihao Xu , Shu Zhang , Weiling Chen , Xavier Tang , Yize Chen , Mengyue Wu , Weizhi Ma , Mengdi Wang , Tianqiao Chen

The linear memory growth of the KV cache poses a significant bottleneck for LLM inference in long-context tasks. Existing static compression methods often fail to preserve globally important information. Although recent dynamic retrieval…

Computation and Language · Computer Science 2026-04-21 Zhiyuan Shi , Qibo Qiu , Feng Xue , Zhonglin Jiang , Li Yu , Jian Jiang , Xiaofei He , Wenxiao Wang

Our ability to continuously acquire, organize, and leverage knowledge is a key feature of human intelligence that AI systems must approximate to unlock their full potential. Given the challenges in continual learning with large language…

Computation and Language · Computer Science 2025-06-23 Bernal Jiménez Gutiérrez , Yiheng Shu , Weijian Qi , Sizhe Zhou , Yu Su

Feedforward geometric foundation models achieve strong short-window reconstruction, yet scaling them to minutes-long videos is bottlenecked by quadratic attention complexity or limited effective memory in recurrent designs. We present LoGeR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Junyi Zhang , Charles Herrmann , Junhwa Hur , Chen Sun , Ming-Hsuan Yang , Forrester Cole , Trevor Darrell , Deqing Sun

We present NeuSymMS, an adaptive memory system that enables large language model (LLM) agents to learn, remember, and reason about users across sessions via a hybrid neuro-symbolic architecture. NeuSymMS couples neural fact extraction from…

Artificial Intelligence · Computer Science 2026-05-22 Mujahid Sultan , Sri Thuraisamy , Daya Rajaratnam

While large language models have become the prevailing approach for agentic reasoning and planning, their success in symbolic domains does not readily translate to the physical world. Spatial intelligence, the ability to perceive 3D…

Machine Learning · Computer Science 2026-02-03 Gloria Felicia , Nolan Bryant , Handi Putra , Ayaan Gazali , Eliel Lobo , Esteban Rojas

The remarkable progress of vision-language models (VLMs) has enabled GUI agents to interact with computers in a human-like manner. Yet real-world computer-use tasks remain difficult due to long-horizon workflows, diverse interfaces, and…

Artificial Intelligence · Computer Science 2026-03-12 Sibo Zhu , Wenyi Wu , Kun Zhou , Stephen Wang , Biwei Huang

Large language model (LLM) agents demonstrate strong performance in short-text contexts but often underperform in extended dialogues due to inefficient memory management. Existing approaches face a fundamental trade-off between efficiency…

Artificial Intelligence · Computer Science 2026-05-04 Xiaochen Zhao , Kaikai Wang , Xiaowen Zhang , Chen Yao , Aili Wang

Vision-language model (VLM) agents increasingly rely on memory-augmented reinforcement learning to reuse experience across long-horizon tasks, yet most existing frameworks store memory as text and depend on proprietary teacher models to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Pan Wang , Yihao Hu , Xiujin Liu , Jingchu Yang , Hang Wang , Zhihao Wen

Large Language Model (LLM) inference presents a unique scheduling challenge due to the Key-Value (KV) cache, where a job's memory footprint grows linearly with the number of decoded tokens. This growth couples scheduling decisions with…

Data Structures and Algorithms · Computer Science 2026-02-02 Yiding Feng , Zonghan Yang , Yuhao Zhang

LiDAR-based place recognition serves as a crucial enabler for long-term autonomy in robotics and autonomous driving systems. Yet, prevailing methodologies relying on handcrafted feature extraction face dual challenges: (1) Inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Xiaohui Jiang , Haijiang Zhu , Chade Li , Fulin Tang , Ning An

While general-purpose Large Language Models (LLMs) applied to Geology often hallucinate when reasoning about subsurface structures and deep-time evolution, current AI in Earth sciences predominantly targets surface remote sensing and GIS.…

Artificial Intelligence · Computer Science 2026-05-26 Chenyou Guo , Zongqi Liu , Yizhou Zhang , Zhaorui Jiang , Ze Liu

Artificial autonomous agents and robots interacting in complex environments are required to continually acquire and fine-tune knowledge over sustained periods of time. The ability to learn from continuous streams of information is referred…

Artificial Intelligence · Computer Science 2018-12-20 German I. Parisi , Jun Tani , Cornelius Weber , Stefan Wermter