English
Related papers

Related papers: MMA: Multimodal Memory Agent

200 papers

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

Visual Question Answering systems face reliability issues due to hallucinations, where models generate answers misaligned with visual input or factual knowledge. While Retrieval Augmented Generation frameworks mitigate this issue by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ruoshuang Du , Xin Sun , Qiang Liu , Bowen Song , Zhongqi Chen , Weiqiang Wang , Liang Wang

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact…

Computation and Language · Computer Science 2026-04-23 Md Nayem Uddin , Kumar Shubham , Eduardo Blanco , Chitta Baral , Gengyu Wang

Missing modalities cause severe failures in multimodal recommender systems. User histories, item text, and visual evidence are frequently absent during cold-start scenarios, exactly when recommendation quality matters most. Existing…

Information Retrieval · Computer Science 2026-05-26 Jinze Wang , Yangchen Zeng , Tiehua Zhang , Lu Zhang , Yuze Liu , Zhishu Shen , Jiong Jin , Zhu Sun

The rapid evolution of Large Language Model (LLM) agents has necessitated robust memory systems to support cohesive long-term interaction and complex reasoning. Benefiting from the strong capabilities of LLMs, recent research focus has…

Artificial Intelligence · Computer Science 2026-04-16 Weiquan Huang , Zixuan Wang , Hehai Lin , Sudong Wang , Bo Xu , Qian Li , Beier Zhu , Linyi Yang , Chengwei Qin

Existing evaluations of agents with memory typically assess memorization and action in isolation. One class of benchmarks evaluates memorization by testing recall of past conversations or text but fails to capture how memory is used to…

Computation and Language · Computer Science 2026-02-19 Zexue He , Yu Wang , Churan Zhi , Yuanzhe Hu , Tzu-Ping Chen , Lang Yin , Ze Chen , Tong Arthur Wu , Siru Ouyang , Zihan Wang , Jiaxin Pei , Julian McAuley , Yejin Choi , Alex Pentland

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Conversational agents struggle to handle long conversations due to context window limitations. Therefore, memory systems are developed to leverage essential historical information. Existing memory systems typically follow a pipeline of…

Computation and Language · Computer Science 2026-01-30 Yimin Deng , Yuqing Fu , Derong Xu , Yejing Wang , Wei Ni , Jingtong Gao , Xiaopeng Li , Chengxu Liu , Xiao Han , Guoshuai Zhao , Xiangyu Zhao , Li Zhu , Xueming Qian

Recent advancements in large language models (LLMs) have significantly enhanced the capabilities of collaborative multi-agent systems, enabling them to address complex challenges. However, within these multi-agent systems, the…

Computation and Language · Computer Science 2026-03-03 Naen Xu , Hengyu An , Shuo Shi , Jinghuai Zhang , Chunyi Zhou , Changjiang Li , Tianyu Du , Zhihui Fu , Jun Wang , Shouling Ji

Multimodal Large Language Models (MLLMs) have significantly advanced GUI agents, yet long-horizon automation remains constrained by two critical bottlenecks: context overload from raw sequential trajectory dependence and architectural…

Artificial Intelligence · Computer Science 2026-04-15 Weihua Cheng , Junming Liu , Yifei Sun , Botian Shi , Yirong Chen , Ding Wang

AI agents that interact with users across multiple sessions require persistent long-term memory to maintain coherent, personalized behavior. Current approaches either rely on flat retrieval-augmented generation (RAG), which loses structural…

Artificial Intelligence · Computer Science 2026-05-14 Swarna Kamal Paul , Shubhendu Sharma , Nitin Sareen

User behavior data produced during interaction with massive items in the significant data era are generally heterogeneous and sparse, leaving the recommender system (RS) a large diversity of underlying patterns to excavate. Deep neural…

Information Retrieval · Computer Science 2022-12-29 Cheng Liang , Teng Huang , Yi He , Song Deng , Di Wu , Xin Luo

Long-context LLMs and Retrieval-Augmented Generation (RAG) systems process information passively, deferring state tracking, contradiction resolution, and evidence aggregation to query time, which becomes brittle under ultra long streams…

Machine Learning · Computer Science 2026-02-24 Kehao Zhang , Shangtong Gui , Sheng Yang , Wei Chen , Yang Feng

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

Computation and Language · Computer Science 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Long-term agent memory is increasingly multimodal, yet existing evaluations rarely test whether agents preserve the visual evidence needed for later reasoning. In prior work, many visually grounded questions can be answered using only…

Intelligent agents need to remember salient information to reason in partially-observed environments. For example, agents with a first-person view should remember the positions of relevant objects even if they go out of view. Similarly, to…

Artificial Intelligence · Computer Science 2022-10-25 Jurgis Pasukonis , Timothy Lillicrap , Danijar Hafner

The rapid proliferation of multimodal misinformation presents significant challenges for automated fact-checking systems, especially when claims are ambiguous or lack sufficient context. We introduce RAMA, a novel retrieval-augmented…

Computation and Language · Computer Science 2025-07-15 Shuo Yang , Zijian Yu , Zhenzhe Ying , Yuqin Dai , Guoqing Wang , Jun Lan , Jinfeng Xu , Jinze Li , Edith C. H. Ngai

Long video understanding requires more than large context windows. It also needs a memory mechanism that decides what visual evidence to retain, keeps it searchable over long horizons, and grounds later reasoning in recoverable observations…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Aiden Yiliu Li , Nels Numan , Anthony Steed

Retrieval-Augmented Generation (RAG) has emerged as the dominant paradigm for grounding large language model outputs in verifiable evidence. However, as modern AI agents transition from static knowledge bases to continuous multimodal…

Machine Learning · Computer Science 2025-11-05 Rohan Wandre , Yash Gajewar , Namrata Patel , Vivek Dhalkari
‹ Prev 1 2 3 10 Next ›