中文
相关论文

相关论文: MementoGUI: Learning Agentic Multimodal Memory Con…

200 篇论文

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

计算与语言 · 计算机科学 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Memory emerges as the core module in the Large Language Model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

We present Mem-$\pi$, a framework for adaptive memory in large language model (LLM) agents, where useful guidance is generated on demand rather than retrieved from external memory stores. Existing memory-augmented agents typically rely on…

We introduce M3-Agent, a novel multimodal agent framework equipped with long-term memory. Like humans, M3-Agent can process real-time visual and auditory inputs to build and update episodic and semantic memories, gradually accumulating…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Lin Long , Yichen He , Wentao Ye , Yiyuan Pan , Yuan Lin , Hang Li , Junbo Zhao , Wei Li

Recent benchmarks for Large Language Model (LLM) agents primarily focus on evaluating reasoning, planning, and execution capabilities, while another critical component-memory, encompassing how agents memorize, update, and retrieve long-term…

计算与语言 · 计算机科学 2026-03-19 Yuanzhe Hu , Yu Wang , Julian McAuley

With the rapid development of Large Vision Language Models, the focus of Graphical User Interface (GUI) agent tasks shifts from single-screen tasks to complex screen navigation challenges. However, real-world GUI environments, such as PC…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haolong Yan , Yeqing Shen , Xin Huang , Jia Wang , Kaijun Tan , Zhixuan Liang , Hongxin Li , Zheng Ge , Osamu Yoshie , Si Li , Xiangyu Zhang , Daxin Jiang

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Graphical User Interface (GUI) Agents powered by Multimodal Large Language Models (MLLMs) show significant potential for automating tasks. However, they often struggle with long-horizon tasks, leading to frequent failures. Process Reward…

人工智能 · 计算机科学 2025-10-06 Tao Xiong , Xavier Hu , Yurun Chen , Yuhang Liu , Changqiao Wu , Pengzhi Gao , Wei Liu , Jian Luan , Shengyu Zhang

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

计算与语言 · 计算机科学 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

人工智能 · 计算机科学 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Large Language Model (LLM) web agents often struggle with long-horizon web navigation and web task completion in new websites, producing inefficient action sequences unless fine-tuned on environment-specific data. We show that…

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact…

计算与语言 · 计算机科学 2026-04-23 Md Nayem Uddin , Kumar Shubham , Eduardo Blanco , Chitta Baral , Gengyu Wang

Long-horizon conversational agents require persistent memory for coherent reasoning, yet uncontrolled accumulation causes temporal decay and false memory propagation. Benchmarks such as LOCOMO and LOCCO report performance degradation from…

人工智能 · 计算机科学 2026-04-03 Payal Fofadiya , Sunil Tiwari

Despite improvements by length extrapolation, efficient attention and memory modules, handling infinitely long documents with linear complexity without performance degradation during extrapolation remains the ultimate challenge in long-text…

Complex tasks are increasingly delegated to ensembles of specialized LLM-based agents that reason, communicate, and coordinate actions-both among themselves and through interactions with external tools, APIs, and databases. While persistent…

多智能体系统 · 计算机科学 2025-05-27 Alireza Rezazadeh , Zichao Li , Ange Lou , Yuying Zhao , Wei Wei , Yujia Bao

Memory-augmented LLM agents offer an appealing shortcut to continual learning: rather than updating model parameters, they accumulate experience in external memory, seemingly sidestepping the stability-plasticity dilemma of parametric…

机器学习 · 计算机科学 2026-05-01 Qisheng Hu , Quanyu Long , Wenya Wang

Large Language Model (LLM) agents require persistent memory to maintain personalization, factual continuity, and long-horizon reasoning, yet standard context-window and retrieval-augmented generation (RAG) pipelines degrade over…

人工智能 · 计算机科学 2026-04-07 Shu Wang , Edwin Yu , Oscar Love , Tom Zhang , Tom Wong , Steve Scargall , Charles Fan

Multimodal large language models are evolving toward multimodal agents capable of proactively executing tasks. Most agent research focuses on GUI or embodied scenarios, which correspond to agents interacting with 2D virtual worlds or 3D…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Longrong Yang , Zhixiong Zeng , Yufeng Zhong , Jing Huang , Liming Zheng , Lei Chen , Haibo Qiu , Zequn Qin , Lin Ma , Xi Li

Large Language Models have demonstrated remarkable capabilities across diverse domains, yet significant challenges persist when deploying them as AI agents for real-world long-horizon tasks. Existing LLM agents suffer from a critical…

Recent advances in Multimodal Large Language Models (MLLMs) have substantially driven the progress of autonomous agents for Graphical User Interface (GUI). Nevertheless, in real-world applications, GUI agents are often faced with…

人工智能 · 计算机科学 2026-02-17 Yibo Wang , Guangda Huzhang , Yuwei Hu , Yu Xia , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Lijun Zhang