中文
相关论文

相关论文: MementoGUI: Learning Agentic Multimodal Memory Con…

200 篇论文

Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots. To…

计算与语言 · 计算机科学 2026-05-29 Junyang Wang , Haiyang Xu , Xi Zhang , Zhaoqing Zhu , Ming Yan , Jieping Ye , Jitao Sang

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

人工智能 · 计算机科学 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

We introduce EMemBench, a programmatic benchmark for evaluating long-term memory of agents through interactive games. Rather than using a fixed set of questions, EMemBench generates questions from each agent's own trajectory, covering both…

计算与语言 · 计算机科学 2026-01-26 Xinze Li , Ziyue Zhu , Siyuan Liu , Yubo Ma , Yuhang Zang , Yixin Cao , Aixin Sun

The recent advancement of autonomous agents powered by Large Language Models (LLMs) has demonstrated significant potential for automating tasks on mobile devices through graphical user interfaces (GUIs). Despite initial progress, these…

人机交互 · 计算机科学 2025-07-30 Yi Kong , Dianxi Shi , Guoli Yang , Zhang ke-di , Chenlin Huang , Xiaopeng Li , Songchang Jin

With the growing demand for intelligent in-vehicle experiences, vehicle-based agents are evolving from simple assistants to long-term companions. This evolution requires agents to continuously model multi-user preferences and make reliable…

人工智能 · 计算机科学 2026-03-26 Yuhao Chen , Yi Xu , Xinyun Ding , Xiang Fang , Shuochen Liu , Luxi Lin , Qingyu Zhang , Ya Li , Quan Liu , Tong Xu

Manipulative communication, such as gaslighting, guilt-tripping, and emotional coercion, is often difficult for individuals to recognize. Existing agentic AI systems lack the structured, longitudinal memory to track these subtle,…

人工智能 · 计算机科学 2026-03-06 Ratna Kandala , Niva Manchanda , Akshata Kishore Moharir , Ananth Kandala

Online video understanding requires models to perform continuous perception and long-range reasoning within potentially infinite visual streams. Its fundamental challenge lies in the conflict between the unbounded nature of streaming media…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Siwei Wen , Zhangcheng Wang , Xingjian Zhang , Lei Huang , Wenjun Wu

Computer-use agents operate over long horizons under noisy perception, multi-window contexts, evolving environment states. Existing approaches, from RL-based planners to trajectory retrieval, often drift from user intent and repeatedly…

人工智能 · 计算机科学 2026-03-02 Seoyoung Lee , Seobin Yoon , Seongbeen Lee , Yoojung Chun , Dayoung Park , Doyeon Kim , Joo Yong Sim

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

计算与语言 · 计算机科学 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Safety evaluations of memory-equipped LLM agents typically measure within-task safety: whether an agent completes a single scenario safely, often under adversarial conditions such as prompt injection or memory poisoning. In deployment,…

人工智能 · 计算机科学 2026-05-19 Ahmad Al-Tawaha , Shangding Gu , Peizhi Niu , Ruoxi Jia , Ming Jin

Although memory capabilities of AI agents are gaining increasing attention, existing solutions remain fundamentally limited. Most rely on flat, narrowly scoped memory components, constraining their ability to personalize, abstract, and…

计算与语言 · 计算机科学 2025-07-11 Yu Wang , Xi Chen

Autonomous LLM agents increasingly operate in long-horizon, interactive settings where success depends on reusing experience accumulated over extended histories. However, existing agent memory systems are fundamentally constrained by…

计算与语言 · 计算机科学 2026-04-30 Jinze Li , Yang Zhang , Xin Yang , Jiayi Qu , Jinfeng Xu , Shuo Yang , Junhua Ding , Edith Cheuk-Han Ngai

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Long-horizon agentic reasoning requires large language models to act over long interaction histories containing thoughts, tool calls, observations, and partial conclusions. The challenge is not merely that these histories grow long, but…

人工智能 · 计算机科学 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Ziliang Zhao , Jiejun Tan , Zheng Liu , Zhicheng Dou

Navigating and understanding complex environments over extended periods of time is a significant challenge for robots. People interacting with the robot may want to ask questions like where something happened, when it occurred, or how long…

机器人学 · 计算机科学 2024-09-23 Abrar Anwar , John Welsh , Joydeep Biswas , Soha Pouya , Yan Chang

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

计算与语言 · 计算机科学 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Large Language Model (LLM)-based agents are increasingly deployed for complex, tool-based tasks where long-term memory is critical to driving actions. Existing benchmarks, however, primarily test a angent's ability to passively retrieve…

计算与语言 · 计算机科学 2026-01-29 Yiting Shen , Kun Li , Wei Zhou , Songlin Hu

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

计算与语言 · 计算机科学 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

人工智能 · 计算机科学 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

计算与语言 · 计算机科学 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo