English
Related papers

Related papers: MementoGUI: Learning Agentic Multimodal Memory Con…

200 papers

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle…

Robotics · Computer Science 2026-04-16 Zhen Liu , Xinyu Ning , Zhe Hu , Xinxin Xie , Weize Li , Zhipeng Tang , Chongyu Wang , Zejun Yang , Hanlin Wang , Yitong Liu , Zhongzhu Pu

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

Existing efforts in building Graphical User Interface (GUI) agents largely rely on the training paradigm of supervised fine-tuning on Large Vision-Language Models (LVLMs). However, this approach not only demands extensive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Run Luo , Lu Wang , Wanwei He , Longze Chen , Jiaming Li , Xiaobo Xia

Lifelong interactive agents are expected to assist users over months or years, which requires continually writing long term memories while retrieving the right evidence for each new query under fixed context and latency budgets. Existing…

Information Retrieval · Computer Science 2026-03-23 Can Lv , Heng Chang , Yuchen Guo , Shengyu Tao , Shiji Zhou

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

Recent advancements in visual language models (VLMs) have notably enhanced their capabilities in handling complex Graphical User Interface (GUI) interaction tasks. Despite these improvements, current frameworks often struggle to generate…

Computation and Language · Computer Science 2025-04-23 Zhiyuan Hu , Shiyun Xiong , Yifan Zhang , See-Kiong Ng , Anh Tuan Luu , Bo An , Shuicheng Yan , Bryan Hooi

Computer-use agents that combine GUI interaction with structured API calls via the Model Context Protocol (MCP) show promise for automating software tasks. However, existing approaches lack a principled understanding of how agents should…

Artificial Intelligence · Computer Science 2026-04-14 Tiantian He , Yihang Chen , Keyue Jiang , Ka Yiu Lee , Kaiwen Zhou , Kun Shao , Shuai Wang

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Retrieval-Augmented Generation remains the dominant pattern for giving LLMs persistent memory, but a visible cluster of personal wiki-style memory architectures emerged in April 2026 -- design proposals from Karpathy, MemPalace, and LLM…

Artificial Intelligence · Computer Science 2026-04-15 Stefan Miteski

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

In the future we can expect that artificial intelligent agents, once deployed, will be required to learn continually from their experience during their operational lifetime. Such agents will also need to communicate with humans and other…

Artificial Intelligence · Computer Science 2021-10-01 David Murphy , Thomas S. Paula , Wagston Staehler , Juliano Vacaro , Gabriel Paz , Guilherme Marques , Bruna Oliveira

Current benchmarks for graphical user interface (GUI) agents predominantly rely on static screenshots. However, real-world smartphone interaction routinely requires agents to process transient audio cues and temporal video dynamics that are…

Human-Computer Interaction · Computer Science 2026-05-20 Felix Henry , Xiaochen Lin , Jiangyou Zhu , Yangfan , Bingqian Zhang , Min Chen , Shiyu Huang

Mobile GUI agents exhibit substantial potential to facilitate and automate the execution of user tasks on mobile phones. However, exist mobile GUI agents predominantly privilege autonomous operation and neglect the necessity of active user…

Artificial Intelligence · Computer Science 2025-10-10 Haitao Jia , Ming He , Zimo Yin , Likang Wu , Jianping Fan , Jitao Sang

Research on large language model (LLM) security is shifting from "will the model leak training data" to a more consequential question: can an agent with persistent, long-term memory be continuously shaped, cross-session poisoned, accessed…

Cryptography and Security · Computer Science 2026-04-21 Zehao Lin , Chunyu Li , Kai Chen

Long-video understanding remains a significant challenge for Multimodal Large Language Models (MLLMs) due to inherent token limitations and the complexity of capturing long-term temporal dependencies. Existing methods often fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jeong Hun Yeo , Sangyun Chung , Sungjune Park , Dae Hoe Kim , Jinyoung Moon , Yong Man Ro

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

The evolution from static ranking models to Agentic Recommender Systems (Agentic RecSys) empowers AI agents to maintain long-term user profiles and autonomously plan service tasks. While this paradigm shift enhances personalization, it…

Cryptography and Security · Computer Science 2026-04-21 Jiachen Qian

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models…

Artificial Intelligence · Computer Science 2026-01-13 Junhao Zheng , Chengming Shi , Xidi Cai , Qiuke Li , Duzhen Zhang , Chenxing Li , Dong Yu , Qianli Ma
‹ Prev 1 8 9 10 Next ›