中文
相关论文

相关论文: SE-GA: Memory-Augmented Self-Evolution for GUI Age…

200 篇论文

Memory data are ubiquitous in Large Language Model (LLM)-based agents (e.g., OpenClaw and Manus). A few recent works have attempted to exploit agents'memory for improving their performance on the question-answering (QA) task, but they lack…

计算与语言 · 计算机科学 2026-05-18 Jiawei Yu , Yixiang Fang , Xilin Liu , Yuchi Ma

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

Deep research agents (DRAs) integrate LLM reasoning with external tools. Memory systems enable DRAs to leverage historical experiences, which are essential for efficient reasoning and autonomous evolution. Existing methods rely on…

人工智能 · 计算机科学 2026-04-21 Jingyang Qiao , Weicheng Meng , Yu Cheng , Zhihang Lin , Zhizhong Zhang , Xin Tan , Jingyu Gong , Kun Shao , Yuan Xie

Developing AI agents powered by large language models (LLMs) faces significant challenges in achieving true Turing completeness and adaptive, code-driven evolution. Current approaches often generate code independently of its runtime…

软件工程 · 计算机科学 2024-09-25 Ming Zhu , Yi Zhou

We present AutoGLM, a new series in the ChatGLM family, designed to serve as foundation agents for autonomous control of digital devices through Graphical User Interfaces (GUIs). While foundation models excel at acquiring human knowledge,…

Training reinforcement learning (RL) policies for legged locomotion often requires extensive environment interactions, which are costly and time-consuming. We propose Symmetry-Guided Memory Augmentation (SGMA), a framework that improves…

机器学习 · 计算机科学 2026-03-26 Kaixi Bao , Chenhao Li , Yarden As , Andreas Krause , Marco Hutter

The development of GUI agents could revolutionize the next generation of human-computer interaction. Motivated by this vision, we present MAI-UI, a family of foundation GUI agents spanning the full spectrum of sizes, including 2B, 8B, 32B,…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Hanzhang Zhou , Xu Zhang , Panrong Tong , Jianan Zhang , Liangyu Chen , Quyu Kong , Chenglin Cai , Chen Liu , Yue Wang , Jingren Zhou , Steven Hoi

Graphical User Interface (GUI) agents adopt an end-to-end paradigm that maps a screenshot to an action sequence, thereby automating repetitive tasks in virtual environments. However, existing GUI agents are evaluated almost exclusively on…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Chunyi Li , Longfei Li , Zicheng Zhang , Xiaohong Liu , Min Tang , Weisi Lin , Guangtao Zhai

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

人工智能 · 计算机科学 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

Our goal is a teachable reasoning system for question-answering (QA), where a user can interact with faithful answer explanations, and correct its errors so that the system improves over time. Our approach is to augment a QA model with a…

计算与语言 · 计算机科学 2022-10-25 Bhavana Dalvi Mishra , Oyvind Tafjord , Peter Clark

Current deep learning approaches for physiological signal monitoring suffer from static topologies and constant energy consumption. We introduce SGEMAS (Self-Growing Ephemeral Multi-Agent System), a bio-inspired architecture that treats…

神经与进化计算 · 计算机科学 2025-12-18 Mustapha Hamdi

Self-evolution, the ability of agents to autonomously improve their reasoning and behavior, is essential for the embodied domain with long-horizon, real-world tasks. Despite current advancements in reinforcement fine-tuning (RFT) showing…

Multimodal Large Language Models (MLLMs) have shown great potential in revolutionizing Graphical User Interface (GUI) automation. However, existing GUI models mostly rely on learning from nearly error-free offline trajectories, thus lacking…

人工智能 · 计算机科学 2025-06-10 Penghao Wu , Shengnan Ma , Bo Wang , Jiaheng Yu , Lewei Lu , Ziwei Liu

This paper introduces RAISE (Reasoning and Acting through Scratchpad and Examples), an advanced architecture enhancing the integration of Large Language Models (LLMs) like GPT-4 into conversational agents. RAISE, an enhancement of the ReAct…

计算与语言 · 计算机科学 2024-01-31 Na Liu , Liangyu Chen , Xiaoyu Tian , Wei Zou , Kaijiang Chen , Ming Cui

Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing methods typically address this challenge through post-hoc credit…

Large language model (LLM) agents have evolved to intelligently process information, make decisions, and interact with users or tools. A key capability is the integration of long-term memory capabilities, enabling these agents to draw upon…

计算与语言 · 计算机科学 2025-08-04 Rana Salama , Jason Cai , Michelle Yuan , Anna Currey , Monica Sunkara , Yi Zhang , Yassine Benajiba

The rapid advancement of large vision language models (LVLMs) and agent systems has heightened interest in mobile GUI agents that can reliably translate natural language into interface operations. Existing single-agent approaches, however,…

人工智能 · 计算机科学 2025-08-28 Quanfeng Lu , Zhantao Ma , Shuai Zhong , Jin Wang , Dahai Yu , Michael K. Ng , Ping Luo

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

人工智能 · 计算机科学 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs…

计算与语言 · 计算机科学 2026-03-10 Muxin Fu , Xiangyuan Xue , Yafu Li , Zefeng He , Siyuan Huang , Xiaoye Qu , Yu Cheng , Yang Yang

Current approaches to memory in Large Language Models (LLMs) predominantly rely on static Retrieval-Augmented Generation (RAG), which often results in scattered retrieval and fails to capture the structural dependencies required for complex…

计算与语言 · 计算机科学 2026-02-11 Zhengxuan Lu , Dongfang Li , Yukun Shi , Beilun Wang , Longyue Wang , Baotian Hu