English
Related papers

Related papers: SE-GA: Memory-Augmented Self-Evolution for GUI Age…

200 papers

GUI agents hold significant potential to enhance the experience and efficiency of human-device interaction. However, current methods face challenges in generalizing across applications (apps) and tasks, primarily due to two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yuchen Sun , Shanhui Zhao , Tao Yu , Hao Wen , Samith Va , Mengwei Xu , Yuanchun Li , Chongyang Zhang

Large Language Model (LLM)-based mobile agents have made significant performance advancements. However, these agents often follow explicit user instructions while overlooking personalized needs, leading to significant limitations for real…

Computation and Language · Computer Science 2026-01-29 Shuoxin Wang , Chang Liu , Gowen Loo , Lifan Zheng , Kaiwen Wei , Xinyi Zeng , Jingyuan Zhang , Yu Tian

The development of high-quality datasets is crucial for benchmarking and advancing research in Graphical User Interface (GUI) agents. Despite their importance, existing datasets are often constructed under idealized conditions, overlooking…

Artificial Intelligence · Computer Science 2025-06-18 Jingqi Yang , Zhilong Song , Jiawei Chen , Mingli Song , Sheng Zhou , linjun sun , Xiaogang Ouyang , Chun Chen , Can Wang

External knowledge has played a crucial role in the recent development of computer use agents. We identify a critical knowledge-execution gap: retrieved knowledge often fails to translate into effective real-world task execution. Our…

Human-Computer Interaction · Computer Science 2025-11-04 Ziyun Zhang , Xinyi Liu , Xiaoyi Zhang , Jun Wang , Gang Chen , Yan Lu

Large Language Model (LLM)-based agents have demonstrated remarkable capabilities in complex reasoning and multi-turn interactions but struggle to continuously improve and adapt when deployed in new environments. One promising approach is…

Artificial Intelligence · Computer Science 2026-03-11 Jiongxiao Wang , Qiaojing Yan , Yawei Wang , Yijun Tian , Soumya Smruti Mishra , Zhichao Xu , Megha Gandhi , Panpan Xu , Lin Lee Cheong

A key objective of embodied intelligence is enabling agents to perform long-horizon tasks in dynamic environments while maintaining robust decision-making and adaptability. To achieve this goal, we propose the Spatio-Temporal Memory Agent…

Artificial Intelligence · Computer Science 2025-03-04 Mingcong Lei , Yiming Zhao , Ge Wang , Zhixin Mai , Shuguang Cui , Yatong Han , Jinke Ren

Graphical user interface (GUI) agents autonomously complete tasks across platforms (\eg, Linux) by sequentially decomposing user instructions into action proposals that iteratively interact with visual elements in the evolving environment.…

Large language model (LLM) based agents are increasingly used to tackle software engineering tasks that require multi-step reasoning and code modification, demonstrating promising yet limited performance. However, most existing LLM agents…

Artificial Intelligence · Computer Science 2025-11-11 Hiroaki Hayashi , Bo Pang , Wenting Zhao , Ye Liu , Akash Gokul , Srijan Bansal , Caiming Xiong , Semih Yavuz , Yingbo Zhou

Multi-agent systems powered by large language models have demonstrated remarkable capabilities across diverse domains, yet existing automated design approaches seek monolithic solutions that fail to adapt resource allocation based on query…

Artificial Intelligence · Computer Science 2025-10-06 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Liu

Today's AI systems have human-designed, fixed architectures and cannot autonomously and continuously improve themselves. The advance of AI could itself be automated. If done safely, that would accelerate AI development and allow us to reap…

Artificial Intelligence · Computer Science 2026-03-16 Jenny Zhang , Shengran Hu , Cong Lu , Robert Lange , Jeff Clune

Large Language Models (LLMs) are increasingly used as autonomous agents for multi-step tasks. However, most existing frameworks fail to maintain a structured understanding of the task state, often relying on linear prompt concatenation or…

Artificial Intelligence · Computer Science 2025-08-26 Ye Ye

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

Computation and Language · Computer Science 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

Reinforcement learning is increasingly used to transform large language models into agentic systems that act over long horizons, invoke tools, and manage memory under partial observability. While recent work has demonstrated performance…

Cryptography and Security · Computer Science 2026-01-01 Ken Huang , Jerry Huang

With the rapid advancements in Large Language Models (LLMs), an increasing number of studies have leveraged LLMs as the cognitive core of agents to address complex task decision-making challenges. Specially, recent research has demonstrated…

Multiagent Systems · Computer Science 2025-03-13 Di Zhao , Longhui Ma , Siwei Wang , Miao Wang , Zhao Lv

AI agents that interact with users across multiple sessions require persistent long-term memory to maintain coherent, personalized behavior. Current approaches either rely on flat retrieval-augmented generation (RAG), which loses structural…

Artificial Intelligence · Computer Science 2026-05-14 Swarna Kamal Paul , Shubhendu Sharma , Nitin Sareen

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Retrieval-Augmented Generation (RAG) is widely employed to mitigate risks such as hallucinations and knowledge obsolescence in medical question answering, yet its predominantly single-round, static retrieval paradigm misaligns with the…

Computation and Language · Computer Science 2026-05-19 Yongfeng Huang , Ruiying Chen , James Cheng

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida

Existing methods for AI psychological counselors predominantly rely on supervised fine-tuning using static dialogue datasets. However, this contrasts with human experts, who continuously refine their proficiency through clinical practice…

Artificial Intelligence · Computer Science 2026-04-29 Yutao Yang , Junsong Li , Qianjun Pan , Jie Zhou , Kai Chen , Qin Chen , Jingyuan Zhao , Ningning Zhou , Xin Li , Liang He

We introduce Learning to Self-Evolve (LSE), a reinforcement learning framework that trains large language models (LLMs) to improve their own contexts at test time. We situate LSE in the setting of test-time self-evolution, where a model…

Computation and Language · Computer Science 2026-03-20 Xiaoyin Chen , Canwen Xu , Yite Wang , Boyi Liu , Zhewei Yao , Yuxiong He
‹ Prev 1 3 4 5 6 7 10 Next ›