English
Related papers

Related papers: EvoCUA: Evolving Computer Use Agents via Learning …

200 papers

Computer use agents (CUAs) have shown strong potential for automating complex digital workflows, yet their training remains constrained by costly live environment interaction and limited high-quality supervision. Existing filtered behavior…

Artificial Intelligence · Computer Science 2026-05-29 Yifei He , Rui Yang , Hao Bai , Tong Zhang , Han Zhao

This paper proposes EvoAgent - an evolvable large language model (LLM) agent framework that integrates structured skill learning with a hierarchical sub-agent delegation mechanism. EvoAgent models skills as multi-file structured capability…

Artificial Intelligence · Computer Science 2026-04-27 Aimin Zhang , Jiajing Guo , Fuwei Jia , Chen Lv , Boyu Wang , Fangzheng Li

Computer-use agents(CUAs)are moving frombounded benchmarks toward real software environments, wherethey operate browsers, desktops, mobile applications, flesystems,terminals, and tool backends. In such settings, reliability isno longer…

Computation and Language · Computer Science 2026-05-11 Zejian Chen , Zhanyuan Liu , Chaozhuo Li , Mengxiang Han , Songyang Liu , Litian Zhang , Feng Gao , Yiming Hei , Xi Zhang

Computer Use Agents (CUAs) can act through both atomic GUI actions, such as click and type, and high-level tool calls, such as API-based file operations, but this hybrid action space often leaves them uncertain about when to continue with…

Artificial Intelligence · Computer Science 2026-05-13 Xuhao Hu , Xi Zhang , Haiyang Xu , Kyle Qiao , Jingyi Yang , Xuanjing Huang , Jing Shao , Ming Yan , Jieping Ye

This paper presents our ongoing work toward developing an enterprise-ready Computer Using Generalist Agent (CUGA) system. Our research highlights the evolutionary nature of building agentic systems suitable for enterprise environments. By…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-10 Sami Marreed , Alon Oved , Avi Yaeli , Segev Shlomov , Ido Levy , Offer Akrabi , Aviad Sela , Asaf Adi , Nir Mashkif

Building reliable computer-use agents requires grounding: accurately connecting natural language instructions to the correct on-screen elements. While large datasets exist for web and mobile interactions, high-quality resources for desktop…

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

The increasing adoption of Large Language Models (LLMs) has enabled AI scientists to perform complex end-to-end scientific discovery tasks requiring coordination of specialized roles, including idea generation and experimental execution.…

Computation and Language · Computer Science 2026-03-10 Yougang Lyu , Xi Zhang , Xinhao Yi , Yuyue Zhao , Shuyu Guo , Wenxiang Hu , Jan Piotrowski , Jakub Kaliski , Jacopo Urbani , Zaiqiao Meng , Lun Zhou , Xiaohui Yan

Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are…

Artificial Intelligence · Computer Science 2026-05-14 Jiayi Zhang , Yongfeng Gu , Jianhao Ruan , Maojia Song , Yiran Peng , Zhiguang Han , Jinyu Xiang , Zhitao Wang , Caiyin Yang , Yixi Ouyang , Bang Liu , Chenglin Wu , Yuyu Luo

Open-ended self-improving agents can autonomously modify their own structural designs to advance their capabilities and overcome the limits of pre-defined architectures, thus reducing reliance on human intervention. We introduce…

Artificial Intelligence · Computer Science 2026-02-05 Zhaotian Weng , Antonis Antoniades , Deepak Nathani , Zhen Zhang , Xiao Pu , Xin Eric Wang

Real-world software engineering tasks require coding agents that can operate on massive repositories, sustain long-horizon sessions, and reliably coordinate complex toolchains at test time. Existing research-grade coding agents offer…

Computation and Language · Computer Science 2026-02-04 Sherman Wong , Zhenting Qi , Zhaodong Wang , Nathan Hu , Samuel Lin , Jun Ge , Erwin Gao , Wenlin Chen , Yilun Du , Minlan Yu , Ying Zhang

Computer use agents (CUA) are systems that automatically interact with graphical user interfaces (GUIs) to complete tasks. CUA have made significant progress with the advent of large vision-language models (VLMs). However, these agents…

Artificial Intelligence · Computer Science 2025-06-04 Man Luo , David Cobbley , Xin Su , Shachar Rosenman , Vasudev Lal , Shao-Yen Tseng , Phillip Howard

Human-like Agents with diverse and dynamic personalities could serve as an essential design probe in the process of user-centered design, thereby enabling designers to enhance the user experience of interactive applications. In this…

Human-Computer Interaction · Computer Science 2024-06-18 Jiale Li , Jiayang Li , Jiahao Chen , Yifan Li , Shijie Wang , Hugo Zhou , Minjun Ye , Yunsheng Su

Current Large Language Model (LLM) agents show strong performance in tool use, but lack the crucial capability to systematically learn from their own experiences. While existing frameworks mainly focus on mitigating external knowledge gaps,…

Computation and Language · Computer Science 2026-05-19 Rong Wu , Xiaoman Wang , Jianbiao Mei , Pinlong Cai , Daocheng Fu , Cheng Yang , Licheng Wen , Xuemeng Yang , Yufan Shen , Yuxin Wang , Botian Shi

Coding agents are increasingly used as general-purpose problem solvers, but their flexibility does not by itself confer the domain expertise needed for specialized tasks. Recent work addresses this through \textit{agent skills}: reusable…

Artificial Intelligence · Computer Science 2026-03-04 Salaheddin Alzubi , Noah Provenzano , Jaydon Bingham , Weiyuan Chen , Tu Vu

We present AIOS 1.0, a novel platform designed to advance computer-use agent (CUA) capabilities through environmental contextualization. While existing approaches primarily focus on building more powerful agent frameworks or enhancing agent…

Artificial Intelligence · Computer Science 2025-11-04 Kai Mei , Xi Zhu , Hang Gao , Shuhang Lin , Yongfeng Zhang

Complex agentic AI systems, powered by a coordinated ensemble of Large Language Models (LLMs), tool and memory modules, have demonstrated remarkable capabilities on intricate, multi-turn tasks. However, this success is shadowed by…

Computation and Language · Computer Science 2026-01-07 Guibin Zhang , Haiyang Yu , Kaiming Yang , Bingli Wu , Fei Huang , Yongbin Li , Shuicheng Yan

Building human-like agent, which aims to learn and think like human intelligence, has long been an important research topic in AI. To train and test human-like agents, we need an environment that imposes the agent to rich multimodal…

Artificial Intelligence · Computer Science 2021-05-04 Kwanyoung Park , Hyunseok Oh , Youngki Lee

Simulated user agents are increasingly used in usability testing to support fast, iterative UX workflows, as they generate rich data such as action logs and think-aloud reasoning, but the unstructured nature of this output often obscures…

Human-Computer Interaction · Computer Science 2026-01-23 Steffen Holter , Eunyee Koh , Mustafa Doga Dogan , Gromit Yeuk-Yin Chan

Agent-to-Agent (A2A) networks enable autonomous AI agents to collaborate by sharing reusable problem-solving instructions. However, how these decentralized ecosystems operate in practice remains largely unexplored. We present the first…

Artificial Intelligence · Computer Science 2026-05-28 Qiming Ye , Peixain Zhang , Yupeng He , Zifan Peng , Gareth Tyson