English
Related papers

Related papers: EvoCUA: Evolving Computer Use Agents via Learning …

200 papers

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after…

Artificial Intelligence · Computer Science 2025-09-03 Jinyuan Fang , Yanwen Peng , Xi Zhang , Yingxu Wang , Xinhao Yi , Guibin Zhang , Yi Xu , Bin Wu , Siwei Liu , Zihao Li , Zhaochun Ren , Nikos Aletras , Xi Wang , Han Zhou , Zaiqiao Meng

Embodied agents are expected to operate persistently in dynamic physical environments, continuously acquiring new capabilities over time. Existing approaches to improving agent performance often rely on modifying the agent itself -- through…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Embodied Artificial Intelligence (AI) is an intelligent system formed by agents and their environment through active perception, embodied cognition, and action interaction. Existing embodied AI remains confined to human-crafted setting, in…

Emerging Technologies · Computer Science 2026-02-05 Tongtong Feng , Xin Wang , Wenwu Zhu

We propose a lifelong learning architecture, the Neural Computer Agent (NCA), where a Reinforcement Learning agent is paired with a predictive model of the environment learned by a Differentiable Neural Computer (DNC). The agent and DNC…

Machine Learning · Computer Science 2019-06-19 Adeel Mufti , Svetlin Penkov , Subramanian Ramamoorthy

Graphical User Interface (GUI) agents show great potential for enabling foundation models to complete real-world tasks, revolutionizing human-computer interaction and improving human productivity. In this report, we present OmegaUse, a…

General-purpose computer-use agents have shown impressive performance across diverse digital environments. However, our new benchmark, OSExpert-Eval, indicates they remain far less helpful than human experts. Although inference-time scaling…

Artificial Intelligence · Computer Science 2026-03-10 Jiateng Liu , Zhenhailong Wang , Rushi Wang , Bingxuan Li , Jeonghwan Kim , Aditi Tiwari , Pengfei Yu , Denghui Zhang , Heng Ji

With the advent of generative AI and large language models, embodied conversational agents are becoming synonymous with online interactions. These agents possess vast amounts of knowledge but suffer from exhibiting limited emotional…

Human-Computer Interaction · Computer Science 2026-02-27 Abhishek Kulkarni , Alexander Barquero , Pavitra Lahari , Aryaan Shaikh , Sarah Brown

This paper proposes an intelligent service optimization method based on a multi-agent collaborative evolution mechanism to address governance challenges in large-scale microservice architectures. These challenges include complex service…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Yilin Li , Song Han , Sibo Wang , Ming Wang , Renzi Meng

Edge computing breaks with traditional autoscaling due to strict resource constraints, thus, motivating more flexible scaling behaviors using multiple elasticity dimensions. This work introduces an agent-based autoscaling framework that…

Artificial Intelligence · Computer Science 2026-01-13 Boris Sedlak , Alireza Furutanpey , Zihang Wang , Víctor Casamayor Pujol , Schahram Dustdar

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

Prevailing medical AI operates on an unrealistic ''one-shot'' model, diagnosing from a complete patient file. However, real-world diagnosis is an iterative inquiry where Clinicians sequentially ask questions and order tests to strategically…

Artificial Intelligence · Computer Science 2026-02-02 Yufei He , Juncheng Liu , Zhiyuan Hu , Yulin Chen , Yue Liu , Yuan Sui , Yibo Li , Nuo Chen , Jun Hu , Bryan Hooi , Xinxing Xu , Jiang Bian

To unleash the full potential of AI for Science, we must untether the agents from a purely digital environment. The agent's ability to control and explore in real-world labs is essential because the physical lab remains foundational to…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Zhenning Yang , Yuhan Chen , Patrick Tser Jern Kon , Tongyuan Miao , Hongyi Lin , Venkat Viswanathan , Danai Koutra , Ang Chen

Rapid advances in large language models and agentic AI are driving the emergence of the Internet of Agents (IoA), a paradigm where billions of autonomous software and embodied agents interact, coordinate, and collaborate to accomplish…

Networking and Internet Architecture · Computer Science 2026-03-13 Shaolong Guo , Yuntao Wang , Zhou Su , Yanghe Pan , Qinnan Hu , Tom H. Luan

Due to the complexity of the natural world, a programmer cannot foresee all possible situations, a connected and autonomous vehicle (CAV) will face during its operation, and hence, CAVs will need to learn to make decisions autonomously. Due…

Multiagent Systems · Computer Science 2018-08-24 Varuna De Silva , Xiongzhao Wang , Deniz Aladagli , Ahmet Kondoz , Erhan Ekmekcioglu

Realizing endogenous narrative evolution in LLM-based multi-agent systems is hindered by the inherent stochasticity of generative emergence. In particular, long-horizon simulations suffer from social memory stacking, where conflicting…

Computation and Language · Computer Science 2026-04-15 Shiyu He , Minchi Kuang , Mengxian Wang , Bin Hu , Tingxiang Gu

Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfaces instead of relying on brittle, application-specific integrations. Despite recent…

Artificial Intelligence · Computer Science 2026-05-01 Jinbiao Wei , Kangqi Ni , Yilun Zhao , Guo Gan , Arman Cohan

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

We introduce Evolutionary Ensemble (EvE), a decentralized framework that organizes existing, highly capable coding agents into a live, co-evolving system for algorithmic discovery. Rather than reinventing the wheel within the "LLMs as…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Zongmin Yu , Liu Yang

Computer-use agents that combine GUI interaction with structured API calls via the Model Context Protocol (MCP) show promise for automating software tasks. However, existing approaches lack a principled understanding of how agents should…

Artificial Intelligence · Computer Science 2026-04-14 Tiantian He , Yihang Chen , Keyue Jiang , Ka Yiu Lee , Kaiwen Zhou , Kun Shao , Shuai Wang

Embodied systems, where generative autonomous agents engage with the physical world through integrated perception, cognition, action, and advanced reasoning powered by large language models (LLMs), hold immense potential for addressing…