English
Related papers

Related papers: Scaling Agents for Computer Use

200 papers

GUI agents powered by LLMs show promise in interacting with diverse digital environments. Among these, video games offer a valuable testbed due to their varied interfaces, with adventure games posing additional challenges through complex,…

Artificial Intelligence · Computer Science 2025-10-16 Jaewoo Ahn , Junseo Kim , Heeseung Yun , Jaehyeon Son , Dongmin Park , Jaewoong Cho , Gunhee Kim

Computer Use Agents (CUAs) are designed to autonomously operate digital interfaces, yet they often fail to reliably determine whether a given task has been completed. We present an autonomous evaluation and feedback framework that uses…

Artificial Intelligence · Computer Science 2025-11-26 Marta Sumyk , Oleksandr Kosovan

Designing autonomous drone swarms is hampered by a vast design space spanning platform, algorithmic, and numerical-strength choices. We perform large-scale agent-based simulations in three canonical scenarios: swarm-on-swarm battle,…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Abram H. Clark , Liraz Mudrik , Colton Kawamura , Nathan C. Redder , João P. Hespanha , Isaac Kaminer

Agent-based modeling is a paradigm of modeling dynamic systems of interacting agents that are individually governed by specified behavioral rules. Training a model of such agents to produce an emergent behavior by specification of the…

Machine Learning · Computer Science 2019-10-11 Karan K. Budhraja , Hang Gao , Tim Oates

Effective information seeking in the vast and ever-growing digital landscape requires balancing expansive search with strategic reasoning. Current large language model (LLM)-based agents struggle to achieve this balance due to limitations…

Artificial Intelligence · Computer Science 2025-08-13 Xianghe Pang , Shuo Tang , Rui Ye , Yuwen Du , Yaxin Du , Siheng Chen

While scaling laws for Large Language Models (LLMs) have been extensively studied along dimensions of model parameters, training data, and compute, the scaling behavior of LLM-based educational agents remains unexplored. We propose that…

Artificial Intelligence · Computer Science 2026-03-13 Mengsong Wu , Hao Hao , Shuzhen Bi , Keqian Li , Wentao Liu , Siyu Song , Hongbo Zhao , Aimin Zhou

Multi-agent systems, where specialized agents collaborate to solve a shared task hold great potential, from increased modularity to simulating complex environments. However, they also have a major caveat -- a single agent can cause the…

Computation and Language · Computer Science 2025-07-22 Ohav Barbi , Ori Yoran , Mor Geva

Agent-based simulation is an indispensable paradigm for studying complex systems. These systems can comprise billions of agents, requiring the computing resources of multiple servers to simulate. Unfortunately, the state-of-the-art…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Lukas Breitwieser , Ahmad Hesam , Abdullah Giray Yağlıkçı , Mohammad Sadrosadati , Fons Rademakers , Onur Mutlu

Continual memory augmentation lets computer-using agents (CUAs) learn from prior interactions, but unvetted memories can encode domain-inappropriate or unsafe heuristics--spurious rules that drift from user intent and safety constraints. We…

Machine Learning · Computer Science 2025-08-11 Thong Q. Nguyen , Shubhang Desai , Raja Hasnain Anwar , Firoz Shaik , Vishwas Suryanarayanan , Vishal Chowdhary

Spreadsheets are ubiquitous across the World Wide Web, playing a critical role in enhancing work efficiency across various domains. Large language model (LLM) has been recently attempted for automatic spreadsheet manipulation but has not…

Artificial Intelligence · Computer Science 2025-03-04 Yibin Chen , Yifu Yuan , Zeyu Zhang , Yan Zheng , Jinyi Liu , Fei Ni , Jianye Hao , Hangyu Mao , Fuzheng Zhang

Large language model (LLM) agents have increasingly advanced service applications, such as booking flight tickets. However, these service agents suffer from unreliability in long-horizon tasks, as they often produce policy violations, tool…

Artificial Intelligence · Computer Science 2026-05-13 Zixu Yang , Hang Zheng , Nan Jiang , Zhiyang Tang , Situo Zhang , Xiaobao Wu , Lu Chen , Kai Yu

Recent advancements in software engineering agents have demonstrated promising capabilities in automating program improvements. However, their reliance on closed-source or resource-intensive models introduces significant deployment…

Software Engineering · Computer Science 2025-04-09 Yingwei Ma , Yongbin Li , Yihong Dong , Xue Jiang , Rongyu Cao , Jue Chen , Fei Huang , Binhua Li

Autonomous edge computing in robotics, smart cities, and autonomous vehicles relies on the seamless integration of sensing, processing, and actuation for real-time decision-making in dynamic environments. At its core is the…

The rapid development of AI agent systems is leading to an emerging Internet of Agents, where specialized agents operate across local devices, edge nodes, private services, and cloud platforms. Although recent efforts have improved agent…

Artificial Intelligence · Computer Science 2026-04-09 Yujun Cheng , Enfang Cui , Hao Qin , Zhiyuan Liang , Qi Xu

Evaluating GUI agents presents a distinct challenge: trajectories are long, visually grounded, and open-ended, yet evaluation must be both accurate and interpretable. Existing approaches typically apply a single holistic judgment over the…

Artificial Intelligence · Computer Science 2026-04-07 Yuwen Zhai , Runze Li , Liang Wang , Nian Shi , Liwu Xu , Wei Zhang , Ran Lin , Bo Xu , Benlei Cui

Enterprise interest in multi-agent systems has shifted from generic software agents to large-language-model (LLM) based intelligent agents that plan, use tools, maintain contextual memory, inspect intermediate results, collaborate with…

Multiagent Systems · Computer Science 2026-05-12 John deVadoss

Deep research has revolutionized data analysis, yet data scientists still devote substantial time to manually crafting visualizations, highlighting the need for robust automation from natural language queries. However, current systems…

Artificial Intelligence · Computer Science 2025-10-06 Zichen Chen , Jiefeng Chen , Sercan Ö. Arik , Misha Sra , Tomas Pfister , Jinsung Yoon

AI agents have become increasingly capable at isolated software engineering (SWE) tasks such as resolving issues on Github. Yet long-horizon tasks involving multiple interdependent subtasks still pose challenges both with respect to…

Computation and Language · Computer Science 2026-03-24 Jiayi Geng , Graham Neubig

Web applications are prime targets for cyberattacks as gateways to critical services and sensitive data. Traditional penetration testing is costly and expertise-intensive, making it difficult to scale with the growing web ecosystem. While…

Cryptography and Security · Computer Science 2025-10-15 Xiaoxue Ren , Penghao Jiang , Kaixin Li , Zhiyong Huang , Xiaoning Du , Jiaojiao Jiang , Zhenchang Xing , Jiamou Sun , Terry Yue Zhuo

Interactive imitation learning makes an agent's control policy robust by stepwise supervisions from an expert. The recent algorithms mostly employ expert-agent switching systems to reduce the expert's burden by limitedly selecting the…

Robotics · Computer Science 2026-04-23 Taisuke Kobayashi