English
Related papers

Related papers: On the Reliability of Computer Use Agents

200 papers

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

In order for humans to confidently decide where to employ RL agents for real-world tasks, a human developer must validate that the agent will perform well at test-time. Some policy interpretability methods facilitate this by capturing the…

Machine Learning · Computer Science 2022-03-22 Julius Frost , Olivia Watkins , Eric Weiner , Pieter Abbeel , Trevor Darrell , Bryan Plummer , Kate Saenko

As AI agents built on large language models (LLMs) become increasingly embedded in society, issues of coordination, control, delegation, and accountability are entangled with concerns over their reliability. To design and implement LLM…

Computers and Society · Computer Science 2025-12-09 R. Patrick Xian , Garry A. Gabison , Ahmed Alaa , Christoph Riedl , Grigorios G. Chrysos

Computer-Using Agents (CUAs) aim to autonomously operate computer systems to complete real-world tasks. However, existing agentic systems remain difficult to scale and lag behind human performance. A key limitation is the absence of…

Stochastic multi-agent systems are a central modeling framework for autonomous controllers, communication protocols, and cyber-physical infrastructures. In many such systems, however, transition probabilities are only estimated from data…

Logic in Computer Science · Computer Science 2026-02-17 Raphaël Berthon , Joost-Pieter Katoen , Munyque Mittelmann , Aniello Murano

Controllability refers to a situation in which a Multi-agent System may be steered from one state to another using specified rules. As a result, there is belief in achieving a given condition by explicit advances. The level of dynamism in…

Multiagent Systems · Computer Science 2021-12-28 Javeria Noor

Reproducing computational research is often assumed to be as simple as rerunning the original code with provided data. In practice, missing packages, fragile file paths, version conflicts, or incomplete logic frequently cause analyses to…

Software Engineering · Computer Science 2026-04-24 Syed Mehtab Hussain Shah , Frank Hopfgartner , Arnim Bleier

As AI systems gain increasing autonomy and execution capability, the number of discovered security vulnerabilities continues to rise. However, many of these vulnerabilities are not fundamentally novel, but instead reflect recurring classes…

Cryptography and Security · Computer Science 2026-05-27 Kevin Eykholt , Dhilung Kirat , Xiaokui Shu , Jiyong Jang , Frederico Araujo , Ian Molloy

Autonomous agents operating in sequential decision-making tasks under uncertainty can benefit from external action suggestions, which provide valuable guidance but inherently vary in reliability. Existing methods for incorporating such…

Artificial Intelligence · Computer Science 2026-05-26 Dylan M. Asmar , Mykel J. Kochenderfer

Leading agent-based trust models address two important needs. First, they show how an agent may estimate the trustworthiness of another agent based on prior interactions. Second, they show how agents may share their knowledge in order to…

Multiagent Systems · Computer Science 2014-01-17 Yonghong Wang , Chung-Wei Hang , Munindar P. Singh

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida

Obviously, the dynamism of software reliability research has speeded up significantly in the last period, and we can state the fact that its intensity is approaching, and in some cases is ahead of the information systems hardware…

Software Engineering · Computer Science 2020-03-06 Anton Petrov , Elena Popova , Alexander Petrov

Browser-use agents are widely used for everyday tasks. They enable automated interaction with web pages through structured DOM based interfaces or vision language models operating on page screenshots. However, web pages often change between…

Cryptography and Security · Computer Science 2026-03-03 Linxi Jiang , Zhijie Liu , Haotian Luo , Zhiqiang Lin

In this paper we investigate the notion of legibility in sequential decision-making in the context of teams and teamwork. There have been works that extend the notion of legibility to sequential decision making, for deterministic and for…

Artificial Intelligence · Computer Science 2025-07-30 Miguel Faria , Francisco S. Melo , Ana Paiva

AI agents are continually optimized for tasks related to human work, such as software engineering and professional writing, signaling a pressing trend with significant impacts on the human workforce. However, these agent developments have…

Artificial Intelligence · Computer Science 2025-11-10 Zora Zhiruo Wang , Yijia Shao , Omar Shaikh , Daniel Fried , Graham Neubig , Diyi Yang

Current tool-using AI agents suffer from limited action space, context inefficiency, and probabilistic instability that makes them unsuitable for handling repetitive tasks which are otherwise reliably and efficiently tackled by agentic…

Software Engineering · Computer Science 2025-12-19 Nishant Gaurav , Adit Akarsh , Tejas Ravishankar , Manoj Bajaj

Current agentic AI benchmarks predominantly evaluate task completion accuracy, while overlooking critical enterprise requirements such as cost-efficiency, reliability, and operational stability. Through systematic analysis of 12 main…

Artificial Intelligence · Computer Science 2025-11-19 Sushant Mehta

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

Our hypothesis is that by equipping certain agents in a multi-agent system controlling an intelligent building with automated decision support, two important factors will be increased. The first is energy saving in the building. The second…

Artificial Intelligence · Computer Science 2013-01-30 Magnus Boman , Paul Davidsson , Hakan L. Younes

This work addresses the problem of ensuring trustworthy computation in a linear consensus network. A solution to this problem is relevant for several tasks in multi-agent systems including motion coordination, clock synchronization, and…

Optimization and Control · Mathematics 2011-04-19 Fabio Pasqualetti , Antonio Bicchi , Francesco Bullo