English
Related papers

Related papers: Step-level Optimization for Efficient Computer-use…

200 papers

Recent advances in multimodal large language models unlock unprecedented opportunities for GUI automation. However, a fundamental challenge remains: how to efficiently acquire high-quality training data while maintaining annotation…

Computer-Using Agents (CUAs) aim to autonomously operate computer systems to complete real-world tasks. However, existing agentic systems remain difficult to scale and lag behind human performance. A key limitation is the absence of…

General-purpose computer-use agents have shown impressive performance across diverse digital environments. However, our new benchmark, OSExpert-Eval, indicates they remain far less helpful than human experts. Although inference-time scaling…

Artificial Intelligence · Computer Science 2026-03-10 Jiateng Liu , Zhenhailong Wang , Rushi Wang , Bingxuan Li , Jeonghwan Kim , Aditi Tiwari , Pengfei Yu , Denghui Zhang , Heng Ji

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

As LLMs shift toward autonomous agents, Deep Research has emerged as a pivotal metric. However, existing academic benchmarks like BrowseComp often fail to meet real-world demands for open-ended research, which requires robust skills in…

Large language model agents are increasingly envisioned as always-on personal assistants with access to anything relevant in the user's digital world. Yet current systems operate over only narrow slices of that world, limiting…

Artificial Intelligence · Computer Science 2026-05-26 Yusong Lin , Xinyuan Liang , Haiyang Wang , Qipeng Gu , Siqi Cheng , Jiangui Chen , Shuzhe Wu , Feiyang Pan , Lue Fan , Sanyuan Zhao , Dandan Tu

Computer-use agents (CUAs) hold promise for automating everyday digital tasks, but their performance on long-horizon, complex problems remains unreliable. Single-rollout execution is brittle, with small errors compounding over time and…

Artificial Intelligence · Computer Science 2026-02-05 Gonzalo Gonzalez-Pumariega , Vincent Tu , Chih-Lun Lee , Jiachen Yang , Ang Li , Xin Eric Wang

Evaluating Computer Use Agents (CUAs) on interactive environments is fraught with methodological pitfalls that the field has yet to systematically address. We show that a 1MB replay script that blindly executes a recorded action sequence…

Software Engineering · Computer Science 2026-05-12 Pierluca D'Oro , Sneha Silwal , William Wong , Yuxuan Sun , Fanyi Xiao , Manchen Wang , Eric Gan , Allen Bolourchi , Joseph Tighe

While trajectory prediction plays a critical role in enabling safe and effective path-planning in automated vehicles, standardized practices for evaluating such models remain underdeveloped. Recent efforts have aimed to unify dataset…

Machine Learning · Computer Science 2025-09-19 Julian F. Schumann , Anna Mészáros , Jens Kober , Arkady Zgonnikov

Next-generation AI must manage vast personal data, diverse tools, and multi-step reasoning, yet most benchmarks remain context-free and single-turn. We present ASTRA-bench (Assistant Skills in Tool-use, Reasoning \& Action-planning), a…

Artificial Intelligence · Computer Science 2026-03-03 Zidi Xiu , David Q. Sun , Kevin Cheng , Maitrik Patel , Josh Date , Yizhe Zhang , Jiarui Lu , Omar Attia , Raviteja Vemulapalli , Oncel Tuzel , Meng Cao , Samy Bengio

Computer use agents represent an emerging area in artificial intelligence, aiming to operate computers autonomously to fulfill user tasks, attracting significant attention from both industry and academia. However, the performance of…

Artificial Intelligence · Computer Science 2026-01-23 Yuhao Cheng , Liang Tang , Shuxian Li , Yukang Huo , Tiaonan Duan , Kaer Huang , Yanzhe Jing , Yiqiang Yan

Background: Large-scale biological jobs on high-performance computing systems require manual intervention if one or more computing cores on which they execute fail. This places not only a cost on the maintenance of the job, but also a cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-04 Blesson Varghese , Gerard McKee , Vassil Alexandrov

Language agents have shown promising adaptability in dynamic environments to perform complex tasks. However, despite the versatile knowledge embedded in large language models, these agents still fall short when it comes to tasks that…

Computation and Language · Computer Science 2024-11-14 Minh Nguyen , Ehsan Shareghi

Autonomous computer use agents that powered by multimodal large language models (MLLMs) are emerging as capable assistants for completing complex digital workflows. However, real-world execution environments are far from ideal: pop-ups,…

Artificial Intelligence · Computer Science 2026-05-26 Jingwei Sun , Jianing Zhu , Yuanyi Li , Tongliang Liu , Xia HU , Bo Han

While Vision-Language Models (VLMs) have significantly advanced Computer-Using Agents (CUAs), current frameworks struggle with robustness in long-horizon workflows and generalization in novel domains. These limitations stem from a lack of…

An efficient and flexible engine for computing fixed points is critical for many practical applications. In this paper, we firstly present a goal-directed fixed point computation strategy in the logic programming paradigm. The strategy…

Programming Languages · Computer Science 2007-05-23 Hai-Feng Guo , Gopal Gupta

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

We introduce DABstep, a novel benchmark for evaluating AI agents on realistic multi-step data analysis tasks. DABstep comprises over 450 real-world challenges derived from a financial analytics platform, requiring models to combine…

Machine Learning · Computer Science 2025-07-01 Alex Egg , Martin Iglesias Goyanes , Friso Kingma , Andreu Mora , Leandro von Werra , Thomas Wolf

Enterprise AI Assistants are increasingly deployed in domains where accuracy is paramount, making each erroneous output a potentially significant incident. This paper presents a comprehensive framework for monitoring, benchmarking, and…

Artificial Intelligence · Computer Science 2025-04-22 Akash V. Maharaj , David Arbour , Daniel Lee , Uttaran Bhattacharya , Anup Rao , Austin Zane , Avi Feller , Kun Qian , Yunyao Li

Large Language Models (LLMs) show promise as data analysis agents, but existing benchmarks overlook the iterative nature of the field, where experts' decisions evolve with deeper insights of the dataset. To address this, we introduce…

Computation and Language · Computer Science 2025-06-09 Hanyu Li , Haoyu Liu , Tingyu Zhu , Tianyu Guo , Zeyu Zheng , Xiaotie Deng , Michael I. Jordan