English
Related papers

Related papers: Computer Use at the Edge of the Statistical Precip…

200 papers

Agent benchmarks typically report only final outcomes: pass or fail. This threatens evaluation credibility in three ways. First, scores may be inflated or deflated by shortcuts and benchmark artifacts, misrepresenting capability. Second,…

Traditional approaches to training agents have generally involved a single, deterministic environment of minimal complexity to solve various tasks such as robot locomotion or computer vision. However, agents trained in static environments…

Robotics · Computer Science 2025-10-01 Kevin Godin-Dubois , Karine Miras , Anna V. Kononova

Real-world software engineering tasks require coding agents that can operate on massive repositories, sustain long-horizon sessions, and reliably coordinate complex toolchains at test time. Existing research-grade coding agents offer…

Computation and Language · Computer Science 2026-02-04 Sherman Wong , Zhenting Qi , Zhaodong Wang , Nathan Hu , Samuel Lin , Jun Ge , Erwin Gao , Wenlin Chen , Yilun Du , Minlan Yu , Ying Zhang

For software interacting directly with real-world end-users, it is common practice to script scenario tests validating the system's compliance with a number of its features. However, these do not accommodate the replication of the type of…

Software Engineering · Computer Science 2022-08-26 Pasquale Salza , Marco Edoardo Palma , Harald C. Gall

Modern information access ecosystems consist of mixtures of systems, such as retrieval systems and large language models, and increasingly rely on marketplaces to mediate access to models, tools, and data, making competition between systems…

Information Retrieval · Computer Science 2026-04-17 To Eun Kim , Alireza Salemi , Hamed Zamani , Fernando Diaz

Agent evaluation requires assessing complex multi-step behaviors involving tool use and intermediate reasoning, making it costly and expertise-intensive. A natural question arises: can frontier coding assistants reliably automate this…

Browser agents enable autonomous web interaction but face critical reliability and security challenges in production. This paper presents findings from building and operating a production browser agent. The analysis examines where current…

Software Engineering · Computer Science 2025-11-26 Aram Vardanyan

Existing web agent benchmarks have largely converged on short, single-site tasks that frontier models are approaching saturation on. However, real world web use consists of long-horizon, multi-site workflows. Common web navigation tasks,…

Machine Learning · Computer Science 2026-04-29 Lawrence Keunho Jang , Jing Yu Koh , Daniel Fried , Ruslan Salakhutdinov

AI agents hold growing promise for accelerating scientific discovery; yet, a lack of frontier evaluations hinders adoption into real workflows. Expert-written benchmarks have proven effective at measuring AI reasoning, but most at this…

Humans often become more self-aware under threat, yet can lose self-awareness when absorbed in a task; we hypothesize that language models exhibit environment-dependent \textit{evaluation awareness}. This raises concerns that models could…

Artificial Intelligence · Computer Science 2026-03-05 Maheep Chaudhary

Programmatic video generation through code offers geometric precision and temporal coherence beyond pixel-level diffusion models, yet rigorously evaluating whether language models can produce spatially correct animated outputs remains an…

Artificial Intelligence · Computer Science 2026-05-20 Qiran Zhang , Yuheng Wang , Runde Yang , Lin Wu , Jingru Fan , Shu Yao , Jie Zhang , Tianle Zhou , Huatao Li , Ruijie Shi , Yihan Li , Chen Qian

Production deployment of AI coding agents requires fast, reproducible evaluation signals. Existing industrial practices trade off speed and fidelity: online A/B testing takes weeks and risks user experience, shadow deployment yields signals…

Software Engineering · Computer Science 2026-05-12 Smriti Jha , Matteo Paltenghi , Chandra Maddila , Vijayaraghavan Murali , Shubham Ugare , Satish Chandra

Autonomous agents operating in the real world must interact continuously with existing physical and semantic infrastructure, track delayed consequences, and verify outcomes over time. Everyday environments are rich in tangible control…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jieru Lin , Zhiwei Yu , Börje F. Karlsson

Objective: Area under the receiving operator characteristic curve (AUC) is commonly reported alongside prediction models for binary outcomes. Recent articles have raised concerns that AUC might be a misleading measure of prediction…

Machine Learning · Statistics 2025-11-04 Emily Minus , R. Yates Coley , Susan M. Shortreed , Brian D. Williamson

Recently, AI-driven interactions with computing devices have advanced from basic prototype tools to sophisticated, LLM-based systems that emulate human-like operations in graphical user interfaces. We are now witnessing the emergence of…

Computation and Language · Computer Science 2026-04-30 Ada Chen , Yongjiang Wu , Junyuan Zhang , Jingyu Xiao , Shu Yang , Jen-tse Huang , Kun Wang , Wenxuan Wang , Shuai Wang

AI agents have significant potential to reshape cybersecurity, making a thorough assessment of their capabilities critical. However, existing evaluations fall short, because they are based on small-scale benchmarks and only measure static…

Cryptography and Security · Computer Science 2026-03-25 Zhun Wang , Tianneng Shi , Jingxuan He , Matthew Cai , Jialin Zhang , Dawn Song

Black-box safety evaluation of AI systems assumes model behavior on test distributions reliably predicts deployment performance. We formalize and challenge this assumption through latent context-conditioned policies -- models whose outputs…

Artificial Intelligence · Computer Science 2026-02-20 Vishal Srivastava

Large language models are shifting from passive information providers to active agents intended for complex workflows. However, their deployment as reliable AI workers in enterprise is stalled by benchmarks that fail to capture the…

The rapid deployment of AI agents in commercial settings has outpaced the development of evaluation methodologies that reflect production realities. Existing benchmarks measure agent capabilities through retrospectively curated tasks with…

The rapid adoption of mobile graphical user interface (GUI) agents, which autonomously control applications and operating systems (OS), exposes new system-level attack surfaces. Existing backdoors against web GUI agents and general GenAI…

Cryptography and Security · Computer Science 2026-03-25 Yutao Luo , Haotian Zhu , Shuchao Pang , Zhigang Lu , Tian Dong , Yongbin Zhou , Minhui Xue