English
Related papers

Related papers: Toward Autonomous UI Exploration: The UIExplorer B…

200 papers

Autonomous agents that execute human tasks by controlling computers can enhance human productivity and application accessibility. However, progress in this field will be driven by realistic and reproducible benchmarks. We present…

Interactive agent benchmarks map an agent run to a binary outcome through outcome checks. When these checks rely on surface level signals or fail to capture the agent's actual action path, they cannot reliably determine whether the run…

Artificial Intelligence · Computer Science 2026-05-12 Shanshan Gao , Liyi Zhou

Evaluating AI agents within complex, interactive environments that mirror real-world challenges is critical for understanding their practical capabilities. While existing agent benchmarks effectively assess skills like tool use or…

Artificial Intelligence · Computer Science 2025-08-15 Long Phan , Mantas Mazeika , Andy Zou , Dan Hendrycks

Efficient exploration is a long-standing problem in sensorimotor learning. Major advances have been demonstrated in noise-free, non-stochastic domains such as video games and simulation. However, most of these formulations either get stuck…

Machine Learning · Computer Science 2019-06-11 Deepak Pathak , Dhiraj Gandhi , Abhinav Gupta

Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex environments, such as web browsers and graphical user interfaces (GUIs). However, existing…

Building agents that can explore their environments intelligently is a challenging open problem. In this paper, we make a step towards understanding how a hierarchical design of the agent's policy can affect its exploration capabilities.…

Machine Learning · Computer Science 2018-11-19 Maruan Al-Shedivat , Lisa Lee , Ruslan Salakhutdinov , Eric Xing

As the capability frontier of autonomous agents continues to expand, they are increasingly able to complete specialized tasks through plug-and-play external skills. Yet current benchmarks mostly test whether models can use provided skills,…

Artificial Intelligence · Computer Science 2026-04-21 Ziao Zhang , Kou Shi , Shiting Huang , Avery Nie , Yu Zeng , Yiming Zhao , Zhen Fang , Qishen Su , Haibo Qiu , Wei Yang , Qingnan Ren , Shun Zou , Wenxuan Huang , Lin Chen , Zehui Chen , Feng Zhao

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

As large language model (LLM) agents increasingly undertake digital work, reliable frameworks are needed to evaluate their real-world competence, adaptability, and capacity for human collaboration. Existing benchmarks remain largely static,…

Artificial Intelligence · Computer Science 2025-12-15 Darvin Yi , Teng Liu , Mattie Terzolo , Lance Hasson , Ayan Sinha , Pablo Mendes , Andrew Rabinovich

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Coding agents are increasingly used as application builders, yet many evaluations still focus on source code, repository-level tests, or intermediate traces rather than the delivered application. We introduce WebGameBench, a…

Artificial Intelligence · Computer Science 2026-05-25 Wenyu Zhang , Guoliang You , Tianlun , Haotian Zhao , Tianshu Zhu , Haoran Wang , Xiaoxuan Tang , Mingyang Dai , Jingnan Gu , Daxiang Dong , Jianmin Wu

The rapid proliferation of artificial intelligence (AI) in consumer-facing digital products has disrupted the assumptions underlying classical user experience (UX) evaluation frameworks. Legacy metrics such as the System Usability Scale…

Human-Computer Interaction · Computer Science 2026-05-08 Harish Vijayakumar

We describe WebSuite, the first diagnostic benchmark for generalist web agents, designed to systematically evaluate why agents fail. Advances in AI have led to the rise of numerous web agents that autonomously operate a browser to complete…

Software Engineering · Computer Science 2024-06-05 Eric Li , Jim Waldo

Existing AI evaluation practices often fail to capture how systems actually perform in low-resource environments, where operational constraints shape usability as much as model quality. Through a structured analysis of existing benchmark…

Artificial Intelligence · Computer Science 2026-05-28 Aakash Pant , Kavya Shah , Apoorv Agnihotri , Sneha Nikam , Prasaanth Balraj , Nakul Jain

AI agents -- powered by reasoning-capable large language models (LLMs) and integrated with tools, data, and web search -- are poised to transform the internet into a \emph{Web of Agents}: a machine-native ecosystem where autonomous agents…

Artificial Intelligence · Computer Science 2025-09-08 Rajesh Tembarai Krishnamachari , Srividya Rajesh

Web agents automate browser tasks, ranging from simple form completion to complex workflows like ordering groceries. While current benchmarks evaluate general-purpose performance~(e.g., WebArena) or safety against malicious actions~(e.g.,…

Cryptography and Security · Computer Science 2026-04-09 Guruprasad Viswanathan Ramesh , Asmit Nayak , Basieem Siddique , Kassem Fawaz

Large Language Models (LLMs)-based agents have made impressive progress in reasoning and tool use, enabling them to solve complex tasks. However, their ability to proactively collaborate with users, especially when goals are vague,…

Agent benchmarks have become the de facto measure of frontier AI competence, guiding model selection, investment, and deployment. However, reward hacking, where agents maximize a score without performing the intended task, emerges…

Artificial Intelligence · Computer Science 2026-05-14 Hao Wang , Hanchen Li , Qiuyang Mang , Alvin Cheung , Koushik Sen , Dawn Song

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To…

Computation and Language · Computer Science 2025-10-20 Wei He , Yueqing Sun , Hongyan Hao , Xueyuan Hao , Zhikang Xia , Qi Gu , Chengcheng Han , Dengchang Zhao , Hui Su , Kefeng Zhang , Man Gao , Xi Su , Xiaodong Cai , Xunliang Cai , Yu Yang , Yunke Zhao

Usability evaluations are essential for ensuring that modern interfaces meet user needs, yet traditional heuristic evaluations by human experts can be time-consuming and subjective, especially early in development. This paper investigates…

Software Engineering · Computer Science 2025-12-05 Nolan Platt , Ethan Luchs , Sehrish Nizamani