English
Related papers

Related papers: ProBench: Benchmarking GUI Agents with Accurate Pr…

200 papers

With the rapid advancement of Vision-Language Models (VLMs), GUI-based mobile agents have emerged as a key development direction for intelligent mobile systems. However, existing agent models continue to face significant challenges in…

Multiagent Systems · Computer Science 2025-09-03 Cheng Zhang , Erhu Feng , Xi Zhao , Yisheng Zhao , Wangbo Gong , Jiahui Sun , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Mobile Graphical User Interface (GUI) agents aim to autonomously complete tasks within or across apps based on user instructions. While recent Multimodal Large Language Models (MLLMs) enable these agents to interpret UI screens and perform…

Artificial Intelligence · Computer Science 2025-11-20 Linqiang Guo , Wei Liu , Yi Wen Heng , Tse-Hsun , Chen , Yang Wang

Smartphone agents are increasingly important for helping users control devices efficiently, with (Multimodal) Large Language Model (MLLM)-based approaches emerging as key contenders. Fairly comparing these agents is essential but…

As agentic AI systems increasingly operate autonomously, establishing trust through verifiable evaluation becomes critical. Yet existing benchmarks lack the transparency and auditability needed to assess whether agents behave reliably. We…

Computation and Language · Computer Science 2025-12-02 Hyunjun Kim , Sooyoung Ryu

Large language model-based web agents have demonstrated strong performance on realistic web interaction tasks. However, existing evaluations are predominantly conducted under relatively stable and well-behaved interaction conditions, which…

Software Engineering · Computer Science 2026-04-21 Haoyue Bai , Dong Wang , Long Chen , Bingguang Hao , Pengyang Shao , Yonghui Yang , Yicheng He , Chenyi Zhuang

GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high…

Software Engineering · Computer Science 2023-11-16 Juyeon Yoon , Robert Feldt , Shin Yoo

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

We introduce REAL, a benchmark and framework for multi-turn agent evaluations on deterministic simulations of real-world websites. REAL comprises high-fidelity, deterministic replicas of 11 widely-used websites across domains such as…

Scientific research follows multi-turn, multi-step workflows that require proactively searching the literature, consulting figures and tables, and integrating evidence across papers to align experimental settings and support reproducible…

Computation and Language · Computer Science 2026-04-08 Xuan Dong , Huanyang Zheng , Tianhao Niu , Zhe Han , Pengzhan Li , Bofei Liu , Zhengyang Liu , Guancheng Li , Qingfu Zhu , Wanxiang Che

Large Language Model (LLM)-powered agents have unlocked new possibilities for automating human tasks. While prior work has focused on well-defined tasks with specified goals, the capabilities of agents in creative design tasks with…

Artificial Intelligence · Computer Science 2025-04-17 Dayeon Ki , Tianyi Zhou , Marine Carpuat , Gang Wu , Puneet Mathur , Viswanathan Swaminathan

The rapid development of GUI foundation models and mobile GUI agents has spurred numerous evaluation benchmarks, yet most rely on simulated environments or open-source applications, leaving real-world closed-source applications largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yifan Sui , Xin Huang , Hongbing Li , Fang Xu , Jiahe Lv , Haolong Yan , Yeqing Shen , Litao Liu , Zhimin Fan , Ziyang Meng , Jia Wang , Junbo Qi , Kaijun Tan , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Osamu Yoshie

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Artificial Intelligence · Computer Science 2025-05-07 Chaoyun Zhang , Shilin He , Jiaxu Qian , Bowen Li , Liqun Li , Si Qin , Yu Kang , Minghua Ma , Guyue Liu , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Recent advances in code agents have enabled automated software development at the project level, supported by large language models (LLMs). However, existing benchmarks for code agent evaluation face two major limitations. First, creating…

Software Engineering · Computer Science 2026-03-24 Lingyue Fu , Bolun Zhang , Hao Guan , Yaoming Zhu , Lin Qiu , Weiwen Liu , Xuezhi Cao , Xunliang Cai , Weinan Zhang , Yong Yu

Web AI agents such as ChatGPT Agent and GenSpark are increasingly used for routine web-based tasks, yet they still rely on text-based input prompts, lack proactive detection of user intent, and offer no support for interactive data analysis…

Human-Computer Interaction · Computer Science 2026-01-22 Yanwei Huang , Arpit Narechania

While current Computer Use Agent (CUA) benchmarks measure task completion effectively, they provide limited assessment of enterprise deployment readiness, emphasizing functional correctness over the operational reliability required for…

Software Engineering · Computer Science 2025-11-24 Horia Cristescu , Charles Park , Trong Canh Nguyen , Sergiu Talmacel , Alexandru-Gabriel Ilie , Stefan Adam

Evaluating AI agents within complex, interactive environments that mirror real-world challenges is critical for understanding their practical capabilities. While existing agent benchmarks effectively assess skills like tool use or…

Artificial Intelligence · Computer Science 2025-08-15 Long Phan , Mantas Mazeika , Andy Zou , Dan Hendrycks

Recent advancements in text-to-image (T2I) generation have enabled models to produce high-quality images from textual descriptions. However, these models often struggle with complex instructions involving multiple objects, attributes, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yucheng Zhou , Jiahao Yuan , Qianning Wang

Autonomous agents powered by large language models (LLMs) are increasingly deployed in real-world applications requiring complex, long-horizon workflows. However, existing benchmarks predominantly focus on atomic tasks that are…

Computation and Language · Computer Science 2025-08-13 Weixuan Wang , Dongge Han , Daniel Madrigal Diaz , Jin Xu , Victor Rühle , Saravan Rajmohan

With the emergence of search-enabled generative QA systems, users are increasingly turning to tools that browse, aggregate, and reconcile evidence across multiple sources on their behalf. Yet many widely used QA benchmarks remain answerable…

Computation and Language · Computer Science 2026-03-06 Preetam Prabhu Srikar Dammu , Arnav Palkhiwala , Tanya Roosta , Chirag Shah

Current evaluations of medical consultation agents often prioritize outcome-oriented tasks, frequently overlooking the end-to-end process integrity and clinical safety essential for real-world practice. While recent interactive benchmarks…

Artificial Intelligence · Computer Science 2026-01-21 Chuhan Qiao , Jianghua Huang , Daxing Zhao , Ziding Liu , Yanjun Shen , Bing Cheng , Wei Lin , Kai Wu
‹ Prev 1 8 9 10 Next ›