English
Related papers

Related papers: D-GARA: A Dynamic Benchmarking Framework for GUI A…

200 papers

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Domain adaptation remains a challenge when there is significant manifold discrepancy between source and target domains. Although recent methods leverage manifold-aware adversarial perturbations to perform data augmentation, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hana Satou , F Monkey

GUI grounding is a critical component in building capable GUI agents. However, existing grounding benchmarks suffer from significant limitations: they either provide insufficient data volume and narrow domain coverage, or focus excessively…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Beitong Zhou , Zhexiao Huang , Yuan Guo , Zhangxuan Gu , Tianyu Xia , Zichen Luo , Fei Tang , Dehan Kong , Yanyi Shang , Suling Ou , Zhenlin Guo , Changhua Meng , Shuheng Shen

Mobile GUI Agents, AI agents capable of interacting with mobile applications on behalf of users, have the potential to transform human computer interaction. However, current evaluation practices for GUI agents face two fundamental…

Artificial Intelligence · Computer Science 2026-05-14 Youngmin Im , Byeongung Jo , Jaeyoung Wi , Seungwoo Baek , Tae Hoon Min , Joo Hyung Lee , Sangeun Oh , Insik Shin , Sunjae Lee

Graphical user interface (GUI) agents can substantially improve productivity by automating frequently executed long-latency tasks on mobile devices. However, existing evaluation benchmarks are still constrained to limited applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yue Cao , Yingyao Wang , Pi Bu , Jingxuan Xing , Wei Jiang , Zekun Zhu , Junpeng Ma , Sashuai Zhou , Tong Lu , Jun Song , Yu Cheng , Yuning Jiang , Bo Zheng

Recent advances in Multimodal Large Language Models (MLLMs) have enabled the development of mobile agents that can understand visual inputs and follow user instructions, unlocking new possibilities for automating complex tasks on mobile…

Robotics · Computer Science 2025-07-24 Ning Li , Xiangmou Qu , Jiamu Zhou , Jun Wang , Muning Wen , Kounianhua Du , Xingyu Lou , Qiuying Peng , Jun Wang , Weinan Zhang

Computer use agents automate digital tasks by directly interacting with graphical user interfaces (GUIs) on computers and mobile devices, offering significant potential to enhance human productivity by completing an open-ended space of user…

Artificial Intelligence · Computer Science 2025-04-02 Saaket Agashe , Kyle Wong , Vincent Tu , Jiachen Yang , Ang Li , Xin Eric Wang

Current mobile GUI agent benchmarks systematically fail to assess memory capabilities, with only 5.2-11.8% memory-related tasks and no cross-session learning evaluation. We introduce MemGUI-Bench, a comprehensive memory-centric benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Guangyi Liu , Pengxiang Zhao , Yaozhen Liang , Qinyi Luo , Shunye Tang , Yuxiang Chai , Weifeng Lin , Han Xiao , WenHao Wang , Siheng Chen , Zhengxi Lu , Gao Wu , Hao Wang , Liang Liu , Yong Liu

In this paper, we introduce the Generalist Virtual Agent (GVA), an autonomous entity engineered to function across diverse digital platforms and environments, assisting users by executing a variety of tasks. This survey delves into the…

Multiagent Systems · Computer Science 2024-11-19 Minghe Gao , Wendong Bu , Bingchen Miao , Yang Wu , Yunfei Li , Juncheng Li , Siliang Tang , Qi Wu , Yueting Zhuang , Meng Wang

Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent…

Mobile GUI agents exhibit substantial potential to facilitate and automate the execution of user tasks on mobile phones. However, exist mobile GUI agents predominantly privilege autonomous operation and neglect the necessity of active user…

Artificial Intelligence · Computer Science 2025-10-10 Haitao Jia , Ming He , Zimo Yin , Likang Wu , Jianping Fan , Jitao Sang

Large-scale, high-quality interaction trajectories are essential for advancing mobile Graphical User Interface (GUI) agents. While existing methods typically rely on labor-intensive human demonstrations or automated model exploration to…

Artificial Intelligence · Computer Science 2026-02-02 Linjia Kang , Zhimin Wang , Yongkang Zhang , Duo Wu , Jinghe Wang , Ming Ma , Haopeng Yan , Zhi Wang

Current benchmarks for graphical user interface (GUI) agents predominantly rely on static screenshots. However, real-world smartphone interaction routinely requires agents to process transient audio cues and temporal video dynamics that are…

Human-Computer Interaction · Computer Science 2026-05-20 Felix Henry , Xiaochen Lin , Jiangyou Zhu , Yangfan , Bingqian Zhang , Min Chen , Shiyu Huang

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

Graphical User Interface (GUI) agents have gained substantial attention due to their impressive capabilities to complete tasks through multiple interactions within GUI environments. However, existing agents primarily focus on enhancing the…

Computation and Language · Computer Science 2025-05-28 Qinzhuo Wu , Pengzhi Gao , Wei Liu , Jian Luan

GUI is a bridge connecting user and application. Existing GUI testing tasks can be categorized into two groups: functionality testing and compatibility testing. While the functionality testing focuses on detecting application runtime bugs,…

Software Engineering · Computer Science 2022-12-29 Jiaming Ye , Mulong Xie , Siyuan Chen , Fuyuan Zhang , Lei Ma , Zhenchang Xing , Jianjun Zhao

As artificial intelligence (AI) technology advances, ensuring the robustness and safety of AI-driven systems has become paramount. However, varying perceptions of robustness among AI developers create misaligned evaluation metrics,…

We introduce Meta Agents Research Environments (ARE), a research platform for scalable creation of environments, integration of synthetic or real applications, and execution of agentic orchestrations. ARE provides simple abstractions to…

Large language model-based web agents have demonstrated strong performance on realistic web interaction tasks. However, existing evaluations are predominantly conducted under relatively stable and well-behaved interaction conditions, which…

Software Engineering · Computer Science 2026-04-21 Haoyue Bai , Dong Wang , Long Chen , Bingguang Hao , Pengyang Shao , Yonghui Yang , Yicheng He , Chenyi Zhuang

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida