English
Related papers

Related papers: Computer-Use Agents as Judges for Generative User …

200 papers

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

Agents operating in complex software environments benefit from reasoning about the consequences of their actions, as even a single incorrect user interface (UI) operation can derail long, artifact-preserving workflows. This challenge is…

This paper presents our ongoing work toward developing an enterprise-ready Computer Using Generalist Agent (CUGA) system. Our research highlights the evolutionary nature of building agentic systems suitable for enterprise environments. By…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-10 Sami Marreed , Alon Oved , Avi Yaeli , Segev Shlomov , Ido Levy , Offer Akrabi , Aviad Sela , Asaf Adi , Nir Mashkif

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida

Repurposing large vision-language models (LVLMs) as computer use agents (CUAs) has led to substantial breakthroughs, primarily driven by human-labeled data. However, these models often struggle with novel and specialized software,…

Artificial Intelligence · Computer Science 2025-08-13 Zeyi Sun , Ziyu Liu , Yuhang Zang , Yuhang Cao , Xiaoyi Dong , Tong Wu , Dahua Lin , Jiaqi Wang

Computer-use agents hold the promise of assisting in a wide range of digital economic activities. However, current research has largely focused on short-horizon tasks over a limited set of software with limited economic value, such as basic…

Machine Learning · Computer Science 2026-04-08 Pranjal Aggarwal , Graham Neubig , Sean Welleck

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

Generating a game is not the same as making one that can be played. Despite advances in code generation, existing approaches treat game generation as one-shot translation from prompt to artifact, leaving interaction-level failures…

Software Engineering · Computer Science 2026-05-28 Yixu Huang , Bo Li , Na Li , Zhe Wang , Kaijie Chen , Haonan Ge , Qingyi Si , Yuanzhe Shen , Ruihan Yang , Guangjing Wang , Hongcheng Guo

Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex environments, such as web browsers and graphical user interfaces (GUIs). However, existing…

Computer-use agents (CUAs) hold the promise of performing a wide variety of general tasks, but current evaluations have primarily focused on simple scenarios. It therefore remains unclear whether such generalist agents can automate more…

Software Engineering · Computer Science 2025-10-06 Pranjal Aggarwal , Sean Welleck

Graphical User Interfaces (GUIs) are central to human-computer interaction, yet automating complex GUI tasks remains a major challenge for autonomous agents, largely due to a lack of scalable, high-quality training data. While recordings of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yichun Zhang , Xiangwu Guo , Yauhong Goh , Jessica Hu , Zhiheng Chen , Xin Wang , Difei Gao , Mike Zheng Shou

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

Verifying the success of computer use agent (CUA) trajectories is a critical challenge: without reliable verification, neither evaluation nor training signal can be trusted. In this paper, we present lessons learned from building a…

Cryptography and Security · Computer Science 2026-04-09 Corby Rosset , Pratyusha Sharma , Andrew Zhao , Miguel Gonzalez-Fernandez , Ahmed Awadallah

Building autonomous agents that perceive and operate graphical user interfaces (GUIs) like humans has long been a vision in the field of artificial intelligence. Central to these agents is the capability for GUI interaction, which involves…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hongxin Li , Jingran Su , Jingfan Chen , Zheng Ju , Yuntao Chen , Qing Li , Zhaoxiang Zhang

AI can now generate high-fidelity UI mock-up screens from a high-level textual description, promising to support UX practitioners' work. However, it remains unclear how UX practitioners would adopt such Generative UI (GenUI) models in a way…

Human-Computer Interaction · Computer Science 2025-05-21 Xiang 'Anthony' Chen , Tiffany Knearem , Yang Li

With the deep integration of artificial intelligence and interactive technology, Graphical User Interface (GUI) Agent, as the carrier connecting goal-oriented natural language and real-world devices, has received widespread attention from…

Artificial Intelligence · Computer Science 2025-11-13 Leyang Yang , Ziwei Wang , Xiaoxuan Tang , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

We introduce GUI-360$^\circ$, a large-scale, comprehensive dataset and benchmark suite designed to advance computer-using agents (CUAs). CUAs present unique challenges and is constrained by three persistent gaps: a scarcity of real-world…

Computer-use agents(CUAs)are moving frombounded benchmarks toward real software environments, wherethey operate browsers, desktops, mobile applications, flesystems,terminals, and tool backends. In such settings, reliability isno longer…

Computation and Language · Computer Science 2026-05-11 Zejian Chen , Zhanyuan Liu , Chaozhuo Li , Mengxiang Han , Songyang Liu , Litian Zhang , Feng Gao , Yiming Hei , Xi Zhang

Computer-use agent (CUA) frameworks, powered by large language models (LLMs) or multimodal LLMs (MLLMs), are rapidly maturing as assistants that can perceive context, reason, and act directly within software environments. Among their most…

Cryptography and Security · Computer Science 2025-10-13 Weidi Luo , Qiming Zhang , Tianyu Lu , Xiaogeng Liu , Bin Hu , Hung-Chun Chiu , Siyuan Ma , Yizhe Zhang , Xusheng Xiao , Yinzhi Cao , Zhen Xiang , Chaowei Xiao