Human-Computer Interaction · Computer Science
A Survey on (M)LLM-Based GUI Agents
Fei Tang, Haolei Xu, Hang Zhang, Siqi Chen +11
2025-06-05
Artificial Intelligence · Computer Science
Agent S: An Open Agentic Framework that Uses Computers Like a Human
Saaket Agashe, Jiuzhou Han, Shuyu Gan, Jiachen Yang +2
2024-10-11
Cryptography and Security · Computer Science
Mobile GUI Agents under Real-world Threats: Are We There Yet?
Guohong Liu, Jialei Ye, Jiacheng Liu, Yuanchun Li +4
2026-04-15
Artificial Intelligence · Computer Science
Large Language Model-Brained GUI Agents: A Survey
Chaoyun Zhang, Shilin He, Jiaxu Qian, Bowen Li +9
2025-05-07
Artificial Intelligence · Computer Science
API Agents vs. GUI Agents: Divergence and Convergence
Chaoyun Zhang, Shilin He, Liqun Li, Si Qin +4
2025-06-24
Artificial Intelligence · Computer Science
PG-Agent: An Agent Powered by Page Graph
Weizhi Chen, Ziwei Wang, Leyang Yang, Sheng Zhou +4
2025-09-05
Human-Computer Interaction · Computer Science
AppAgent v2: Advanced Agent for Flexible Mobile Interactions
Yanda Li, Chi Zhang, Wenjia Jiang, Wanqi Yang +5
2025-09-18
Artificial Intelligence · Computer Science
WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting Point
Henry Hengyuan Zhao, Kaiming Yang, Wendi Yu, Difei Gao +1
2026-05-26
Computer Vision and Pattern Recognition · Computer Science
UIPro: Unleashing Superior Interaction Capability For GUI Agents
Hongxin Li, Jingran Su, Jingfan Chen, Zheng Ju +3
2025-09-23
Artificial Intelligence · Computer Science
GUI Agents with Foundation Models: A Comprehensive Survey
Shuai Wang, Weiwen Liu, Jingxuan Chen, Yuqi Zhou +11
2025-02-14
Machine Learning · Computer Science
Towards Trustworthy GUI Agents: A Survey
Yucheng Shi, Wenhao Yu, Jingyuan Huang, Wenlin Yao +2
2026-02-25
Human-Computer Interaction · Computer Science
Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agents
Chaoran Chen, Zhiping Zhang, Ibrahim Khalilov, Bingcan Guo +6
2025-06-06
Artificial Intelligence · Computer Science
Instruction Agent: Enhancing Agent with Expert Demonstration
Yinheng Li, Hailey Hultquist, Justin Wagle, Kazuhito Koishida
2025-09-10
Artificial Intelligence · Computer Science
AppAgentX: Evolving GUI Agents as Proficient Smartphone Users
Wenjia Jiang, Yangyang Zhuang, Chenxi Song, Xu Yang +2
2025-04-16
Computation and Language · Computer Science
ScreenLLM: Stateful Screen Schema for Efficient Action Understanding and Prediction
Yiqiao Jin, Stefano Petrangeli, Yu Shen, Gang Wu
2025-03-28
Computer Vision and Pattern Recognition · Computer Science
GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration
Yuchen Sun, Shanhui Zhao, Tao Yu, Hao Wen +4
2025-03-25
Computer Vision and Pattern Recognition · Computer Science
SpiritSight Agent: Advanced GUI Agent with One Look
Zhiyuan Huang, Ziming Cheng, Junting Pan, Zhaohui Hou +1
2025-04-17