English
Related papers

Related papers: Effective, Platform-Independent GUI Testing via Im…

200 papers

Integration testing is one the important phase in software testing life cycle (STLC). With the fast growth of internet and web services, web-based applications are also growing rapidly and their importance and complexity is also increasing.…

Software Engineering · Computer Science 2012-07-16 Imran Akhtar Khan , Roopa Singh

Context: Visual GUI testing (VGT) is referred to as the latest generation GUI-based testing. It is a tool-driven technique, which uses image recognition for interacting with and asserting the behavior of the system under test. Motivated by…

Reinforcement learning frameworks have introduced abstractions to implement and execute algorithms at scale. They assume standardized simulator interfaces but are not concerned with identifying suitable task representations. We present…

Machine Learning · Computer Science 2019-09-17 Michael Schaarschmidt , Kai Fricke , Eiko Yoneki

In recent times a number of platforms are using badge-based achievements or leaderboards to increase user involvement and participation. Due to recent advancements, there is a question of up to what extent virtual achievement systems have…

Human-Computer Interaction · Computer Science 2024-09-11 Venkata Sai Bhargav Bathini , Lokesh Meesala , Ahamad Shaik , Hrushyang Adloori

In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as…

The widespread adoption of the "Games as a Service" model necessitates frequent content updates, placing immense pressure on quality assurance. In response, automated game testing has been viewed as a promising solution to cope with this…

Artificial Intelligence · Computer Science 2025-12-16 Enhong Mu , Minami Yoda , Yan Zhang , Mingyue Zhang , Yutaka Matsuno , Jialong Li

Mobile apps are indispensable for people's daily life. Complementing with automated GUI testing, manual testing is the last line of defence for app quality. However, the repeated actions and easily missing of functionalities make manual…

Software Engineering · Computer Science 2022-01-31 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or…

Human-Computer Interaction · Computer Science 2023-05-25 Mulong Xie , Zhenchang Xing , Sidong Feng , Chunyang Chen , Liming Zhu , Xiwei Xu

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Difei Gao , Lei Ji , Zechen Bai , Mingyu Ouyang , Peiran Li , Dongxing Mao , Qinchen Wu , Weichen Zhang , Peiyi Wang , Xiangwu Guo , Hengxu Wang , Luowei Zhou , Mike Zheng Shou

Unmanned aerial vehicles (UAVs) have numerous applications, but their efficient and optimal flight can be a challenge. Reinforcement Learning (RL) has emerged as a promising approach to address this challenge, yet there is no standardized…

Robotics · Computer Science 2023-04-05 Jun Jet Tai , Jim Wong , Mauro Innocente , Nadjim Horri , James Brusey , Swee King Phang

UI testing is tedious and time-consuming due to the manual effort required. Recent research has explored opportunities for reusing existing UI tests from an app to automatically generate new tests for other apps. However, the evaluation of…

Software Engineering · Computer Science 2020-11-04 Yixue Zhao , Justin Chen , Adriana Sejfia , Marcelo Schmitt Laser , Jie Zhang , Federica Sarro , Mark Harman , Nenad Medvidovic

API testing has increasing demands for software companies. Prior API testing tools were aware of certain types of dependencies that needed to be concise between operations and parameters. However, their approaches, which are mostly done…

Software Engineering · Computer Science 2024-07-16 Tri Le , Thien Tran , Duy Cao , Vy Le , Tien Nguyen , Vu Nguyen

Photorealistic color retouching plays a vital role in visual content creation, yet manual retouching remains inaccessible to non-experts due to its reliance on specialized expertise. Reference-based methods offer a promising alternative by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Melany Yang , Yuhang Yu , Diwang Weng , Jinwei Chen , Wei Dong

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

Virtual Reality (VR) is an emerging technique that provides a unique real-time experience for users. VR technologies have provided revolutionary user experiences in various scenarios (e.g., training, education, product/architecture design,…

Software Engineering · Computer Science 2022-11-04 Dhia Elhaq Rzig , Nafees Iqbal , Isabella Attisano , Xue Qin , Foyzul Hassan

Software malleability allows applications to be easily changed, configured, and adapted even after deployment. While prior work has explored configurable systems, adaptive recommender systems, and malleable GUIs, these approaches are often…

Software Engineering · Computer Science 2026-04-09 Yuying Wang , Kaifeng Huang , Hao Deng , Zhiyuan Sun , Jinxuan Zhou , Shengjie Zhao

Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions and interacting with the screen. While recent methods apply reinforcement learning (RL) to train…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Li Gu , Zihuan Jiang , Zhixiang Chi , Huan Liu , Ziqiang Wang , Yuanhao Yu , Glen Berseth , Yang Wang

Property-based testing (PBT) is a popular software testing methodology and is effective in validating the functionality of mobile applications (apps for short). However, its adoption in practice remains limited, largely due to the manual…

Software Engineering · Computer Science 2026-03-24 Yiheng Xiong , Ting Su , Jingling Sun , Jue Wang , Qin Li , Geguang Pu , Zhendong Su

GUI agent aims to enable automated operations on Mobile/PC devices, which is an important task toward achieving artificial general intelligence. The rapid advancement of VLMs accelerates the development of GUI agents, owing to their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhixiong Zeng , Jing Huang , Liming Zheng , Wenkang Han , Yufeng Zhong , Lei Chen , Longrong Yang , Yingjie Chu , Yuzhi He , Lin Ma

The rapid advancement of vision-language models has catalyzed the emergence of GUI agents, which hold immense potential for automating complex tasks, from online shopping to flight booking, thereby alleviating the burden of repetitive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zhongyin Zhao , Yuan Liu , Yikun Liu , Haicheng Wang , Le Tian , Xiao Zhou , Yangxiu You , Zilin Yu , Yang Yu , Jie Zhou