English
Related papers

Related papers: TaskAudit: Detecting Functiona11ity Errors in Mobi…

200 papers

Verifying the correct behavior of robots in contact tasks is challenging due to model uncertainties associated with contacts. Standard methods for testing often fall short since all (uncountable many) solutions cannot be obtained. Instead,…

Robotics · Computer Science 2023-11-28 Chencheng Tang , Matthias Althoff

Android, the #1 mobile app framework, enforces the single-GUI-thread model, in which a single UI thread manages GUI rendering and event dispatching. Due to this model, it is vital to avoid blocking the UI thread for responsiveness. One…

Software Engineering · Computer Science 2018-08-10 Lingling Fan , Ting Su , Sen Chen , Guozhu Meng , Yang Liu , Lihua Xu , Geguang Pu

Graphical user interface (GUI) agents can substantially improve productivity by automating frequently executed long-latency tasks on mobile devices. However, existing evaluation benchmarks are still constrained to limited applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yue Cao , Yingyao Wang , Pi Bu , Jingxuan Xing , Wei Jiang , Zekun Zhu , Junpeng Ma , Sashuai Zhou , Tong Lu , Jun Song , Yu Cheng , Yuning Jiang , Bo Zheng

Android Apps are frequently updated, every couple of weeks, to keep up with changing user, hardware and business demands. Correctness of App updates is checked through extensive testing. Recent research has proposed tools for automated GUI…

Software Engineering · Computer Science 2020-11-25 Chao Peng , Ajitha Rajan

Despite their growing popularity, many public kiosks with touchscreens are inaccessible to blind people. Toucha11y is a working prototype that allows blind users to use existing inaccessible touchscreen kiosks independently and with little…

Robotics · Computer Science 2023-05-09 Jiasheng Li , Zeyu Yan , Arush Shah , Jonathan Lazar , Huaishu Peng

Enabling fully automated testing of mobile applications has recently become an important topic of study for both researchers and practitioners. A plethora of tools and approaches have been proposed to aid mobile developers both by…

Software Engineering · Computer Science 2018-01-22 Mario Linares Vasquez , Carlos Bernal-Cardenas , Kevin Moran , Denys Poshyvanyk

While current Computer Use Agent (CUA) benchmarks measure task completion effectively, they provide limited assessment of enterprise deployment readiness, emphasizing functional correctness over the operational reliability required for…

Software Engineering · Computer Science 2025-11-24 Horia Cristescu , Charles Park , Trong Canh Nguyen , Sergiu Talmacel , Alexandru-Gabriel Ilie , Stefan Adam

Large language model (LLM)-based mobile agents are increasingly popular due to their capability to interact directly with mobile phone Graphic User Interfaces (GUIs) and their potential to autonomously manage daily tasks. Despite their…

Artificial Intelligence · Computer Science 2024-06-13 Luyuan Wang , Yongyu Deng , Yiwei Zha , Guodong Mao , Qinmin Wang , Tianchen Min , Wei Chen , Shoufa Chen

There is plethora of tools available for automatic evaluation of web accessibility with respect to WCAG. This paper compares a set of WCAG tools and their results in terms of ease of comprehension and implementation by web developers. The…

Human-Computer Interaction · Computer Science 2020-09-15 Shashank Kumar , JeevithaShree DV , Pradipta Biswas

Providing an equitable and inclusive user experience (UX) for people with disabilities (PWD) is a central goal of accessible design. In the specific case of Deaf users, whose hearing impairments impact language development and…

Human-Computer Interaction · Computer Science 2025-08-12 Andrés Eduardo Fuentes-Cortázar , Alejandra Rivera-Hernández , José Rafael Rojano-Cáceres

The field of touch-based authentication has been rapidly developing over the last decade, creating a fragmented and difficult-to-navigate area for researchers and application developers alike due to the variety of methods investigated. In…

Cryptography and Security · Computer Science 2022-07-26 Martin Georgiev , Simon Eberz , Ivan Martinovic

GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high…

Software Engineering · Computer Science 2023-11-16 Juyeon Yoon , Robert Feldt , Shin Yoo

Android is the most popular mobile operating system in the world, running on more than 70% of mobile devices. This implies a gigantic and very competitive market for Android apps. Being successful in such a market is far from trivial and…

Access-control misconfigurations are among the main causes of today's data breaches in web applications. However, few techniques are available to support automatic and systematic testing for access-control changes and detecting risky…

Cryptography and Security · Computer Science 2025-05-20 Chengcheng Xiang , Li Zhong , Eric Mugnier , Nathaniel Nguyen , Yuanyuan Zhou , Tianyin Xu

With mobile apps rapidly permeating all aspects of daily living with use by all segments of the population, it is crucial to support the evaluation of app usability for specific impaired users to improve app accessibility. In this work, we…

Human-Computer Interaction · Computer Science 2025-03-18 Kenny Tsu Wei Choo , Rajesh Krishna Balan , Youngki Lee

Software testing is an important phase in the software development life-cycle because it helps in identifying bugs in a software system before it is shipped into the hand of its end users. There are numerous studies on how developers test…

Software Engineering · Computer Science 2019-02-15 Luis Cruz , Rui Abreu , David Lo

Graphical User Interfaces (GUIs) are the primary means by which users interact with mobile applications, making them crucial to both app functionality and user experience. However, a major challenge in automated testing is the frequent…

Software Engineering · Computer Science 2024-12-05 Linqiang Guo , Wei Liu , Yi Wen Heng , Tse-Hsun , Chen , Yang Wang

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies largely focus on…

Software Engineering · Computer Science 2025-11-04 Zhuowen Yin , Cuifeng Gao , Chunsong Fan , Wenzhang Yang , Yinxing Xue , Lijun Zhang

Android applications (apps) grow dramatically in recent years. Apps are user interface (UI) centric typically. Rapid UI responsiveness is key consideration to app developers. However, we still lack a handy tool for profiling app performance…

Software Engineering · Computer Science 2015-12-29 Yu Kang , Yangfan Zhou , Hui Xu , Michael R. Lyu

In crowdsourced user experiments that collect performance data from graphical user interface (GUI) interactions, some participants ignore instructions or act carelessly, threatening the validity of performance models. We investigate a…

Human-Computer Interaction · Computer Science 2026-02-25 Takaya Miyama , Satoshi Nakamura , Shota Yamanaka