English
Related papers

Related papers: NiCro: Purely Vision-based, Non-intrusive Cross-De…

200 papers

Context: Accessibility issues (e.g., small size and narrow interval) in mobile applications (apps) lead to obstacles for billions of low vision users in interacting with Graphical User Interfaces (GUIs). Although GUI accessibility scanning…

Software Engineering · Computer Science 2025-02-21 Mengxi Zhang , Huaxiao Liu , Shenning Song , Chunyang Chen , Pei Huang , Jian Zhao

Inter-component communication (ICC) is a widely used mechanism in mobile apps, which enables message-based control flow transferring and data passing between Android components. Effective ICC resolution requires precisely identifying entry…

Software Engineering · Computer Science 2022-09-07 Jiwei Yan , Shixin Zhang , Yepang Liu , Xi Deng , Jun Yan , Jian Zhang

Mobile applications have become a popular software development domain in recent years due in part to a large user base, capable hardware, and accessible platforms. However, mobile developers also face unique challenges, including pressure…

Software Engineering · Computer Science 2018-09-06 Kevin Moran , Cody Watson , John Hoskins , George Purnell , Denys Poshyvanyk

Background. Evidence suggests that mobile applications are not thoroughly tested as their desktop counterparts. In particular GUI testing is generally limited. Like web-based applications, mobile apps suffer from GUI test fragility, i.e.…

Software Engineering · Computer Science 2017-11-13 Riccardo Coppola , Maurizio Morisio , Marco Torchiano

The large demand of mobile devices creates significant concerns about the quality of mobile applications (apps). Developers need to guarantee the quality of mobile apps before it is released to the market. There have been many approaches…

Software Engineering · Computer Science 2022-10-13 Yu Zhao , Brent Harrison , Tingting Yu

Mobile app GUI (Graphical User Interface) pages now contain rich visual information, with the visual semantics of each page helping users understand the application logic. However, these complex visual and functional logic present new…

Software Engineering · Computer Science 2024-12-05 Zhe Liu , Cheng Li , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Yawen Wang , Jun Hu , Qing Wang

GUI responsiveness is critical for a positive user experience in mobile applications. Even brief delays in visual feedback can frustrate users and lead to negative reviews. However, detecting and quantifying such user-perceived delays…

Software Engineering · Computer Science 2025-08-05 Wei Liu , Linqiang Guo , Yi Wen Heng , Chenglin Li , Tse-Hsun , Chen , Ahmed E. Hassan

Automatic generators of GUI tests often fail to generate semantically relevant test cases, and thus miss important test scenarios. To address this issue, test adaptation techniques can be used to automatically generate semantically…

Software Engineering · Computer Science 2026-01-12 Leonardo Mariani , Mauro Pezzè , Valerio Terragni , Daniele Zuddas

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial…

Software Engineering · Computer Science 2018-04-09 Kevin Moran , Boyang Li , Carlos Bernal-Cárdenas , Dan Jelf , Denys Poshyvanyk

Desktop GUI agents operate under partial observability: visually similar screens can correspond to different underlying workflow states, so locally plausible actions can lead to sharply different outcomes. We frame this as a problem of…

Artificial Intelligence · Computer Science 2026-05-18 Michael Solodko , Justin Wagle

Graphical user interface testing is significantly challenging, and automating it even more so. Test-driven development is impractical: it generally requires an initial implementation of the GUI to generate golden images or to construct…

Software Engineering · Computer Science 2020-06-09 Donald Beaver

The Graphical User Interface (GUI) plays a critical role in the interaction between users and mobile applications (apps), aiming at facilitating the operation process. However, due to the variety of functions and non-standardized design,…

Software Engineering · Computer Science 2025-02-24 Mengxi Zhang , Huaxiao Liu , Chunyang Chen , Guangyong Gao , Han Li , Jian Zhao

When a bug manifests in a user-facing application, it is likely to be exposed through the graphical user interface (GUI). Given the importance of visual information to the process of identifying and understanding such bugs, users are…

Software Engineering · Computer Science 2021-02-08 Nathan Cooper , Carlos Bernal-Cárdenas , Oscar Chaparro , Kevin Moran , Denys Poshyvanyk

Context. Multiple automated techniques have been proposed and developed for mobile application GUI testing aiming to improve effectiveness, efficiency, and practicality. The effectiveness, efficiency, and practicality are 3 fundamental…

Software Engineering · Computer Science 2019-01-01 Yauhen Leanidavich Arnatovich , Lipo Wang

The ubiquity of computing devices has led to an increased need to ensure not only that the applications deployed on them are correct with respect to their specifications, but also that the devices are used in an appropriate manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-30 Luke Chircop , Christian Colombo , Gordon J. Pace

The authentication field is evolving towards mechanisms able to keep users continuously authenticated without the necessity of remembering or possessing authentication credentials. While existing continuous authentication systems have…

Inter-Component Communication (ICC) is a key mechanism in Android. It enables developers to compose rich functionalities and explore reuse within and across apps. Unfortunately, as reported by a large body of literature, ICC is rather…

Software Engineering · Computer Science 2021-01-18 Jordan Samhi , Alexandre Bartel , Tegawendé F. Bissyandé , Jacques Klein

The increasing number of edge devices with enhanced sensing capabilities, such as smartphones, wearables, and IoT devices equipped with sensors, holds the potential for innovative smart-edge applications in healthcare. These devices…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Patrick Langer , Elgar Fleisch , Filipe Barata

Smartphones' cameras, microphones, and device displays enable users to capture and view memorable moments of their lives. However, adversaries can trick users into authorizing malicious apps that exploit weaknesses in current mobile…

Operating Systems · Computer Science 2016-04-11 Giuseppe Petracca , Ahmad Atamli , Yuqiong Sun , Jens Grossklags , Trent Jaeger

GUI agents drive applications through their visual interfaces instead of programmatic APIs, interacting with arbitrary software via taps, swipes, and keystrokes, reaching a long tail of applications that CLI-based agents cannot. Yet…

Machine Learning · Computer Science 2026-04-14 Fei Tang , Zhiqiong Lu , Boxuan Zhang , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen