English
Related papers

Related papers: Efficiency Matters: Speeding Up Automated Testing …

200 papers

GUI grounding, which maps natural-language instructions to actionable UI elements, is a core capability of GUI agents. Prior works largely treats instructions as a static proxy for user intent, overlooking the impact of instruction…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Liangyu Chen , Hanzhang Zhou , Chenglin Cai , Jianan Zhang , Panrong Tong , Quyu Kong , Xu Zhang , Chen Liu , Yuqi Liu , Wenxuan Wang , Yue Wang , Qin Jin , Steven Hoi

This paper proposes a novel online evaluation protocol for Test Time Adaptation (TTA) methods, which penalizes slower methods by providing them with fewer samples for adaptation. TTA methods leverage unlabeled data at test time to adapt to…

Automation systems that can autonomously drive application user interfaces to complete user tasks are of great benefit, especially when users are situationally or permanently impaired. Prior automation systems do not produce generalizable…

Human-Computer Interaction · Computer Science 2024-07-01 Wei Li , Fu-Lin Hsu , Will Bishop , Folawiyo Campbell-Ajala , Max Lin , Oriana Riva

Random testing (RT) is a well-studied testing method that has been widely applied to the testing of many applications, including embedded software systems, SQL database systems, and Android applications. Adaptive random testing (ART) aims…

Software Engineering · Computer Science 2020-07-15 Rubing Huang , Weifeng Sun , Yinyin Xu , Haibo Chen , Dave Towey , Xin Xia

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Automated test execution scheduling is crucial in modern software development environments, where components are frequently updated with changes that impact their integration with hardware systems. Building test schedules, which focus on…

Software Engineering · Computer Science 2024-03-20 Arnaud Gotlieb , Morten Mossige , Helge Spieker

Graphical User Interface (GUI) has become one of the most significant parts of mobile applications (apps). It is a direct bridge between mobile apps and end users, which directly affects the end user's experience. Neglecting GUI quality can…

Software Engineering · Computer Science 2025-10-21 Shengcheng Yu , Chunrong Fang , Ziyuan Tuo , Quanjun Zhang , Chunyang Chen , Zhenyu Chen , Zhendong Su

The importance of mobile application (app) quality insurance is increasing with the rapid development of the mobile Internet. Automated test generation approaches, as a dominant direction of app quality insurance, follow specific models or…

Software Engineering · Computer Science 2024-06-13 Shengcheng Yu , Chunrong Fang , Mingzhe Du , Zimin Ding , Zhenyu Chen , Zhendong Su

The fragmentation problem has extended from Android to different platforms, such as iOS, mobile web, and even mini-programs within some applications (app). In such a situation, recording and replaying test scripts is a popular automated…

Software Engineering · Computer Science 2021-02-23 Shengcheng Yu , Chunrong Fang , Yexiao Yun , Yang Feng

In crowdsourced user experiments that collect performance data from graphical user interface (GUI) interactions, some participants ignore instructions or act carelessly, threatening the validity of performance models. We investigate a…

Human-Computer Interaction · Computer Science 2026-02-25 Takaya Miyama , Satoshi Nakamura , Shota Yamanaka

There is a growing demand for mobile user interface (UI) automation, driven by its broad applications across industries. With the advent of visual language models (VLMs), GUI automation has progressed from generating text-based instructions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Neeraj Anand , Rishabh Jain , Sohan Patnaik , Balaji Krishnamurthy , Mausoom Sarkar

Mobile applications are being used every day by more than half of the world's population to perform a great variety of tasks. With the increasingly widespread usage of these applications, the need arises for efficient techniques to test…

Software Engineering · Computer Science 2017-09-05 Ariel Rosenfeld , Odaya Kardashov , Orel Zang

Dynamic taint analysis (DTA), as a fundamental analysis technique, is widely used in security, privacy, and diagnosis, etc. As DTA demands to collect and analyze massive taint data online, it suffers extremely high runtime overhead. Over…

Cryptography and Security · Computer Science 2024-02-28 Yiyu Zhang , Tianyi Liu , Yueyang Wang , Yun Qi , Kai Ji , Jian Tang , Xiaoliang Wang , Xuandong Li , Zhiqiang Zuo

Ensuring the correct visual appearance of graphical user interfaces (GUIs) is important because visual bugs can cause substantial losses for businesses. An application might behave functionally correct in an automated test, but visual bugs…

Software Engineering · Computer Science 2020-07-22 Daniel Kraus , Jeremias Rößler , Martin Sulzmann

Generating tests that can reveal performance issues in large and complex software systems within a reasonable amount of time is a challenging task. On one hand, there are numerous combinations of input data values to explore. On the other…

Software Engineering · Computer Science 2021-04-07 Ali Sedaghatbaf , Mahshid Helali Moghadam , Mehrdad Saadatmand

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Difei Gao , Lei Ji , Zechen Bai , Mingyu Ouyang , Peiran Li , Dongxing Mao , Qinchen Wu , Weichen Zhang , Peiyi Wang , Xiangwu Guo , Hengxu Wang , Luowei Zhou , Mike Zheng Shou

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial…

Software Engineering · Computer Science 2018-04-09 Kevin Moran , Boyang Li , Carlos Bernal-Cárdenas , Dan Jelf , Denys Poshyvanyk

Adaptive designs(AD) are a broad class of trial designs that allow preplanned modifications based on patient data providing improved efficiency and flexibility. However, a delay in observing the primary outcome variable can harm this added…

Methodology · Statistics 2025-09-26 Aritra Mukherjee , Michael J. Grayling , James M. S. Wason

Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Longhui Yuan , Binhui Xie , Shuang Li

The latest advances in the design of vehicles with the adaptive level of automation pose new challenges in the vehicle-driver interaction. Safety requirements underline the need to explore optimal cockpit architectures with regard to driver…

Human-Computer Interaction · Computer Science 2020-06-19 Ilya Yuskevich , A. Hein , Kahina Amokrane-Ferka , Abdelkrim Doufene , Marija Jankovic