English
Related papers

Related papers: Test2VA: Reusing GUI Test Cases for Voice Assistan…

200 papers

GUI testing is an essential quality assurance process in mobile app development. However, the creation and maintenance of GUI tests for mobile apps are resource-intensive and costly. Recognizing that many apps share similar functionalities,…

Software Engineering · Computer Science 2025-04-04 Xiaolei Li , Jialun Cao , Yepang Liu , Shing-Chi Cheung , Hailong Wang

Screen recordings are becoming increasingly important as rich software artifacts that inform mobile application development processes. However, the amount of manual effort required to extract information from these graphical artifacts can…

Software Engineering · Computer Science 2021-03-09 Madeleine Havranek , Carlos Bernal-Cárdenas , Nathan Cooper , Oscar Chaparro , Denys Poshyvnayk , Kevin Moran

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

Automated GUI testing is crucial for ensuring the quality and reliability of Android apps. However, the efficacy of existing UI testing techniques is often limited, especially in terms of coverage. Recent studies, including the…

Software Engineering · Computer Science 2026-01-30 Wei Minn , Biniam Fisseha Demissie , Yan Naing Tun , Jiakun Liu , Mariano Ceccato , Lwin Khin Shar , David Lo

App quality has been shown to be the most important indicator of app adoption. To assure quality, developers mainly use testing to find bugs in app and apply structural and GUI test coverage criteria. However, mobile apps have more…

Software Engineering · Computer Science 2019-11-22 Danilo Dominguez Perez , Wei Le

The emergent large language/multimodal models facilitate the evolution of mobile agents, especially in mobile UI task automation. However, existing evaluation approaches, which rely on human validation or established datasets to compare…

Human-Computer Interaction · Computer Science 2024-08-05 Li Zhang , Shihe Wang , Xianqing Jia , Zhihan Zheng , Yunhe Yan , Longxi Gao , Yuanchun Li , Mengwei Xu

Writing and maintaining UI tests for mobile apps is a time-consuming and tedious task. While decades of research have produced automated approaches for UI test generation, these approaches typically focus on testing for crashes or…

Software Engineering · Computer Science 2022-11-03 Yixue Zhao , Saghar Talebipour , Kesina Baral , Hyojae Park , Leon Yee , Safwat Ali Khan , Yuriy Brun , Nenad Medvidovic , Kevin Moran

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial…

Software Engineering · Computer Science 2018-04-09 Kevin Moran , Boyang Li , Carlos Bernal-Cárdenas , Dan Jelf , Denys Poshyvanyk

GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high…

Software Engineering · Computer Science 2023-11-16 Juyeon Yoon , Robert Feldt , Shin Yoo

With the development of foundation AI technologies, task-executable voice assistants (VAs) have become more popular, enhancing user convenience and expanding device functionality. Android task-executable VAs are applications that are…

Cryptography and Security · Computer Science 2025-09-30 Shidong Pan , Yikai Ge , Xiaoyu Sun

Today, intelligent voice assistant (VA) software like Amazon's Alexa, Google's Voice Assistant (GVA) and Apple's Siri have millions of users. These VAs often collect and analyze huge user data for improving their functionality. However,…

Cryptography and Security · Computer Science 2021-10-08 Vandit Sharma , Mainack Mondal

Automated Graphical User Interface (GUI) testing plays a crucial role in ensuring app quality, especially as mobile applications have become an integral part of our daily lives. Despite the growing popularity of learning-based techniques in…

Software Engineering · Computer Science 2023-10-25 Zhe Liu , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Xing Che , Dandan Wang , Qing Wang

Self-supervised learning approaches have lately achieved great success on a broad spectrum of machine learning problems. In the field of speech processing, one of the most successful recent self-supervised models is wav2vec 2.0. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-10 Marie Kunešová , Zbyněk Zajíc

Apps' pervasive role in our society led to the definition of test automation approaches to ensure their dependability. However, state-of-the-art approaches tend to generate large numbers of test inputs and are unlikely to achieve more than…

Software Engineering · Computer Science 2021-12-07 Chanh Duc Ngo , Fabrizio Pastore , Lionel Briand

Software developers study and reuse existing source code to understand how to properly use application programming interfaces (APIs). However, manually finding sufficient and adequate code examples for a given API is a difficult and a…

Software Engineering · Computer Science 2022-08-02 Mohammad Ghafari , Konstantin Rubinov , Mohammad Mehdi Pourhashem K

Voice authentication is drawing increasing attention and becomes an attractive alternative to passwords for mobile authentication. Recent advances in mobile technology further accelerate the adoption of voice biometrics in an array of…

Cryptography and Security · Computer Science 2021-06-04 Linghan Zhang , Jie Yang

In the past few years, mobile devices have been increasingly replacing traditional computers as their capabilities such as CPU computation, memory, RAM size, and many more, are being enhanced almost to the level of conventional computers.…

Software Engineering · Computer Science 2019-02-04 Ibrahim-Anka Salihu , Rosziati Ibrahim , Bestoun S. Ahmed , Kamal Z. Zamli , Asmau Usman

The focus of this paper is on automating the security testing of RESTful APIs. The testing stage of this specific kind of components is often performed manually, and this is yet considered as a long and difficult activity. This paper…

Cryptography and Security · Computer Science 2024-03-07 Sebastien Salva , Jarod Sue

While Alexa can perform over 100,000 skills on paper, its capability covers only a fraction of what is possible on the web. To reach the full potential of an assistant, it is desirable that individuals can create skills to automate their…

Human-Computer Interaction · Computer Science 2020-09-01 Michael H. Fischer , Giovanni Campagna , Euirim Choi , Monica S. Lam

Mobile applications are being used every day by more than half of the world's population to perform a great variety of tasks. With the increasingly widespread usage of these applications, the need arises for efficient techniques to test…

Software Engineering · Computer Science 2017-09-05 Ariel Rosenfeld , Odaya Kardashov , Orel Zang