English
Related papers

Related papers: Improving Random Testing via LLM-powered UI Tarpit…

200 papers

Software development teams generally welcome any effort to expose bugs in their code base. In this work, we build on the hypothesis that mobile apps from the same category (e.g., two web browser apps) may be affected by similar bugs in…

Software Engineering · Computer Science 2023-01-24 Xunzhu Tang , Haoye Tian , Pingfan Kong , Kui Liu , Jacques Klein , Tegawendé F. Bissyande

With the rapid development of web technology, more and more software applications have become web-based in the past decades. To ensure software quality and user experience, various techniques have been proposed to automatically test web…

Software Engineering · Computer Science 2024-10-17 Siyi Wang , Sinan Wang , Yujia Fan , Xiaolei Li , Yepang Liu

Exploratory GUI testing is a particularly demanding setting for MLLM agents: without predefined test scripts, an agent must autonomously navigate an application and discover defects through its own interaction. However, current evaluation…

Software Engineering · Computer Science 2026-05-29 Xiaoyi Chen , Yifei Gao , Yang Xu , Xingxing Song , Yi Zhang , Jitao Sang

The widespread adoption of Android devices for sensitive operations like banking and communication has made them prime targets for cyber threats, particularly Advanced Persistent Threats (APT) and sophisticated malware attacks. Traditional…

Cryptography and Security · Computer Science 2025-03-21 Dincy R Arikkat , Vinod P. , Rafidha Rehiman K. A. , Serena Nicolazzo , Marco Arazzi , Antonino Nocera , Mauro Conti

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Exploratory GUI testing is essential for software quality but suffers from high manual costs. While Multi-modal Large Language Model (MLLM) agents excel in navigation, they fail to autonomously discover defects due to two core challenges:…

Artificial Intelligence · Computer Science 2026-01-09 Yifei Gao , Jiang Wu , Xiaoyi Chen , Yifan Yang , Zhe Cui , Tianyi Ma , Jiaming Zhang , Jitao Sang

TikTok, a widely-used social media app boasting over a billion monthly active users, requires effective app quality assurance for its intricate features. Feature testing is crucial in achieving this goal. However, the multi-user interactive…

Software Engineering · Computer Science 2025-04-23 Sidong Feng , Changhao Du , Huaxiao Liu , Qingnan Wang , Zhengwei Lv , Gang Huo , Xu Yang , Chunyang Chen

Large Language Models (LLMs) are increasingly integrated into critical systems in industries like healthcare and finance. Users can often submit queries to LLM-enabled chatbots, some of which can enrich responses with information retrieved…

Cryptography and Security · Computer Science 2025-05-21 Sayon Palit , Daniel Woods

This paper analyzes Large Language Model (LLM) security vulnerabilities based on data from Crucible, encompassing 214,271 attack attempts by 1,674 users across 30 LLM challenges. Our findings reveal automated approaches significantly…

Cryptography and Security · Computer Science 2025-04-30 Rob Mulla , Ads Dawson , Vincent Abruzzon , Brian Greunke , Nick Landers , Brad Palm , Will Pearce

Android User Interface (UI) testing is a critical research area due to the ubiquity of apps and the challenges faced by developers. Record and replay (R&R) tools facilitate manual and automated UI testing by recording UI actions to execute…

Software Engineering · Computer Science 2025-04-30 Zihe Song , S M Hasan Mansur , Ravishka Rathnasuriya , Yumna Fatima , Wei Yang , Kevin Moran , Wing Lam

This paper introduces DroidBot-GPT, a tool that utilizes GPT-like large language models (LLMs) to automate the interactions with Android mobile applications. Given a natural language description of a desired task, DroidBot-GPT can…

Software Engineering · Computer Science 2024-01-09 Hao Wen , Hongming Wang , Jiaxuan Liu , Yuanchun Li

Large language models (LLMs) are increasingly integrated into software development workflows, yet they often introduce subtle logic or data-misuse errors that differ from human bugs. To study how these two error types interact, we construct…

Software Engineering · Computer Science 2026-01-28 Cole Granger , Dipin Khati , Daniel Rodriguez-Cardenas , Denys Poshyvanyk

The integration of Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) into mobile GUI agents has significantly enhanced user efficiency and experience. However, this advancement also introduces potential security…

Cryptography and Security · Computer Science 2025-03-18 Yulong Yang , Xinshan Yang , Shuaidong Li , Chenhao Lin , Zhengyu Zhao , Chao Shen , Tianwei Zhang

Mobile applications have become a ubiquitous part of our daily life, providing users with access to various services and utilities. Text input, as an important interaction channel between users and applications, plays an important role in…

Software Engineering · Computer Science 2023-10-25 Zhe Liu , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Xing Che , Dandan Wang , Qing Wang

While Large Language Models (LLMs) are rapidly integrating into daily life, research on their risks often remains lab-based and disconnected from the problems users encounter "in the wild." While recent HCI research has begun to explore…

Computers and Society · Computer Science 2025-09-12 Lingyao Li , Renkai Ma , Zhaoqian Xue , Junjie Xiong

Artificial Intelligence (AI) advancements have enabled the development of Large Language Models (LLMs) that can perform a variety of tasks with remarkable semantic understanding and accuracy. ChatGPT is one such LLM that has gained…

Software Engineering · Computer Science 2024-08-02 M. Mehdi Kholoosi , M. Ali Babar , Roland Croft

The assurance of mobile app GUI has become increasingly important, as the GUI serves as the primary medium of interaction between users and apps. Although numerous automated GUI testing approaches have been developed with diverse…

Software Engineering · Computer Science 2026-05-05 Shengcheng Yu , Yuchen Ling , Chunrong Fang , Quan Zhou , Yi Zhao , Chunyang Chen , Shaomin Zhu , Zhenyu Chen

Mobile apps provide new opportunities to people with disabilities to act independently in the world. Motivated by this trend, researchers have conducted empirical studies by using the inaccessibility issue rate of each page (i.e., screen…

Software Engineering · Computer Science 2022-03-15 Sen Chen , Chunyang Chen , Lingling Fan , Mingming Fan , Xian Zhan , Yang Liu

Software updates, including bug repair and feature additions, are frequent in modern applications but they often leave test suites outdated, resulting in undetected bugs and increased chances of system failures. A recent study by Meta…

Software Engineering · Computer Science 2025-03-20 Shanto Rahman , Sachit Kuhar , Berk Cirisci , Pranav Garg , Shiqi Wang , Xiaofei Ma , Anoop Deoras , Baishakhi Ray

The development and analysis of mobile applications in term of security have become an active research area from many years as many apps are vulnerable to different attacks. Especially the concept of hybrid applications has emerged in the…

Cryptography and Security · Computer Science 2020-07-31 Usama Khalid , Muhammad Abdullah , Kashif Inayat