English
Related papers

Related papers: Test Script Intention Generation for Mobile Applic…

200 papers

Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or…

Human-Computer Interaction · Computer Science 2023-05-25 Mulong Xie , Zhenchang Xing , Sidong Feng , Chunyang Chen , Liming Zhu , Xiwei Xu

Graphical User Interface (GUI) agents have the potential to assist users in interacting with complex software (e.g., PowerPoint, Photoshop). While prior research has primarily focused on automating user actions through clicks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Saelyne Yang , Jaesang Yu , Yi-Hao Peng , Kevin Qinghong Lin , Jae Won Cho , Yale Song , Juho Kim

With the advent of AI-based coding engines, it is possible to convert natural language requirements to executable code in standard programming languages. However, AI-generated code can be unreliable, and the natural language requirements…

Software Engineering · Computer Science 2024-11-06 Martin Mirchev , Andreea Costea , Abhishek Kr Singh , Abhik Roychoudhury

Google users have different intents from their queries such as acquiring information, buying products, comparing or simulating services, looking for products, and so on. Understanding the right intention of users helps to provide i) better…

Information Retrieval · Computer Science 2020-06-17 Samin Mohammadi , Mathieu Chapon , Arthur Fremond

Documenting the functionality of software units with code comments, e.g., Javadoc comments, is a common programmer best-practice in software engineering. This paper introduces a novel test generation technique that exploits the code-comment…

Software Engineering · Computer Science 2025-05-01 Giovanni Denaro , Luca Guglielmo

Context: Visual GUI testing (VGT) is referred to as the latest generation GUI-based testing. It is a tool-driven technique, which uses image recognition for interacting with and asserting the behavior of the system under test. Motivated by…

Software testing is a crucial phase in software development, enabling the detection of issues and defects that may arise during the development process. Addressing these issues enhances software applications' quality, reliability, user…

Software Engineering · Computer Science 2024-03-18 Giacomo Garaccione , Tommaso Fulcini , Paolo Stefanut Bodnarescul , Riccardo Coppola , Luca Ardito

Automated GUI testing is widely used to help ensure the quality of mobile apps. However, many GUIs require appropriate text inputs to proceed to the next page which remains a prominent obstacle for testing coverage. Considering the…

Software Engineering · Computer Science 2022-12-12 Zhe Liu , Chunyang Chen , Junjie Wang , Xing Che , Yuekai Huang , Jun Hu , Qing Wang

Intent detection aims to identify user intents from natural language inputs, where supervised methods rely heavily on labeled in-domain (IND) data and struggle with out-of-domain (OOD) intents, limiting their practical applicability.…

Computation and Language · Computer Science 2025-06-11 Xiao Wei , Xiaobao Wang , Ning Zhuang , Chenyang Wang , Longbiao Wang , Jianwu dang

Estimating click-through rate (CTR) accurately has an essential impact on improving user experience and revenue in sponsored search. For CTR prediction model, it is necessary to make out user real-time search intention. Most of the current…

Machine Learning · Computer Science 2021-03-31 Feng Li , Zhenrui Chen , Pengjie Wang , Yi Ren , Di Zhang , Xiaoyu Zhu

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa

Detecting and identifying user intent from text, both written and spoken, plays an important role in modelling and understand dialogs. Existing research for intent discovery model it as a classification task with a predefined set of known…

Information Retrieval · Computer Science 2019-04-19 Nikhita Vedula , Nedim Lipka , Pranav Maneriker , Srinivasan Parthasarathy

Generative AI often produces results misaligned with user intentions, for example, resolving ambiguous prompts in unexpected ways. Despite existing approaches to clarify intent, a major challenge remains: understanding and influencing AI's…

Human-Computer Interaction · Computer Science 2026-02-10 Lena Hegemann , Xinyi Wen , Michael A. Hedderich , Tarmo Nurmi , Hariharan Subramonyam

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

The assurance of mobile app GUI has become increasingly important, as the GUI serves as the primary medium of interaction between users and apps. Although numerous automated GUI testing approaches have been developed with diverse…

Software Engineering · Computer Science 2026-05-05 Shengcheng Yu , Yuchen Ling , Chunrong Fang , Quan Zhou , Yi Zhao , Chunyang Chen , Shaomin Zhu , Zhenyu Chen

The software industry aims to provide customers with quality software. Testing software is a critical and sensitive stage in ensuring software quality. Due to the increasing popularity of mobile devices, the use of Android applications has…

Software Engineering · Computer Science 2022-09-07 Fatemeh Mosayeb , Shohreh Ajoudanian

As AI systems increasingly exhibit autonomous, goal-directed, and long-horizon behavior, users lack a standardized way to detect the degree to which a system functions like an intentional actor for governance and accountability purposes.…

Artificial Intelligence · Computer Science 2026-05-08 Allessia Chiappetta , Robert Mahari

WebView is a UI widget that helps integrate web applications into the native context of Android apps. It provides powerful mechanisms for bi-directional interactions between the native-end (Java) and the web-end (JavaScript) of an Android…

Software Engineering · Computer Science 2023-06-07 Jiajun Hu , Lili Wei , Yepang Liu , Shing-Chi Cheung

Agentic AI systems can now generate code with remarkable fluency, but a fundamental question remains: \emph{does the generated code actually do what the user intended?} The gap between informal natural language requirements and precise…

Software Engineering · Computer Science 2026-03-19 Shuvendu K. Lahiri

The ubiquity of mobile phones makes mobile GUI understanding an important task. Most previous works in this domain require human-created metadata of screens (e.g. View Hierarchy) during inference, which unfortunately is often not available…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Jingwen Fu , Xiaoyi Zhang , Yuwang Wang , Wenjun Zeng , Sam Yang , Grayson Hilliard