English
Related papers

Related papers: Large Language Models for Mobile GUI Text Input Ge…

200 papers

Gestures perform a variety of communicative functions that powerfully influence human face-to-face interaction. How this communicative function is achieved varies greatly between individuals and depends on the role of the speaker and the…

Human-Computer Interaction · Computer Science 2023-10-24 Laura B. Hensel , Nutchanon Yongsatianchot , Parisa Torshizi , Elena Minucci , Stacy Marsella

Mobile apps have become essential of our daily lives, making code quality a critical concern for developers. Behavioural code smells are characteristics in the source code that induce inappropriate code behaviour during execution, which…

Software Engineering · Computer Science 2026-04-14 Houcine Abdelkader Cherief , Florent Avellaneda , Naouel Moha

Error correction is an important capability when applying large language models (LLMs) to facilitate user typing on mobile devices. In this paper, we use LLMs to synthesize a high-quality dataset of error correction pairs to evaluate and…

Machine Learning · Computer Science 2025-05-27 Yanxiang Zhang , Zheng Xu , Shanshan Wu , Yuanbo Zhang , Daniel Ramage

Research on using Large Language Models (LLMs) in system development is expanding, especially in automated code and test generation. While E2E testing is vital for ensuring application quality, most test generation research has focused on…

Software Engineering · Computer Science 2025-03-25 Takuro Morimoto , Harumi Haraguchi

Intelligent assistants powered by Large Language Models (LLMs) can generate program and test code with high accuracy, boosting developers' and testers' productivity. However, there is a lack of studies exploring LLMs for testing Web APIs,…

Software Engineering · Computer Science 2024-09-09 André Pereira , Bruno Lima , João Pascoal Faria

The demand for quality in mobile applications has increased greatly given users' high reliance on them for daily tasks. Developers work tirelessly to ensure that their applications are both functional and user-friendly. In pursuit of this,…

Software Engineering · Computer Science 2025-05-16 Safwat Ali Khan

Large Language Models (LLMs) are increasingly being explored for their potential in software engineering, particularly in static analysis tasks. In this study, we investigate the potential of current LLMs to enhance call-graph analysis and…

Software Engineering · Computer Science 2025-07-17 Ashwin Prasad Shivarpatna Venkatesh , Rose Sunil , Samkutty Sabu , Amir M. Mir , Sofia Reis , Eric Bodden

Failure-inducing inputs play a crucial role in diagnosing and analyzing software bugs. Bug reports typically contain these inputs, which developers extract to facilitate debugging. Since bug reports are written in natural language, prior…

Software Engineering · Computer Science 2025-12-16 Alif Al Hasan , Subarna Saha , Mia Mohammad Imran , Tarannum Shaila Zaman

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a…

Computation and Language · Computer Science 2023-08-29 Lixiang Yan , Lele Sha , Linxuan Zhao , Yuheng Li , Roberto Martinez-Maldonado , Guanliang Chen , Xinyu Li , Yueqiao Jin , Dragan Gašević

Ensuring accessibility in mobile applications remains a significant challenge, particularly for visually impaired users who rely on screen readers. User interface icons are essential for navigation and interaction and often lack meaningful…

Human-Computer Interaction · Computer Science 2024-10-10 Sabrina Haque , Christoph Csallner

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

Computation and Language · Computer Science 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

User modeling (UM) aims to discover patterns or learn representations from user data about the characteristics of a specific user, such as profile, preference, and personality. The user models enable personalization and suspiciousness…

Computation and Language · Computer Science 2023-12-27 Zhaoxuan Tan , Meng Jiang

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

The rapid advancement of mobile applications has led to a significant demand for cross-platform compatibility, particularly between the Android and iOS platforms. Traditional approaches to mobile application translation often rely on manual…

Software Engineering · Computer Science 2025-07-23 Zhili Zeng , Kimya Khakzad Shahandashti , Alvine Boaye Belle , Song Wang , Zhen Ming , Jiang

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Artificial Intelligence · Computer Science 2025-05-07 Chaoyun Zhang , Shilin He , Jiaxu Qian , Bowen Li , Liqun Li , Si Qin , Yu Kang , Minghua Ma , Guyue Liu , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Text-rich visual understanding-the ability to process environments where dense textual content is integrated with visuals-is crucial for multimodal large language models (MLLMs) to interact effectively with structured environments. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Junpeng Liu , Tianyue Ou , Yifan Song , Yuxiao Qu , Wai Lam , Chenyan Xiong , Wenhu Chen , Graham Neubig , Xiang Yue

Given natural language test case description for an Android application, existing testing approaches require developers to manually write scripts using tools such as Appium and Espresso to execute the corresponding test case. This process…

Commit Message Generation (CMG) approaches aim to automatically generate commit messages based on given code diffs, which facilitate collaboration among developers and play a critical role in Open-Source Software (OSS). Very recently, Large…

Software Engineering · Computer Science 2024-11-07 Pengyu Xue , Linhao Wu , Zhongxing Yu , Zhi Jin , Zhen Yang , Xinyi Li , Zhenyu Yang , Yue Tan