English

Predicting the usability of mobile applications using AI tools: the rise of large user interface models, opportunities, and challenges

Human-Computer Interaction 2024-05-08 v1 Artificial Intelligence
Authors: Abdallah Namoun , Ahmed Alrehaili , Zaib Un Nisa , Hani Almoamari , Ali Tufail
View on arXiv ↗ PDF ↗

Abstract

This article proposes the so-called large user interface models (LUIMs) to enable the generation of user interfaces and prediction of usability using artificial intelligence in the context of mobile applications.

Keywords

mobile applications usability prediction large user interface models artificial intelligence

Cite

@article{arxiv.2405.03716,
  title  = {Predicting the usability of mobile applications using AI tools: the rise of large user interface models, opportunities, and challenges},
  author = {Abdallah Namoun and Ahmed Alrehaili and Zaib Un Nisa and Hani Almoamari and Ali Tufail},
  journal= {arXiv preprint arXiv:2405.03716},
  year   = {2024}
}

Comments

12 pages, 3 figures, 4 tables, The 7th International Conference on Emerging Data and Industry (EDI40)

Related papers

View all related →
Human-Computer Interaction · Computer Science
Qualitative Evaluation of LLM-Designed GUI
Bartosz Sawicki, Tomasz Les, Dariusz Parzych, Aleksandra Wycisk-Ficek +2
2026-02-02
Human-Computer Interaction · Computer Science
Towards LLM-Based Usability Analysis for Recommender User Interfaces
Sebastian Lubos, Alexander Felfernig, Damian Garber, Viet-Man Le +1
2025-11-19
Human-Computer Interaction · Computer Science
Large Language User Interfaces: Voice Interactive User Interfaces powered by LLMs
Syed Mekael Wasti, Ken Q. Pu, Ali Neshati
2024-04-17
Software Engineering · Computer Science
Effort and Size Estimation in Software Projects with Large Language Model-based Intelligent Interfaces
Claudionor N. Coelho, Hanchen Xiong, Tushar Karayil, Sree Koratala +4
2024-07-01
Artificial Intelligence · Computer Science
A Contemporary Overview: Trends and Applications of Large Language Models on Mobile Devices
Lianjun Liu, Hongli An, Pengxuan Chen, Longxiang Ye
2026-03-03
Human-Computer Interaction · Computer Science
On AI-Inspired UI-Design
Jialiang Wei, Anne-Lise Courbis, Thomas Lambolais, Gérard Dray +1
2025-01-29
Software Engineering · Computer Science
Recommending Usability Improvements with Multimodal Large Language Models
Sebastian Lubos, Alexander Felfernig, Damian Garber, Viet-Man Le +1
2026-04-29
Software Engineering · Computer Science
LLMs in Mobile Apps: Practices, Challenges, and Opportunities
Kimberly Hau, Safwat Hassan, Shurui Zhou
2025-02-25
Computation and Language · Computer Science
Generative Interfaces for Language Models
Jiaqi Chen, Yanzhe Zhang, Yutong Zhang, Yijia Shao +1
2026-05-05
Software Engineering · Computer Science
Investigating Multimodal Large Language Models to Support Usability Evaluation
Sebastian Lubos, Alexander Felfernig, Damian Garber, Gerhard Leitner +2
2026-04-13
Human-Computer Interaction · Computer Science
Enabling Conversational Interaction with Mobile UI using Large Language Models
Bryan Wang, Gang Li, Yang Li
2023-02-21
Computation and Language · Computer Science
User Modeling Challenges in Interactive AI Assistant Systems
Megan Su, Yuwei Bao
2024-04-01
Human-Computer Interaction · Computer Science
MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces
Reuben A. Luera, Ryan Rossi, Franck Dernoncourt, Samyadeep Basu +11
2025-10-13
Human-Computer Interaction · Computer Science
Good Intentions, Risky Inventions: A Method for Assessing the Risks and Benefits of AI in Mobile and Wearable Uses
Marios Constantinides, Edyta Bogucka, Sanja Scepanovic, Daniele Quercia
2024-07-30
Computation and Language · Computer Science
User Modeling in the Era of Large Language Models: Current Research and Future Directions
Zhaoxuan Tan, Meng Jiang
2023-12-27
Human-Computer Interaction · Computer Science
Usability Issues With Mobile Applications: Insights From Practitioners and Future Research Directions
Pawel Weichbroth
2025-06-03
Artificial Intelligence · Computer Science
GUI Agents with Foundation Models: A Comprehensive Survey
Shuai Wang, Weiwen Liu, Jingxuan Chen, Yuqi Zhou +11
2025-02-14
Software Engineering · Computer Science
Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models
Sebastian Lubos, Alexander Felfernig, Damian Garber, Adnan Kraljić +10
2026-05-29
Software Engineering · Computer Science
Does GenAI Make Usability Testing Obsolete?
Ali Ebrahimi Pourasad, Walid Maalej
2026-01-14
Human-Computer Interaction · Computer Science
Modelling internet based applications for designing multi-device adaptive interfaces
Enrico Bertini, Giuseppe Santucci
2017-01-26
Computers and Society · Computer Science
Designing Effective LLM-Assisted Interfaces for Curriculum Development
Abdolali Faraji, Mohammadreza Tavakoli, Mohammad Moein, Mohammadreza Molavi +1
2025-06-16
Computation and Language · Computer Science
Redefining Digital Health Interfaces with Large Language Models
Fergus Imrie, Paulius Rauba, Mihaela van der Schaar
2024-03-01
Human-Computer Interaction · Computer Science
Creating General User Models from Computer Use
Omar Shaikh, Shardul Sapkota, Shan Rizvi, Eric Horvitz +3
2025-09-23
Human-Computer Interaction · Computer Science
Open WebUI: An Open, Extensible, and Usable Interface for AI Interaction
Jaeryang Baek, Ayana Hussain, Danny Liu, Nicholas Vincent +1
2025-10-06
Machine Learning · Statistics
An Overview of Large Language Models for Statisticians
Wenlong Ji, Weizhe Yuan, Emily Getzen, Kyunghyun Cho +6
2025-02-26