English

Boosting GUI Prototyping with Diffusion Models

Software Engineering 2023-10-05 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

GUI (graphical user interface) prototyping is a widely-used technique in requirements engineering for gathering and refining requirements, reducing development risks and increasing stakeholder engagement. However, GUI prototyping can be a time-consuming and costly process. In recent years, deep learning models such as Stable Diffusion have emerged as a powerful text-to-image tool capable of generating detailed images based on text prompts. In this paper, we propose UI-Diffuser, an approach that leverages Stable Diffusion to generate mobile UIs through simple textual descriptions and UI components. Preliminary results show that UI-Diffuser provides an efficient and cost-effective way to generate mobile GUI designs while reducing the need for extensive prototyping efforts. This approach has the potential to significantly improve the speed and efficiency of GUI prototyping in requirements engineering.

Keywords

Cite

@article{arxiv.2306.06233,
  title  = {Boosting GUI Prototyping with Diffusion Models},
  author = {Jialiang Wei and Anne-Lise Courbis and Thomas Lambolais and Binbin Xu and Pierre Louis Bernard and Gérard Dray},
  journal= {arXiv preprint arXiv:2306.06233},
  year   = {2023}
}

Comments

Accepted for The 31st IEEE International Requirements Engineering Conference 2023, RE@Next! track

R2 v1 2026-06-28T11:01:36.387Z