English

Bridging Gulfs in UI Generation through Semantic Guidance

Human-Computer Interaction 2026-02-10 v2 Artificial Intelligence

Abstract

While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI generation, we conducted a thematic analysis of UI prompting guidelines, identifying key design semantics and discovering that they are hierarchical and interdependent. Leveraging these findings, we developed a system that enables users to specify semantics, visualize relationships, and extract how semantics are reflected in generated UIs. By making semantics serve as an intermediate representation between human intent and AI output, our system bridges both gulfs by making requirements explicit and outcomes interpretable. A comparative user study suggests that our approach enhances users' perceived control over intent expression and outcome interpretation, and facilitates more predictable iterative refinement. Our work demonstrates how explicit semantic representation enables systematic and explainable exploration of design possibilities in AI-driven UI design.

Keywords

Cite

@article{arxiv.2601.19171,
  title  = {Bridging Gulfs in UI Generation through Semantic Guidance},
  author = {Seokhyeon Park and Soohyun Lee and Eugene Choi and Hyunwoo Kim and Minkyu Kweon and Yumin Song and Jinwook Seo},
  journal= {arXiv preprint arXiv:2601.19171},
  year   = {2026}
}

Comments

In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

R2 v1 2026-07-01T09:21:35.746Z