English
Related papers

Related papers: Gradual Generation of User Interfaces as a Design …

200 papers

The emergence of generative AI (GenAI) models, including large language models and text-to-image models, has significantly advanced the synergy between humans and AI with not only their outstanding capability but more importantly, the…

Human-Computer Interaction · Computer Science 2025-03-05 Leixian Shen , Haotian Li , Yifang Wang , Xing Xie , Huamin Qu

Technological progress has persistently shaped the dynamics of human-machine interactions in task execution. In response to the advancements in Generative AI, this paper outlines a detailed study plan that investigates various human-AI…

Human-Computer Interaction · Computer Science 2024-02-13 Zijian Ding

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

With the advancement of neural generative capabilities, the art community has actively embraced GenAI (generative artificial intelligence) for creating painterly content. Large text-to-image models can quickly generate aesthetically…

Artificial Intelligence · Computer Science 2024-02-12 Aven-Le Zhou , Yu-Ao Wang , Wei Wu , Kang Zhang

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Dawen Zhang , Mingyue Yuan , Kaiqi Xian , Don Samitha Elvitigala , June Kim , Gelareh Mohammadi , Zhenchang Xing , Xiwei Xu , Aaron Quigley

Generative AI applications present unique design challenges. As generative AI technologies are increasingly being incorporated into mainstream applications, there is an urgent need for guidance on how to design user experiences that foster…

Human-Computer Interaction · Computer Science 2024-01-29 Justin D. Weisz , Jessica He , Michael Muller , Gabriela Hoefer , Rachel Miles , Werner Geyer

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

Human-Computer Interaction · Computer Science 2024-09-04 Aron E. Owen , Jonathan C. Roberts

This paper investigates User Experience (UX) with prototypes generated by Generative Artificial Intelligence (GenAI) tools. An empirical survey with 92 participants evaluated AI-generated and human-created prototypes without prior…

Human-Computer Interaction · Computer Science 2026-05-15 Karoline Romero , Igor Wiese , Renato Balancieiri , Gislaine Camila Leal , Guilherme Guerino

Designing user interfaces that align with user preferences is a time-consuming process, which requires iterative cycles of prototyping, user testing, and refinement. Recent advancements in LLM-based UI generation have enabled efficient UI…

Human-Computer Interaction · Computer Science 2026-01-27 Yimeng Liu , Misha Sra , Chang Xiao

Generative AI models are increasingly being integrated into human task workflows, enabling the production of expressive content across a wide range of contexts. Unlike traditional human-AI design methods, the new approach to designing…

Human-Computer Interaction · Computer Science 2025-04-01 Hari Subramonyam , Divy Thakkar , Andrew Ku , Jürgen Dieber , Anoop Sinha

Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily…

Human-Computer Interaction · Computer Science 2025-04-09 Hyerim Park , Malin Eiband , Andre Luckow , Michael Sedlmair

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of…

Human-Computer Interaction · Computer Science 2025-10-30 Mingyue Yuan , Jieshan Chen , Yongquan Hu , Sidong Feng , Mulong Xie , Gelareh Mohammadi , Zhenchang Xing , Aaron Quigley

This work investigates generative facial expression interfaces for intelligent agents from a meta-design perspective. We propose the Generative Personalized Facial Expression Interface (GPFEI) framework, which organizes rule-bounded spaces,…

Human-Computer Interaction · Computer Science 2026-02-12 Yate Ge , Lin Tian , Yi Dai , Shuhan Pan , Yiwen Zhang , Qi Wang , Weiwei Guo , Xiaohua Sun

We present a novel framework to advance generative artificial intelligence (AI) applications in the realm of printed art products, specifically addressing large-format products that require high-resolution artworks. The framework consists…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Noah Pursell , Anindya Maiti

Generative AI systems are transforming content creation, but their usability remains a key challenge. This paper examines usability factors such as user experience, transparency, control, and cognitive load. Common challenges include…

Human-Computer Interaction · Computer Science 2025-02-26 Anna Ravera , Cristina Gena

Artificial Intelligence (AI)-driven material design has been attracting great attentions as a groundbreaking technology across a wide spectrum of industries. Molecular design is particularly important owing to its broad application domains…

Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional…

Human-Computer Interaction · Computer Science 2023-06-05 Matthew K. Hong , Shabnam Hakimi , Yan-Ying Chen , Heishiro Toyoda , Charlene Wu , Matt Klenk

The design process of user interfaces (UIs) often begins with articulating high-level design goals. Translating these high-level design goals into concrete design mock-ups, however, requires extensive effort and UI design expertise. To…

Human-Computer Interaction · Computer Science 2021-10-18 Forrest Huang , Gang Li , Xin Zhou , John F. Canny , Yang Li

Generative AI (GenAI) is transforming creative fields shaping our culture and our heritage. We focus on widespread interactions between clients and (creative) specialists highlighting a change in interaction patterns leading to a shift from…

Artificial Intelligence · Computer Science 2025-12-05 Johannes Schneider , Kilic Sinem , Daniel Stockhammer

Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers…

Human-Computer Interaction · Computer Science 2025-01-29 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Gérard Dray , Walid Maalej