English
Related papers

Related papers: On AI-Inspired UI-Design

200 papers

Large language models (LLMs) promise to accelerate UI design, yet current tools struggle with two fundamentals: externalizing designers' intent and controlling iterative change. We introduce SPEC, a structured, parameterized, hierarchical…

Human-Computer Interaction · Computer Science 2025-09-10 Yunnong Chen , Chengwei Shi , Liuqing Chen

Deep generative models have the potential to fundamentally change the way we create high-fidelity digital content but are often hard to control. Prompting a generative model is a promising recent development that in principle enables…

Human-Computer Interaction · Computer Science 2022-09-07 Hai Dang , Lukas Mecke , Florian Lehmann , Sven Goller , Daniel Buschek

Novel user interfaces based on artificial intelligence, such as natural-language agents, present new categories of engineering challenges. These systems need to cope with uncertainty and ambiguity, interface with machine learning…

Programming Languages · Computer Science 2017-09-18 Alex Renda , Harrison Goldstein , Sarah Bird , Chris Quirk , Adrian Sampson

Large language models (LLMs) show strong potential to support creative tasks, but the role of the interface design is poorly understood. In particular, the effect of different modes of collaboration between humans and LLMs on co-creation…

Human-Computer Interaction · Computer Science 2026-03-10 Sebastian Maier , Manuel Schneider , Stefan Feuerriegel

Artificial Intelligence holds significant potential to enhance human creativity. However, achieving this vision requires a clearer understanding of how such enhancement can be effectively realized. Drawing on a relational and distributed…

Human-Computer Interaction · Computer Science 2025-06-17 Andrea Gaggioli , Sabrina Bartolotta , Andrea Ubaldi , Katusha Gerardini , Eleonora Diletta Sarcinella , Alice Chirico

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

Computation and Language · Computer Science 2023-12-08 Murray Shanahan , Catherine Clarke

User interface (UI) design goes beyond visuals to shape user experience (UX), underscoring the shift toward UI/UX as a unified concept. While recent studies have explored UI evaluation using Multimodal Large Language Models (MLLMs), they…

Computation and Language · Computer Science 2026-01-13 Jaehyun Jeon , Min Soo Kim , Jang Han Yoon , Sumin Shim , Yejin Choi , Hanbin Kim , Dae Hyun Kim , Youngjae Yu

Thanks to their generative capabilities, large language models (LLMs) have become an invaluable tool for creative processes. These models have the capacity to produce hundreds and thousands of visual and textual outputs, offering abundant…

Human-Computer Interaction · Computer Science 2024-03-15 Sangho Suh , Meng Chen , Bryan Min , Toby Jia-Jun Li , Haijun Xia

Prewriting is the process of discovering and developing ideas before a first draft, which requires divergent thinking and often implies unstructured strategies such as diagramming, outlining, free-writing, etc. Although large language…

Human-Computer Interaction · Computer Science 2024-03-01 Qian Wan , Siying Hu , Yu Zhang , Piaohong Wang , Bo Wen , Zhicong Lu

User Interface (UI) design is an creative process that involves considerable reiteration and rework. Designers go through multiple iterations of different prototyping fidelities to create a UI design. In this research, we propose to modify…

Human-Computer Interaction · Computer Science 2020-04-08 Vinoth Pandian Sermuga Pandian , Sarah Suleri

Large Language Models (LLMs) increasingly exhibit \textbf{anthropomorphism} characteristics -- human-like qualities portrayed across their outlook, language, behavior, and reasoning functions. Such characteristics enable more intuitive and…

Computation and Language · Computer Science 2025-09-16 Yunze Xiao , Lynnette Hui Xian Ng , Jiarui Liu , Mona T. Diab

Chat-based prompts respond with verbose linear-sequential texts, making it difficult to explore and refine ambiguous intents, back up and reinterpret, or shift directions in creative AI-assisted design work. AI-Instruments instead embody…

Human-Computer Interaction · Computer Science 2025-02-27 Nathalie Riche , Anna Offenwanger , Frederic Gmeiner , David Brown , Hugo Romat , Michel Pahud , Nicolai Marquardt , Kori Inkpen , Ken Hinckley

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

Recent advancements in artificial intelligence, such as computer vision and deep learning, have led to the emergence of numerous generative AI platforms, particularly for image generation. However, the application of AI-generated image…

Human-Computer Interaction · Computer Science 2024-06-21 Yuying Tang , Mariana Ciancia , Zhigang Wang , Ze Gao

The growing integration of AI tools in software development, particularly Large Language Models (LLMs) such as ChatGPT, has revolutionized how developers approach coding tasks. However, achieving high-quality code often requires iterative…

Software Engineering · Computer Science 2025-06-03 Sophia DiCuffa , Amanda Zambrana , Priyanshi Yadav , Sashidhar Madiraju , Khushi Suman , Eman Abdullah AlOmar

While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and…

Software Engineering · Computer Science 2026-04-28 Victoria Jackson , Grischa Liebel , Rafael Prikladnicki , Andre van der Hoek

The integration of Large Language Models (LLMs) into interactive systems opens new opportunities for adaptive user experiences, yet it also raises challenges regarding accessibility, explainability, and normative compliance. This paper…

Human-Computer Interaction · Computer Science 2026-01-13 Blessing Jerry , Lourdes Moreno , Virginia Francisco , Raquel Hervas

Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI…

Human-Computer Interaction · Computer Science 2024-05-03 Zijian Ding

Large Language Models (LLMs) have transformed human-computer interaction by enabling natural language-based communication with AI-powered chatbots. These models are designed to be intuitive and user-friendly, allowing users to articulate…

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle