English
Related papers

Related papers: DesignWeaver: Dimensional Scaffolding for Text-to-…

200 papers

Text-to-image generation has seen an explosion of interest since 2021. Today, beautiful and intriguing digital images and artworks can be synthesized from textual inputs ("prompts") with deep generative models. Online communities around…

Multimedia · Computer Science 2023-11-27 Jonas Oppenlaender

Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image…

Human-Computer Interaction · Computer Science 2023-08-28 Hai Dang , Frederik Brudy , George Fitzmaurice , Fraser Anderson

Text-to-image generative models have recently exploded in popularity and accessibility. Yet so far, use of these models in creative tasks that bridge the 2D digital world and the creation of physical artefacts has been understudied. We…

Artificial Intelligence · Computer Science 2023-02-02 Amy Smith , Hope Schroeder , Ziv Epstein , Michael Cook , Simon Colton , Andrew Lippman

We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with…

Human-Computer Interaction · Computer Science 2024-07-08 Jonas Oppenlaender , Rhema Linder , Johanna Silvennoinen

Text-to-3D generative AI systems create navigable environments from natural language prompts, but unlike text-to-image generation, evaluation requires embodied exploration of spatial coherence, scale, and navigability. We present the first…

Human-Computer Interaction · Computer Science 2026-03-17 Aung Pyae

Environment designers in the entertainment industry create imaginative 2D and 3D scenes for games, films, and television, requiring both fine-grained control of specific details and consistent global coherence. Designers have increasingly…

Human-Computer Interaction · Computer Science 2025-09-03 Wen-Fan Wang , Ting-Ying Lee , Chien-Ting Lu , Che-Wei Hsu , Nil Ponsa Campanyà , Yu Chen , Mike Y. Chen , Bing-Yu Chen

Generative AI (GenAI) image tools are increasingly used in design practice, enabling rapid ideation but offering limited support for refinement tasks such as adjusting layout, scale, or visual attributes. While text prompts and inpainting…

Human-Computer Interaction · Computer Science 2026-02-10 Hyerim Park , Phuong Thao Tran , Andre Luckow , Ceenu George , Michael Sedlmair , Malin Eiband

While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI…

Human-Computer Interaction · Computer Science 2026-02-10 Seokhyeon Park , Soohyun Lee , Eugene Choi , Hyunwoo Kim , Minkyu Kweon , Yumin Song , Jinwook Seo

The use of generative AI (GenAI) tools has fundamentally transformed software development. Central to this shift is prompt engineering, the practice of crafting textual prompts to guide GenAI tools in generating useful content. Although…

Software Engineering · Computer Science 2026-01-26 Daniel Otten , Trevor Stalnaker , Nathan Wintersgill , Oscar Chaparro , Denys Poshyvanyk

The rapid development of artificial intelligence (AI) has fundamentally transformed creative work practices in the design industry. Existing studies have identified both opportunities and challenges for creative practitioners in their…

Human-Computer Interaction · Computer Science 2025-09-30 Nami Ogawa , Yuki Okafuji , Yuji Hatada , Jun Baba

Graphic designers often get inspiration through the recombination of references. Our formative study (N=6) reveals that graphic designers focus on conceptual keywords during this process, and want support for discovering the keywords,…

Human-Computer Interaction · Computer Science 2024-03-08 DaEun Choi , Sumin Hong , Jeongeon Park , John Joon Young Chung , Juho Kim

Text-to-image generative models have increasingly been used to assist designers during concept generation in various creative domains, such as graphic design, user interface design, and fashion design. However, their applications in…

Artificial Intelligence · Computer Science 2024-07-23 Leah Chong , Jude Rayan , Steven Dow , Ioanna Lykourentzou , Faez Ahmed

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle

Prototyping AI applications is notoriously difficult. While large language model (LLM) prompting has dramatically lowered the barriers to AI prototyping, designers are still prototyping AI functionality and UI separately. We investigate how…

Human-Computer Interaction · Computer Science 2023-10-25 Savvas Petridis , Michael Terry , Carrie J. Cai

Creating meaningful visual narratives through human-AI collaboration requires understanding how text-image intertextuality emerges when textual intentions meet AI-generated visuals. We conducted a three-phase qualitative study with 15…

Human-Computer Interaction · Computer Science 2025-11-06 Mengyao Guo , Kexin Nie , Ze Gao , Black Sun , Xueyang Wang , Jinda Han , Xingting Wu

When designing a program, both novice programmers and seasoned developers alike often sketch out -- or, perhaps more famously, whiteboard -- their ideas. Yet despite the introduction of natively multimodal Generative AI models, work on…

Computers and Society · Computer Science 2026-02-12 David H. Smith , S. Moonwara A. Monisha , Annapurna Vadaparty , Leo Porter , Daniel Zingaro

The integration of generative artificial intelligence (AI) into architectural design has advanced significantly, enabling the generation of text, images, and 3D models. However, prior AI applications lack support for text-to-parametric…

Human-Computer Interaction · Computer Science 2025-05-20 Guangxi Feng , Wei Yan

As generative AI (GenAI) increasingly permeates design workflows, its impact on design outcomes and designers' creative capabilities warrants investigation. We conducted a within-subjects experiment where we asked participants to design…

Human-Computer Interaction · Computer Science 2024-11-04 Yue Fu , Han Bin , Tony Zhou , Marx Wang , Yixin Chen , Zelia Gomes Da Costa Lai , Jacob O. Wobbrock , Alexis Hiniker

In the realm of AI architectural design, the importance of prompts is becoming increasingly prominent. With advancements in artificial intelligence and large-scale model technology, more design tasks are being delegated to machine learning…

Human-Computer Interaction · Computer Science 2024-04-25 Xin Zhang , Wenwen Liu

Generative AI tools have lowered barriers to producing branded social media images and captions, yet small-business owners (SBOs) still struggle to create on-brand posts without access to professional designers or marketing consultants.…

Human-Computer Interaction · Computer Science 2026-04-14 Taehyun Yang , Eunhye Kim , Zhongzheng Xu , Fumeng Yang