English
Related papers

Related papers: ControlGUI: Guiding Generative GUI Exploration thr…

200 papers

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle

We present a novel framework to advance generative artificial intelligence (AI) applications in the realm of printed art products, specifically addressing large-format products that require high-resolution artworks. The framework consists…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Noah Pursell , Anindya Maiti

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it…

Human-Computer Interaction · Computer Science 2025-11-19 Weiyan Shi , Sunaya Upadhyay , Geraldine Quek , Kenny Tsu Wei Choo

Text-based prompting remains the predominant interaction paradigm in generative AI, yet it often introduces friction for novice users such as small business owners (SBOs), who struggle to articulate creative goals in domain-specific…

Human-Computer Interaction · Computer Science 2025-04-23 Nimisha Karnatak , Adrien Baranes , Rob Marchant , Huinan Zeng , Tríona Butler , Kristen Olson

In this paper, we present DesignDiffusion, a simple yet effective framework for the novel task of synthesizing design images from textual descriptions. A primary challenge lies in generating accurate and style-consistent textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zhendong Wang , Jianmin Bao , Shuyang Gu , Dong Chen , Wengang Zhou , Houqiang Li

Generative AI models are increasingly being integrated into human task workflows, enabling the production of expressive content across a wide range of contexts. Unlike traditional human-AI design methods, the new approach to designing…

Human-Computer Interaction · Computer Science 2025-04-01 Hari Subramonyam , Divy Thakkar , Andrew Ku , Jürgen Dieber , Anoop Sinha

Recent generative AI advances present new possibilities for supporting visual art creation, but how such promise might assist novice artists during early-stage processes requires investigation. How novices adopt or resist these tools can…

Human-Computer Interaction · Computer Science 2025-10-01 Cindy Peng , Alice Qian , Linghao Jin , Jieneng Chen , Evans Xu Han , Paul Pu Liang , Hong Shen , Haiyi Zhu , Jane Hsieh

Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily…

Human-Computer Interaction · Computer Science 2025-04-09 Hyerim Park , Malin Eiband , Andre Luckow , Michael Sedlmair

Recent advances in vision-language models have facilitated progress in sketch generation. However, existing specialized methods primarily focus on generic synthesis and lack mechanisms for precise control over sketch styles. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Tengjie Li , Shikui Tu , Lei Xu

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Generative art unlocks boundless creative possibilities, yet its full potential remains untapped due to the technical expertise required for advanced architectural concepts and computational workflows. To bridge this gap, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Duc-Hung Nguyen , Huu-Phuc Huynh , Minh-Triet Tran , Trung-Nghia Le

Design mockups are essential instruments for visualizing and testing design ideas. However, the process of generating mockups can be time-consuming and challenging for designers. In this article, we present and evaluate two different…

Human-Computer Interaction · Computer Science 2023-03-23 Tommaso Calò , Luigi De Russis

Generative Artificial Intelligence (AI) has advanced rapidly, enabling the generation of renderings from architectural sketches. This progress has significantly improved the efficiency of communication and conceptual expression during the…

Graphics · Computer Science 2025-03-06 Zhengyang Wang , Hao Jin , Xusheng Du , Yuxiao Ren , Ye Zhang , Haoran Xie

Generative AI shifts interaction toward intent-based outcome specification, despite user intents being inherently vague, fluid, and evolving. While a growing body of HCI research has proposed diverse interaction techniques to support this…

Human-Computer Interaction · Computer Science 2026-01-29 Yoonsu Kim , Kihoon Son , Seoyoung Kim , Brandon Chin , Juho Kim

Professional designers work from client briefs that specify goals and constraints but often lack concrete design details. Translating these abstract requirements into visual designs poses a central challenge, yet existing tools address…

Human-Computer Interaction · Computer Science 2026-04-14 Kotaro Kikuchi , Nami Ogawa

Generative AI promises to allow people to create high-quality personalized media. Although powerful, we identify three fundamental design problems with existing tooling through a literature review. We introduce a multimodal generative AI…

Human-Computer Interaction · Computer Science 2025-06-23 Gregory Croisdale , Emily Huang , John Joon Young Chung , Anhong Guo , Xu Wang , Austin Z. Henley , Cyrus Omar

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

Human-Computer Interaction · Computer Science 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

Design is a non-linear, reflective process in which practitioners engage with visual, semantic, and other expressive materials to explore, iterate, and refine ideas. As Generative AI (GenAI) becomes integrated into professional design…

Human-Computer Interaction · Computer Science 2026-03-04 Xiaohan Peng , Wendy E. Mackay , Janin Koch

Cross-Modal learning tasks have picked up pace in recent times. With plethora of applications in diverse areas, generation of novel content using multiple modalities of data has remained a challenging problem. To address the same, various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Nikhil Verma

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow