English
Related papers

Related papers: Brief2Design: A Multi-phased, Compositional Approa…

200 papers

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle

The Design2Code problem, which involves converting digital designs into functional source code, is a significant challenge in software development due to its complexity and time-consuming nature. Traditional approaches often struggle with…

Machine Learning · Computer Science 2025-04-29 Tung D. Vu , Chung Hoang , Truong-Son Hy

Concept designers in the entertainment industry create highly detailed, often imaginary environments for movies, games, and TV shows. Their early ideation phase requires intensive research, brainstorming, visual exploration, and combination…

Human-Computer Interaction · Computer Science 2025-02-21 Wen-Fan Wang , Chien-Ting Lu , Nil Ponsa Campanyà , Bing-Yu Chen , Mike Y. Chen

Client-designer alignment is crucial to the success of design projects, yet little research has explored how digital technologies might influence this alignment. To address this gap, this paper presents a three-phase study investigating how…

Human-Computer Interaction · Computer Science 2025-06-16 Daniel Hove Paludan , Julie Fredsgård , Kasper Patrick Bährentz , Ilhan Aslan

While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI…

Human-Computer Interaction · Computer Science 2026-02-10 Seokhyeon Park , Soohyun Lee , Eugene Choi , Hyunwoo Kim , Minkyu Kweon , Yumin Song , Jinwook Seo

Generative AI promises to allow people to create high-quality personalized media. Although powerful, we identify three fundamental design problems with existing tooling through a literature review. We introduce a multimodal generative AI…

Human-Computer Interaction · Computer Science 2025-06-23 Gregory Croisdale , Emily Huang , John Joon Young Chung , Anhong Guo , Xu Wang , Austin Z. Henley , Cyrus Omar

Visual blends combine elements from two distinct visual concepts into a single, integrated image, with the goal of conveying ideas through imaginative and often thought-provoking visuals. Communicating abstract concepts through visual…

Human-Computer Interaction · Computer Science 2025-02-25 Zhida Sun , Zhenyao Zhang , Yue Zhang , Min Lu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Generative AI models offer many possibilities for text creation and transformation. Current graphical user interfaces (GUIs) for prompting them lack support for iterative exploration, as they do not represent prompts as actionable interface…

Human-Computer Interaction · Computer Science 2025-03-28 Rifat Mehreen Amin , Oliver Hans Kühle , Daniel Buschek , Andreas Butz

Graphic designers often get inspiration through the recombination of references. Our formative study (N=6) reveals that graphic designers focus on conceptual keywords during this process, and want support for discovering the keywords,…

Human-Computer Interaction · Computer Science 2024-03-08 DaEun Choi , Sumin Hong , Jeongeon Park , John Joon Young Chung , Juho Kim

Professional software offers immense power but also presents significant learning challenges. Its complex interfaces, as well as insufficient built-in structured guidance and unfamiliar terminology, often make newcomers struggle with task…

Human-Computer Interaction · Computer Science 2025-05-20 Yimeng Liu , Misha Sra

As designers become familiar with Generative AI, a new concept is emerging: Agentic AI. While generative AI produces output in response to prompts, agentic AI systems promise to perform mundane tasks autonomously, potentially freeing…

Human-Computer Interaction · Computer Science 2025-09-26 Samangi Wadinambiarachchi , Jenny Waycott , Yvonne Rogers , Greg Wadley

Recent advancements in instruction-following models have made user interactions with models more user-friendly and efficient, broadening their applicability. In graphic design, non-professional users often struggle to create visually…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Wanrong Zhu , Jennifer Healey , Ruiyi Zhang , William Yang Wang , Tong Sun

Drawing supports learning by externalizing mental models, but providing timely feedback at scale remains challenging. We present Draw2Learn, a system that explores how AI can act as a supportive teammate during drawing-based learning. The…

Human-Computer Interaction · Computer Science 2026-02-03 Yuqi Hang

This survey provides a comprehensive overview of the advancements in Artificial Intelligence in Graphic Design (AIGD), focusing on integrating AI techniques to support design interpretation and enhance the creative process. We categorize…

Artificial Intelligence · Computer Science 2025-03-25 Xingxing Zou , Wen Zhang , Nanxuan Zhao

Creating 2D animations is a complex, iterative process requiring continuous adjustments to movement, timing, and coordination of multiple elements within a scene. To support designers of varying levels of experience with animation design…

Human-Computer Interaction · Computer Science 2025-08-14 Tiffany Tseng , Ruijia Cheng , Jeffrey Nichols

Generative AI is reshaping product design practices through "vibe coding," where product team members express intent in natural language and AI translates it into functional prototypes and code. Despite rapid adoption, little research has…

Human-Computer Interaction · Computer Science 2026-05-04 Jie Li , Youyang Hou , Laura Lin , Ruihao Zhu , Hancheng Cao , Abdallah El Ali

Although exploring alternatives is fundamental to creating better interface designs, current processes for creating alternatives are generally manual, limiting the alternatives a designer can explore. We present Scout, a system that helps…

Human-Computer Interaction · Computer Science 2020-01-16 Amanda Swearngin , Chenglong Wang , Alannah Oleson , James Fogarty , Amy J. Ko

Navigating and visualizing multilayered knowledge graphs remains a challenging, unresolved problem in information systems design. Building on our earlier study, which engaged end users in both the design and population of a domain-specific…

Human-Computer Interaction · Computer Science 2025-05-05 Stanislava Gardasevic , Manika Lamba , Jasmine S. Malone

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

In the realm of AI architectural design, the importance of prompts is becoming increasingly prominent. With advancements in artificial intelligence and large-scale model technology, more design tasks are being delegated to machine learning…

Human-Computer Interaction · Computer Science 2024-04-25 Xin Zhang , Wenwen Liu