English
Related papers

Related papers: Brief2Design: A Multi-phased, Compositional Approa…

200 papers

As interfaces evolve from static user pathways to dynamic human-AI collaboration, no standard methods exist for selecting appropriate interface patterns based on user needs and task complexity. Existing frameworks only provide guiding…

Human-Computer Interaction · Computer Science 2026-02-27 Shruthi Andru , Shrut Kirti Saksena

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

Human-Computer Interaction · Computer Science 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

Data storytelling workflows ask learners to integrate analytical, design, and narrative skills, but instructors rarely have the capacity to provide detailed feedback at each step. Computational and AI-assisted storytelling offers…

Human-Computer Interaction · Computer Science 2026-05-19 Jennifer Posada , Taha Hassan , Lujie Karen Chen , Louise Yarnall , Jiaqi Gong

Designing infographics can be a tedious process for non-experts and time-consuming even for professional designers. Based on the literature and a formative study, we propose a flexible framework for automated and semi-automated infographics…

Human-Computer Interaction · Computer Science 2021-08-31 Anjul Tyagi , Jian Zhao , Pushkar Patel , Swasti Khurana , Klaus Mueller

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

Artificial Intelligence · Computer Science 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

One of the key challenges of AI generated designs in Microsoft Designer is selecting the most contextually relevant and novel fonts for the design suggestions. Previous efforts involved manually mapping design intent to fonts. Though this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Aryan Singh , Sumithra Bhakthavatsalam

Expertise is often built by learning from examples. This process, known as schema induction, helps us identify patterns from examples. Despite its importance, schema induction remains a challenging cognitive task. Recent advances in…

Human-Computer Interaction · Computer Science 2025-02-24 Sitong Wang , Lydia B. Chilton

Creating stylized visualization requires going beyond the limited, abstract, geometric marks produced by most tools. Rather, the designer builds stylized idioms where the marks are both transformed (e.g., photographs of candles instead of…

Human-Computer Interaction · Computer Science 2023-04-05 Jiaqi Wu , John Joon Young Chung , Eytan Adar

The emergence of Generative AI is catalyzing a paradigm shift in user interfaces from command-based to intent-based outcome specification. In this paper, we explore abstract-to-detailed task transitions in the context of frontend code…

Human-Computer Interaction · Computer Science 2024-08-05 Qinshi Zhang , Latisha Besariani Hendra , Mohan Chi , Zijian Ding

Text-based prompting remains the predominant interaction paradigm in generative AI, yet it often introduces friction for novice users such as small business owners (SBOs), who struggle to articulate creative goals in domain-specific…

Human-Computer Interaction · Computer Science 2025-04-23 Nimisha Karnatak , Adrien Baranes , Rob Marchant , Huinan Zeng , Tríona Butler , Kristen Olson

AI illustrator aims to automatically design visually appealing images for books to provoke rich thoughts and emotions. To achieve this goal, we propose a framework for translating raw descriptions with complex semantics into semantically…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Yiyang Ma , Huan Yang , Bei Liu , Jianlong Fu , Jiaying Liu

An essential task in analyzing collaborative design processes, such as those that are part of workshops in design studies, is identifying design outcomes and understanding how the collaboration between participants formed the results and…

Human-Computer Interaction · Computer Science 2025-08-11 Maurice Koch , Nelusa Pathmanathan , Daniel Weiskopf , Kuno Kurzhals

This paper presents a real-time generative drawing system that interprets and integrates both formal intent - the structural, compositional, and stylistic attributes of a sketch - and contextual intent - the semantic and thematic meaning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jookyung Song , Mookyoung Kang , Nojun Kwak

Graphic design generation demands a delicate balance between high visual fidelity and fine-grained structural editability. However, existing approaches typically bifurcate into either non-editable raster image synthesis or abstract layout…

Graphics · Computer Science 2026-02-24 Ziyuan Liu , Shizhao Sun , Danqing Huang , Yingdong Shi , Meisheng Zhang , Ji Li , Jingsong Yu , Jiang Bian

Characterizing creativity in visualization design can lead to the design of more expressive representations and visualization authoring tools that prioritize human creativity. In this paper, we examine how creativity manifests itself in…

Human-Computer Interaction · Computer Science 2026-04-14 Tianwei Ma , Zinat Ara , Safwat Ali Khan , Fanny Chevalier , Niklas Elmqvist , Naimul Hoque

Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily…

Human-Computer Interaction · Computer Science 2025-04-09 Hyerim Park , Malin Eiband , Andre Luckow , Michael Sedlmair

Pre-trained large language models can perform natural language processing downstream tasks by conditioning on human-designed prompts. However, a prompt-based approach often requires "prompt engineering" to design different prompts,…

Computation and Language · Computer Science 2024-05-28 Mingyang Song , Yi Feng , Liping Jing

Although explainable computational creativity seeks to create and sustain computational models of creativity that foster a collaboratively creative process through explainability, there remains little to no work in supporting designers when…

Human-Computer Interaction · Computer Science 2023-08-21 Michael Clemens

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

Human-Computer Interaction · Computer Science 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

Graphic designs are an effective medium for visual communication. They range from greeting cards to corporate flyers and beyond. Off-late, machine learning techniques are able to generate such designs, which accelerates the rate of content…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Sahil Goyal , Abhinav Mahajan , Swasti Mishra , Prateksha Udhayanan , Tripti Shukla , K J Joseph , Balaji Vasan Srinivasan