English
Related papers

Related papers: DesignWeaver: Dimensional Scaffolding for Text-to-…

200 papers

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it…

Human-Computer Interaction · Computer Science 2025-11-19 Weiyan Shi , Sunaya Upadhyay , Geraldine Quek , Kenny Tsu Wei Choo

The emergence of generative AI (GenAI) models, including large language models and text-to-image models, has significantly advanced the synergy between humans and AI with not only their outstanding capability but more importantly, the…

Human-Computer Interaction · Computer Science 2025-03-05 Leixian Shen , Haotian Li , Yifang Wang , Xing Xie , Huamin Qu

Digital art portfolios serve as impactful mediums for artists to convey their visions, weaving together visuals, audio, interactions, and narratives. However, without technical backgrounds, design students often find it challenging to…

Human-Computer Interaction · Computer Science 2023-11-27 Tao Long , Weirui Peng

We present "Narrative Weaver", a novel framework that addresses a fundamental challenge in generative AI: achieving multi-modal controllable, long-range, and consistent visual content generation. While existing models excel at generating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhengjian Yao , Yongzhi Li , Xinyuan Gao , Quan Chen , Peng Jiang , Yanye Lu

Can visual artworks created using generative visual algorithms inspire human creativity in storytelling? We asked writers to write creative stories from a starting prompt, and provided them with visuals created by generative AI models from…

Human-Computer Interaction · Computer Science 2021-10-29 Safinah Ali , Devi Parikh

Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers…

Human-Computer Interaction · Computer Science 2025-01-29 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Gérard Dray , Walid Maalej

Generative Artificial Intelligence (Generative AI) is a collection of AI technologies that can generate new information such as texts and images. With its strong capabilities, Generative AI has been actively studied in creative design…

Human-Computer Interaction · Computer Science 2025-02-04 Liuging Chen , Yaxuan Song , Jia Guo , Lingyun Sun , Peter Childs , Yuan Yin

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

Drawing supports learning by externalizing mental models, but providing timely feedback at scale remains challenging. We present Draw2Learn, a system that explores how AI can act as a supportive teammate during drawing-based learning. The…

Human-Computer Interaction · Computer Science 2026-02-03 Yuqi Hang

Text-to-image generation model is able to generate images across a diverse range of subjects and styles based on a single prompt. Recent works have proposed a variety of interaction methods that help users understand the capabilities of…

Human-Computer Interaction · Computer Science 2023-07-19 Seungho Baek , Hyerin Im , Jiseung Ryu , Juhyeong Park , Takyeon Lee

AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools…

Human-Computer Interaction · Computer Science 2023-03-02 Frederic Gmeiner , Humphrey Yang , Lining Yao , Kenneth Holstein , Nikolas Martelaro

AI is growing increasingly capable of automatically generating user interfaces (GenUI) from user prompts. However, designing GenUI applications that enable users to discover diverse customizations while preserving GenUI's expressiveness…

Human-Computer Interaction · Computer Science 2026-01-27 Bryan Min , Peiling Jiang , Zhicheng Huang , Haijun Xia

Character design in games involves interdisciplinary collaborations, typically between designers who create the narrative content, and illustrators who realize the design vision. However, traditional workflows face challenges in…

Human-Computer Interaction · Computer Science 2025-08-19 Long Ling , Xinyi Chen , Ruoyu Wen , Toby Jia-Jun Li , Ray LC

This paper presents a novel conversational AI-enabled active ideation interface as a creative idea-generation tool to assist novice designers in mitigating the initial latency and ideation bottlenecks that are commonly observed. It is a…

Human-Computer Interaction · Computer Science 2025-04-16 B. Sankar , Dibakar Sen

This study examines the role of vagueness in the design process and its strategic management for the effective human-AI interaction. While vagueness in the generation of design ideas promotes diverse interpretations and prevents fixation,…

Human-Computer Interaction · Computer Science 2024-11-14 Myungjin Kim , Bogoan Kim , Kyungsik Han

Generative Artificial Intelligence systems have been developed for image, code, story, and game generation with the goal of facilitating human creativity. Recent work on neural generative systems has emphasized one particular means of…

Artificial Intelligence · Computer Science 2024-06-13 Zhiyu Lin , Upol Ehsan , Rohan Agarwal , Samihan Dani , Vidushi Vashishth , Mark Riedl

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more. However, most neural generation algorithms are "uncontrolled" in the sense that the user has little say in…

Artificial Intelligence · Computer Science 2022-08-08 Zhiyu Lin , Rohan Agarwal , Mark Riedl

This paper examines the art practices, artwork, and motivations of prolific users of the latest generation of text-to-image models. Through interviews, observations, and a user survey, we present a sampling of the artistic styles and…

Human-Computer Interaction · Computer Science 2023-03-23 Minsuk Chang , Stefania Druga , Alex Fiannaca , Pedro Vergani , Chinmay Kulkarni , Carrie Cai , Michael Terry

Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their…

Machine Learning · Computer Science 2024-02-06 Zoe De Simone , Angie Boggust , Arvind Satyanarayan , Ashia Wilson

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang