English
Related papers

Related papers: ControlGUI: Guiding Generative GUI Exploration thr…

200 papers

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional…

Human-Computer Interaction · Computer Science 2023-06-05 Matthew K. Hong , Shabnam Hakimi , Yan-Ying Chen , Heishiro Toyoda , Charlene Wu , Matt Klenk

Recent diffusion-based generators can produce high-quality images from textual prompts. However, they often disregard textual instructions that specify the spatial layout of the composition. We propose a simple approach that achieves robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Minghao Chen , Iro Laina , Andrea Vedaldi

Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper…

Human-Computer Interaction · Computer Science 2024-01-29 Jon McCormack , Maria Teresa Llano , Stephen James Krol , Nina Rajcic

Controllable image generation has always been one of the core demands in image generation, aiming to create images that are both creative and logical while satisfying additional specified conditions. In the post-AIGC era, controllable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Guandong Li

In online advertising scenario, sellers often create multiple creatives to provide comprehensive demonstrations, making it essential to present the most appealing design to maximize the Click-Through Rate (CTR). However, sellers generally…

Information Retrieval · Computer Science 2024-01-23 Hao Yang , Jianxin Yuan , Shuai Yang , Linhe Xu , Shuo Yuan , Yifan Zeng

Recent advancements in large vision-language models have enabled highly expressive and diverse vector sketch generation. However, state-of-the-art methods rely on a time-consuming optimization process involving repeated feedback from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ellie Arar , Yarden Frenkel , Daniel Cohen-Or , Ariel Shamir , Yael Vinker

Generative AI has made visual storytelling widely accessible, yet current prompt-based interactions often force users into a trade-off between precise control and creative flow. We present One Kiss, a co-creative comic generation system…

Human-Computer Interaction · Computer Science 2026-03-18 Xiruo Wang , Xinyi Jiang , Ziqi Lyu

Recent advances in diffusion models have significantly improved text-to-image (T2I) generation, but they often struggle to balance fine-grained precision with high-level control. Methods like ControlNet and T2I-Adapter excel at following…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Pouyan Navard , Amin Karimi Monsefi , Mengxi Zhou , Wei-Lun Chao , Alper Yilmaz , Rajiv Ramnath

With the advancement of generative artificial intelligence, previous studies have achieved the task of generating aesthetic images from hand-drawn sketches, fulfilling the public's needs for drawing. However, these methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Lifan Jiang , Shuang Chen , Boxi Wu , Xiaotong Guan , Jiahui Zhang

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

We propose a diffusion-based approach for Text-to-Image (T2I) generation with interactive 3D layout control. Layout control has been widely studied to alleviate the shortcomings of T2I diffusion models in understanding objects' placement…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Abdelrahman Eldesokey , Peter Wonka

Deep learning-based sketch-to-clothing image generation provides the initial designs and inspiration in the fashion design processes. However, clothing generation from freehand drawing is challenging due to the sparse and ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Yongming Zhang , Tianyu Zhang , Haoran Xie

Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches…

Human-Computer Interaction · Computer Science 2026-01-29 Boyu Li , Lin-Ping Yuan , Zeyu Wang , Hongbo Fu

We present a case study of using generative user interfaces, or ``vibe coding,'' a method leveraging large language models (LLMs) for generating code via natural language prompts, to support rapid prototyping in user-centered design (UCD).…

Human-Computer Interaction · Computer Science 2025-07-29 Tianyi Li , Tanay Maheshwari , Alex Voelker

As designers become familiar with Generative AI, a new concept is emerging: Agentic AI. While generative AI produces output in response to prompts, agentic AI systems promise to perform mundane tasks autonomously, potentially freeing…

Human-Computer Interaction · Computer Science 2025-09-26 Samangi Wadinambiarachchi , Jenny Waycott , Yvonne Rogers , Greg Wadley

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

Human-Computer Interaction · Computer Science 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

Graphics · Computer Science 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

While diffusion-based text-to-image (T2I) models provide a simple and powerful way to generate images, guiding this generation remains a challenge. For concepts that are difficult to describe through language, users may struggle to create…

Human-Computer Interaction · Computer Science 2023-08-11 John Joon Young Chung , Eytan Adar

We introduce StreamDiffusion, a real-time diffusion pipeline designed for interactive image generation. Existing diffusion models are adept at creating images from text or image prompts, yet they often fall short in real-time interaction.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Akio Kodaira , Chenfeng Xu , Toshiki Hazama , Takanori Yoshimoto , Kohei Ohno , Shogo Mitsuhori , Soichi Sugano , Hanying Cho , Zhijian Liu , Masayoshi Tomizuka , Kurt Keutzer