English
Related papers

Related papers: Exploring Visual Prompts: Refining Images with Scr…

200 papers

Text-to-image generation has seen an explosion of interest since 2021. Today, beautiful and intriguing digital images and artworks can be synthesized from textual inputs ("prompts") with deep generative models. Online communities around…

Multimedia · Computer Science 2023-11-27 Jonas Oppenlaender

Generative models are increasingly powerful, yet users struggle to guide them through prompts. The generative process is difficult to control and unpredictable, and user instructions may be ambiguous or under-specified. Prior prompt…

Human-Computer Interaction · Computer Science 2026-02-16 Zhipeng Li , Yi-Chi Liao , Christian Holz

Design inspiration is crucial for establishing the direction of a design as well as evoking feelings and conveying meanings during the conceptual design process. Many practice designers use text-based searches on platforms like Pinterest to…

Human-Computer Interaction · Computer Science 2024-07-18 Ye Wang , Nicole B. Damen , Thomas Gale , Voho Seo , Hooman Shayani

Generative AI, specifically text-to-image models, have revolutionized interior architectural design by enabling the rapid translation of conceptual ideas into visual representations from simple text prompts. While generative AI can produce…

Human-Computer Interaction · Computer Science 2025-06-19 Richa Gupta , Alexander Htet Kyaw

Generative AI models have shown impressive ability to produce images with text prompts, which could benefit creativity in visual art creation and self-expression. However, it is unclear how precisely the generated images express contexts…

Human-Computer Interaction · Computer Science 2023-03-21 Yunlong Wang , Shuyuan Shen , Brian Y. Lim

With the advancement of neural generative capabilities, the art community has actively embraced GenAI (generative artificial intelligence) for creating painterly content. Large text-to-image models can quickly generate aesthetically…

Artificial Intelligence · Computer Science 2024-02-12 Aven-Le Zhou , Yu-Ao Wang , Wei Wu , Kang Zhang

With the advancement of neural generative capabilities, the art community has increasingly embraced GenAI (Generative Artificial Intelligence), particularly large text-to-image models, for producing aesthetically compelling results.…

Human-Computer Interaction · Computer Science 2025-08-26 Aven-Le Zhou , Wei Wu , Yu-Ao Wang , Kang Zhang

During the early stages of interface design, designers need to produce multiple sketches to explore a design space. Design tools often fail to support this critical stage, because they insist on specifying more details than necessary.…

Human-Computer Interaction · Computer Science 2026-03-31 Aryan Garg , Yue Jiang , Antti Oulasvirta

AI is growing increasingly capable of automatically generating user interfaces (GenUI) from user prompts. However, designing GenUI applications that enable users to discover diverse customizations while preserving GenUI's expressiveness…

Human-Computer Interaction · Computer Science 2026-01-27 Bryan Min , Peiling Jiang , Zhicheng Huang , Haijun Xia

As generative AI tools increasingly influence creative practice, they raise longstanding HCI questions about how creatives learn complex software and how they can be better supported. We conducted an interview study with artists and…

Human-Computer Interaction · Computer Science 2026-05-12 Haidan Liu , Isabelle Kwan , Taiga Okuma , Jeffrey Loverock , Nicholas Vincent , Parmit K Chilana

Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper…

Human-Computer Interaction · Computer Science 2024-01-29 Jon McCormack , Maria Teresa Llano , Stephen James Krol , Nina Rajcic

As generative AI (GenAI) systems become increasingly proficient at simulating human-like and well-reasoned text, users may attribute authority to AI outputs, shaping how they engage with writing and reasoning tasks. While prior work has…

Human-Computer Interaction · Computer Science 2026-05-18 Vitor H. A. Welzel , Nicholas Vincent

The abilities of Generative-Artificial Intelligence (AI) to produce real-time, sophisticated responses across diverse contexts has promised a huge potential in physics education, particularly in providing customized feedback. In this study,…

Physics Education · Physics 2025-08-14 Amogh Sirnoorkar , N. Sanjay Rebello

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the…

Artificial Intelligence · Computer Science 2025-04-30 Khoi Trinh , Scott Seidenberger , Raveen Wijewickrama , Murtuza Jadliwala , Anindya Maiti

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow

Prompt engineering is still the primary way for users of generative text-to-image models to manipulate generated images in a targeted way. Based on treating the model as a continuous function and by passing gradients between the image space…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Niklas Deckers , Julia Peters , Martin Potthast

Generative artificial intelligence (GenAI) text-to-image systems are increasingly used to generate architectural imagery, yet their capacity to reproduce accurate images in a historically rule-bound field remains poorly characterized. We…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Jamie Magrill , Leah Gornstein , Sandra Seekins , Barry Magrill

Synthesis of digital artifacts conditioned on user prompts has become an important paradigm facilitating an explosion of use cases with generative AI. However, such models often fail to connect the generated outputs and desired target…

Machine Learning · Computer Science 2026-04-15 Melvin Wong , Yew-Soon Ong , Abhishek Gupta , Kavitesh K. Bali , Caishun Chen

Generative AI (GenAI) has spurred the expectation of being creative, due to its ability to generate content, yet so far, its creativity has somewhat disappointed, because it is trained using existing data following human intentions to…

Artificial Intelligence · Computer Science 2024-05-14 Ming-Hui Huang , Roland T. Rust