English
Related papers

Related papers: Exploring Visual Prompts: Refining Images with Scr…

200 papers

The evidence on the effects of generative AI (GenAI) on critical thinking is mixed, with studies suggesting both potential harms and benefits depending on its implementation. Some argue that AI-driven provocations, such as questions asking…

Human-Computer Interaction · Computer Science 2026-03-23 Thomas Şerban von Davier , Hao-Ping Lee , Jodi Forlizzi , Sauvik Das

This pictorial presents an ongoing research programme comprising three practice-based Design Research projects conducted through 2024, exploring the affordances of diffusion-based AI image generation systems, specifically Stable Diffusion.…

Human-Computer Interaction · Computer Science 2024-11-21 Joseph Lindley , Roger Whitham

Text-to-Image models, including Stable Diffusion, have significantly improved in generating images that are highly semantically aligned with the given prompts. However, existing models may fail to produce appropriate images for the cultural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Suchae Jeong , Inseong Choi , Youngsik Yun , Jihie Kim

Creative writing is a deeply human craft, yet AI systems using large language models (LLMs) offer the automation of significant parts of the writing process. So why do some creative writers choose to use AI? Through interviews and observed…

Human-Computer Interaction · Computer Science 2025-06-12 Alicia Guo , Shreya Sathyanarayanan , Leijie Wang , Jeffrey Heer , Amy Zhang

This paper aims to explore a generative approach for knowledge-based design ideation by applying the latest pre-trained language models in artificial intelligence (AI). Specifically, a method of fine-tuning the generative pre-trained…

Computation and Language · Computer Science 2022-04-21 Qihao Zhu , Jianxi Luo

As generative AI (GenAI) tools become easily accessible, there is promise in using such tools to support instructors. To that end, this paper examines using GenAI to help generate slides from instructor authored course notes, emphasizing…

Artificial Intelligence · Computer Science 2026-05-14 Juho Leinonen , Lisa Zhang , Arto Hellas

While generative artificial intelligence (GenAI) is finding increased adoption in workplaces, current tools are primarily designed for individual use. Prior work established the potential for these tools to enhance personal creativity and…

Human-Computer Interaction · Computer Science 2026-02-25 Janet G. Johnson , Macarena Peralta , Mansanjam Kaur , Ruijie Sophia Huang , Sheng Zhao , Ruijia Guan , Shwetha Rajaram , Michael Nebeling

Propelled by their remarkable capabilities to generate novel and engaging content, Generative Artificial Intelligence (GenAI) technologies are disrupting traditional workflows in many industries. While prior research has examined GenAI from…

Human-Computer Interaction · Computer Science 2024-04-08 Yuan Sun , Eunchae Jang , Fenglong Ma , Ting Wang

The strength of modern generative models lies in their ability to be controlled through text-based prompts. Typical "hard" prompts are made from interpretable words and tokens, and must be hand-crafted by humans. There are also "soft"…

Machine Learning · Computer Science 2023-06-02 Yuxin Wen , Neel Jain , John Kirchenbauer , Micah Goldblum , Jonas Geiping , Tom Goldstein

Deep neural networks (DNNs) have demonstrated exceptional performance across various image segmentation tasks. However, the process of preparing datasets for training segmentation DNNs is both labor-intensive and costly, as it typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yixin Zhang , Shen Zhao , Hanxue Gu , Maciej A. Mazurowski

Design mockups are essential instruments for visualizing and testing design ideas. However, the process of generating mockups can be time-consuming and challenging for designers. In this article, we present and evaluate two different…

Human-Computer Interaction · Computer Science 2023-03-23 Tommaso Calò , Luigi De Russis

While designers increasingly leverage Generative AI for divergent exploration, current interaction is optimized for convergent refinement, forcing users to specify fixed targets rather than open-ended search spaces. Based on a formative…

Human-Computer Interaction · Computer Science 2026-05-12 DaEun Choi , Kihoon Son , Jaesang Yu , Hyunjoon Jung , Juho Kim

Image generation using generative artificial intelligence has become a popular activity. However, text-to-image generation - where images are produced from typed prompts - can be less engaging in public settings since the act of typing…

Human-Computer Interaction · Computer Science 2025-02-18 Jonas Oppenlaender , Hannah Johnston , Johanna Silvennoinen , Helena Barranha

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Yuan Xue , Yuan-Chen Guo , Han Zhang , Tao Xu , Song-Hai Zhang , Xiaolei Huang

Graphic designers often get inspiration through the recombination of references. Our formative study (N=6) reveals that graphic designers focus on conceptual keywords during this process, and want support for discovering the keywords,…

Human-Computer Interaction · Computer Science 2024-03-08 DaEun Choi , Sumin Hong , Jeongeon Park , John Joon Young Chung , Juho Kim

Analyzing creative activity traces requires capturing activity at appropriate granularity and interpreting it in ways that reflect the structure of creative practice. However, existing approaches record state changes without preserving the…

Human-Computer Interaction · Computer Science 2026-03-10 Xiaohan Peng , Sotiris Piliouras , Carl Abou Saada Nujaim

Cognitive augmentation is a cornerstone in advancing education, particularly through personalized learning. However, personalizing extensive textual materials, such as narratives and academic textbooks, remains challenging due to their…

Human-Computer Interaction · Computer Science 2025-03-11 Ryugo Morita , Ko Watanabe , Jinjia Zhou , Andreas Dengel , Shoya Ishimaru

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak

Generative user interfaces (UIs) create new opportunities to adapt interfaces to individual users on demand, but personalization remains difficult because desirable UI properties are subjective, hard to articulate, and costly to infer from…

Machine Learning · Computer Science 2026-04-14 Yi-Hao Peng , Samarth Das , Jeffrey P. Bigham , Jason Wu

Recent Generative Artificial Intelligence (GenAI) trends focus on various applications, including creating stories, illustrations, poems, articles, computer code, music compositions, and videos. Extrinsic hallucinations are a critical…

Machine Learning · Computer Science 2024-01-24 Krishna Ronanki , Beatriz Cabrero-Daniel , Christian Berger