English
Related papers

Related papers: Composable Prompting Workspaces for Creative Writi…

200 papers

Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such technologies…

Human-Computer Interaction · Computer Science 2023-03-17 Nanna Inie , Jeanette Falk , Steven Tanimoto

Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper…

Human-Computer Interaction · Computer Science 2024-01-29 Jon McCormack , Maria Teresa Llano , Stephen James Krol , Nina Rajcic

Prompt learning is an effective paradigm that bridges gaps between the pre-training tasks and the corresponding downstream applications. Approaches based on this paradigm have achieved great transcendent results in various applications.…

Information Retrieval · Computer Science 2022-09-26 Zhigang Kan , Linhui Feng , Zhangyue Yin , Linbo Qiao , Xipeng Qiu , Dongsheng Li

Neural language models have the potential to support human writing. However, questions remain on their integration and influence on writing and output. To address this, we designed and compared two user interfaces for writing with AI on…

Human-Computer Interaction · Computer Science 2022-08-02 Florian Lehmann , Niklas Markert , Hai Dang , Daniel Buschek

AI Advancements have augmented casual writing and story generation, but their usage poses challenges in collaborative storytelling. In role-playing games such as Dungeons & Dragons (D&D), composing prompts using generative AI requires a…

Human-Computer Interaction · Computer Science 2023-04-05 Jose Ma. Santiago , Richard Lance Parayno , Jordan Aiko Deja , Briane Paul V. Samson

While generative models have become powerful tools for image synthesis, they are typically optimized for executing carefully crafted textual prompts, offering limited support for the open-ended visual exploration that often precedes idea…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kfir Goldberg , Elad Richardson , Yael Vinker

Aligning text-to-image generation with user intent remains challenging, as users frequently provide ambiguous inputs and struggle with model idiosyncrasies. We propose Adaptive Prompt Elicitation (APE), a technique that adaptively poses…

Human-Computer Interaction · Computer Science 2026-04-22 Xinyi Wen , Lena Hegemann , Xiaofu Jin , Shuai Ma , Antti Oulasvirta

This workshop paper presents a critical examination of the integration of Generative AI (Gen AI) into the academic writing process, focusing on the use of AI as a collaborative tool. It contrasts the performance and interaction of two AI…

Human-Computer Interaction · Computer Science 2024-04-26 Joseph Tu , Hilda Hadan , Derrick M. Wang , Sabrina A Sgandurra , Reza Hadi Mogavi , Lennart E. Nacke

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Text-to-image generation model is able to generate images across a diverse range of subjects and styles based on a single prompt. Recent works have proposed a variety of interaction methods that help users understand the capabilities of…

Human-Computer Interaction · Computer Science 2023-07-19 Seungho Baek , Hyerin Im , Jiseung Ryu , Juhyeong Park , Takyeon Lee

Complex data analysis inherently seeks unexpected insights through exploratory visual analysis methods, transcending logical, step-by-step processing. However, existing interfaces such as notebooks and dashboards have limitations in…

Human-Computer Interaction · Computer Science 2024-03-22 Zijian Ding , Joel Chan

Since its introduction in 2022, Generative AI has significantly impacted the art world, from winning state art fairs to creating complex videos from simple prompts. Amid this renaissance, a pivotal issue emerges: should users of Generative…

Computers and Society · Computer Science 2024-06-19 Yiyang Mei

While large-scale pretrained language models have significantly improved writing assistance functionalities such as autocomplete, more complex and controllable writing assistants have yet to be explored. We leverage advances in language…

Computation and Language · Computer Science 2021-09-21 Simeng Sun , Wenlong Zhao , Varun Manjunatha , Rajiv Jain , Vlad Morariu , Franck Dernoncourt , Balaji Vasan Srinivasan , Mohit Iyyer

Despite Generative AI (GenAI) systems' potential for enhancing content creation, users often struggle to effectively integrate GenAI into their creative workflows. Core challenges include misalignment of AI-generated content with user…

This paper presents a novel conversational AI-enabled active ideation interface as a creative idea-generation tool to assist novice designers in mitigating the initial latency and ideation bottlenecks that are commonly observed. It is a…

Human-Computer Interaction · Computer Science 2025-04-16 B. Sankar , Dibakar Sen

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

Natural language descriptions of user interface (UI) elements such as alternative text are crucial for accessibility and language-based interaction in general. Yet, these descriptions are constantly missing in mobile UIs. We propose widget…

Machine Learning · Computer Science 2020-10-12 Yang Li , Gang Li , Luheng He , Jingjie Zheng , Hong Li , Zhiwei Guan

In the current study,we propose that, in the era of generative AI, there is now a new form of literacy called "prompt literacy," which refers to the ability to generate precise prompts as input for AI systems, interpret the outputs, and…

Human-Computer Interaction · Computer Science 2023-11-10 Yohan Hwang , Jang Ho Lee , Dongkwang Shin

Authoring realistic haptic textures typically requires low-level parameter tuning and repeated trial-and-error, limiting speed, transparency, and creative reach. We present a language-driven authoring system that turns natural-language…

Human-Computer Interaction · Computer Science 2026-04-09 Wanli Qian , Aiden Chang , Shihan Lu , Michael Gu , Heather Culbertson

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker