English
Related papers

Related papers: Brickify: Enabling Expressive Design Intent Specif…

200 papers

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow

Aligning text-to-image generation with user intent remains challenging, as users frequently provide ambiguous inputs and struggle with model idiosyncrasies. We propose Adaptive Prompt Elicitation (APE), a technique that adaptively poses…

Human-Computer Interaction · Computer Science 2026-04-22 Xinyi Wen , Lena Hegemann , Xiaofu Jin , Shuai Ma , Antti Oulasvirta

Recent graphical interfaces offer direct manipulation mechanisms for authoring visualizations, but are largely restricted to static output. To author interactive visualizations, users must instead turn to textual specification; but, such…

Human-Computer Interaction · Computer Science 2020-09-07 Jonathan Zong , Dhiraj Barnwal , Rupayan Neogy , Arvind Satyanarayan

Interior space design significantly influences residents' daily lives. However, the process often presents high barriers and complex reasoning for users, leading to semantic losses in articulating comprehensive requirements and…

Human-Computer Interaction · Computer Science 2024-09-04 Yijiang Liu , Hui Wang

While designers increasingly leverage Generative AI for divergent exploration, current interaction is optimized for convergent refinement, forcing users to specify fixed targets rather than open-ended search spaces. Based on a formative…

Human-Computer Interaction · Computer Science 2026-05-12 DaEun Choi , Kihoon Son , Jaesang Yu , Hyunjoon Jung , Juho Kim

We propose a new technique based on program synthesis for automatically generating visualizations from natural language queries. Our method parses the natural language query into a refinement type specification using the intents-and-slots…

Programming Languages · Computer Science 2022-09-05 Qiaochu Chen , Shankara Pailoor , Celeste Barnaby , Abby Criswell , Chenglong Wang , Greg Durrett , Isil Dillig

Intent modeling has attracted widespread attention in recommender systems. As the core motivation behind user selection of items, intent is crucial for elucidating recommendation results. The current mainstream modeling method is to…

Information Retrieval · Computer Science 2024-05-16 Yi Zhang , Lei Sang , Yiwen Zhang

The replication of object stiffness is essential for enhancing haptic feedback in virtual environments. However, existing research has overlooked how stylus stiffness influences the perception of virtual object stiffness during…

Human-Computer Interaction · Computer Science 2025-02-17 Ryoya Komatsu , Ayumu Ogura , Shigeo Yoshida , Kazutoshi Tanaka , Yuichi Itoh

Current direct modeling systems limit users to low-level interactions with vertices, edges, and faces, forcing designers to manage detailed geometric elements rather than focusing on high-level design intent. This paper introduces semantic…

Human-Computer Interaction · Computer Science 2025-04-22 Qiang Zou , Shuo Liu

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

Human-Computer Interaction · Computer Science 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily…

Human-Computer Interaction · Computer Science 2025-04-09 Hyerim Park , Malin Eiband , Andre Luckow , Michael Sedlmair

The emergence of generative AI (GenAI) models, including large language models and text-to-image models, has significantly advanced the synergy between humans and AI with not only their outstanding capability but more importantly, the…

Human-Computer Interaction · Computer Science 2025-03-05 Leixian Shen , Haotian Li , Yifang Wang , Xing Xie , Huamin Qu

Image generation using generative artificial intelligence has become a popular activity. However, text-to-image generation - where images are produced from typed prompts - can be less engaging in public settings since the act of typing…

Human-Computer Interaction · Computer Science 2025-02-18 Jonas Oppenlaender , Hannah Johnston , Johanna Silvennoinen , Helena Barranha

Intent-Based Networking (IBN) aims to simplify network management by enabling users to specify high-level goals that drive automated network design and configuration. However, translating informal natural-language intents into formally…

Networking and Internet Architecture · Computer Science 2025-09-30 Anis Bekri , Amar Abane , Abdella Battou , Saddek Bensalem

Creating stylized visualization requires going beyond the limited, abstract, geometric marks produced by most tools. Rather, the designer builds stylized idioms where the marks are both transformed (e.g., photographs of candles instead of…

Human-Computer Interaction · Computer Science 2023-04-05 Jiaqi Wu , John Joon Young Chung , Eytan Adar

During the early stages of interface design, designers need to produce multiple sketches to explore a design space. Design tools often fail to support this critical stage, because they insist on specifying more details than necessary.…

Human-Computer Interaction · Computer Science 2026-03-31 Aryan Garg , Yue Jiang , Antti Oulasvirta

Diversity in image generation is essential to ensure fair representations and support creativity in ideation. Hence, many text-to-image models have implemented diversification mechanisms. Yet, after a few iterations of generation, a lack of…

Human-Computer Interaction · Computer Science 2025-06-25 M. Michelessa , J. Ng , C. Hurter , B. Y. Lim

Design is a non-linear, reflective process in which practitioners engage with visual, semantic, and other expressive materials to explore, iterate, and refine ideas. As Generative AI (GenAI) becomes integrated into professional design…

Human-Computer Interaction · Computer Science 2026-03-04 Xiaohan Peng , Wendy E. Mackay , Janin Koch

Recent advances in Machine-Learning have led to the development of models that generate images based on a text description.Such large prompt-based text to image models (TTIs), trained on a considerable amount of data, allow the creation of…

Human-Computer Interaction · Computer Science 2023-03-23 Chinmay Kulkarni , Stefania Druga , Minsuk Chang , Alex Fiannaca , Carrie Cai , Michael Terry

Interactive visualization can support fluid exploration but is often limited to predetermined tasks. Scripting can support a vast range of queries but may be more cumbersome for free-form exploration. Embedding interactive visualization in…