English
Related papers

Related papers: Adaptive Prompt Elicitation for Text-to-Image Gene…

200 papers

TIPO (Text-to-Image Prompt Optimization) introduces an efficient approach for automatic prompt refinement in text-to-image (T2I) generation. Starting from simple user prompts, TIPO leverages a lightweight pre-trained model to expand these…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shih-Ying Yeh , Yi Li , Sang-Hyun Park , Giyeong Oh , Xuehai Wang , Min Song , Youngjae Yu , Shang-Hong Lai

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

By conditioning on natural language instructions, large language models (LLMs) have displayed impressive capabilities as general-purpose computers. However, task performance depends significantly on the quality of the prompt used to steer…

Machine Learning · Computer Science 2023-03-13 Yongchao Zhou , Andrei Ioan Muresanu , Ziwen Han , Keiran Paster , Silviu Pitis , Harris Chan , Jimmy Ba

Vision foundation models have been explored recently to build general-purpose vision systems. However, predominant paradigms, driven by casting instance-level tasks as an object-word alignment, bring heavy cross-modality interaction, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunhang Shen , Chaoyou Fu , Peixian Chen , Mengdan Zhang , Ke Li , Xing Sun , Yunsheng Wu , Shaohui Lin , Rongrong Ji

As generative AI systems rapidly improve, a key question emerges: how do users adapt to these changes, and when does such adaptation matter for realizing performance gains? Drawing on theories of dynamic capabilities and IT complements, we…

Human-Computer Interaction · Computer Science 2026-01-08 Eaman Jahani , Benjamin S. Manning , Joe Zhang , Hong-Yi TuYe , Mohammed Alsobay , Christos Nicolaides , Siddharth Suri , David Holtz

Synthesis of digital artifacts conditioned on user prompts has become an important paradigm facilitating an explosion of use cases with generative AI. However, such models often fail to connect the generated outputs and desired target…

Machine Learning · Computer Science 2026-04-15 Melvin Wong , Yew-Soon Ong , Abhishek Gupta , Kavitesh K. Bali , Caishun Chen

Prompt engineering is crucial for achieving reliable and effective outputs from large language models (LLMs), but its design requires specialized knowledge of prompting techniques and a deep understanding of target tasks. To address this…

Computation and Language · Computer Science 2025-10-22 Yohei Ikenoue , Hitomi Tashiro , Shigeru Kuroyanagi

The emergence of generative AI (GenAI) models, including large language models and text-to-image models, has significantly advanced the synergy between humans and AI with not only their outstanding capability but more importantly, the…

Human-Computer Interaction · Computer Science 2025-03-05 Leixian Shen , Haotian Li , Yifang Wang , Xing Xie , Huamin Qu

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

Recent technological advances popularized the use of image generation among the general public. Crafting effective prompts can, however, be difficult for novice users. To tackle this challenge, we developed PromptMap, a new interaction…

Human-Computer Interaction · Computer Science 2025-04-04 Krzysztof Adamkiewicz , Paweł W. Woźniak , Julia Dominiak , Andrzej Romanowski , Jakob Karolus , Stanislav Frolov

Recent text-to-image (T2I) generation models have advanced significantly, enabling the creation of high-fidelity images from textual prompts. However, existing evaluation benchmarks primarily focus on the explicit alignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Wenchao Zhang , Jiahe Tian , Runze He , Jizhong Han , Jiao Dai , Miaomiao Feng , Wei Mi , Xiaodan Zhang

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Mingrui Wu , Lu Wang , Pu Zhao , Fangkai Yang , Jianjin Zhang , Jianfeng Liu , Yuefeng Zhan , Weihao Han , Hao Sun , Jiayi Ji , Xiaoshuai Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang , Rongrong Ji

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Recent text-to-image (T2I) diffusion models achieve remarkable realism, yet faithful prompt-image alignment remains challenging, particularly for complex prompts with multiple objects, relations, and fine-grained attributes. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Liyao Jiang , Ruichen Chen , Chao Gao , Di Niu

AI coding assistants are reshaping software development by shifting focus from writing code to formulating prompts. In chat-focused approaches such as vibe coding, prompts become the primary arbiter between human intent and executable…

Software Engineering · Computer Science 2026-03-18 Shalini Chakraborty , Jan-Philipp Steghöfer

Generative AI models have shown impressive ability to produce images with text prompts, which could benefit creativity in visual art creation and self-expression. However, it is unclear how precisely the generated images express contexts…

Human-Computer Interaction · Computer Science 2023-03-21 Yunlong Wang , Shuyuan Shen , Brian Y. Lim

With the advancement of neural generative capabilities, the art community has increasingly embraced GenAI (Generative Artificial Intelligence), particularly large text-to-image models, for producing aesthetically compelling results.…

Human-Computer Interaction · Computer Science 2025-08-26 Aven-Le Zhou , Wei Wu , Yu-Ao Wang , Kang Zhang

In the past year, large language models (LLMs) have had remarkable success in domains outside the traditional natural language processing, and their capacity is further expanded into the so-called LLM agents when connected with external…

Computation and Language · Computer Science 2025-02-17 Weizhe Chen , Sven Koenig , Bistra Dilkina

Text-to-Image models, including Stable Diffusion, have significantly improved in generating images that are highly semantically aligned with the given prompts. However, existing models may fail to produce appropriate images for the cultural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Suchae Jeong , Inseong Choi , Youngsik Yun , Jihie Kim