English
Related papers

Related papers: Adaptive Prompt Elicitation for Text-to-Image Gene…

200 papers

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

Human-Computer Interaction · Computer Science 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Prompting LLMs offers an efficient way to guide output generation without explicit model training. In the e-commerce domain, prompting-based applications are widely used for tasks such as query understanding, recommender systems, and…

Computation and Language · Computer Science 2025-03-19 Jingying Zeng , Zhenwei Dai , Hui Liu , Samarth Varshney , Zhiji Liu , Chen Luo , Zhen Li , Qi He , Xianfeng Tang

State-of-the-art neural language models can now be used to solve ad-hoc language tasks through zero-shot prompting without the need for supervised training. This approach has gained popularity in recent years, and researchers have…

Computation and Language · Computer Science 2022-08-17 Hendrik Strobelt , Albert Webson , Victor Sanh , Benjamin Hoover , Johanna Beyer , Hanspeter Pfister , Alexander M. Rush

Image generation using generative artificial intelligence has become a popular activity. However, text-to-image generation - where images are produced from typed prompts - can be less engaging in public settings since the act of typing…

Human-Computer Interaction · Computer Science 2025-02-18 Jonas Oppenlaender , Hannah Johnston , Johanna Silvennoinen , Helena Barranha

Despite the progress in text-to-image generation, semantic image editing remains a challenge. Inversion-based algorithms unavoidably introduce reconstruction errors, while instruction-based models mainly suffer from limited dataset quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 En Ci , Shanyan Guan , Yanhao Ge , Yilin Zhang , Wei Li , Zhenyu Zhang , Jian Yang , Ying Tai

Generative AI models offer many possibilities for text creation and transformation. Current graphical user interfaces (GUIs) for prompting them lack support for iterative exploration, as they do not represent prompts as actionable interface…

Human-Computer Interaction · Computer Science 2025-03-28 Rifat Mehreen Amin , Oliver Hans Kühle , Daniel Buschek , Andreas Butz

Pre-trained Vision-Language (V-L) models set the benchmark for generalization to downstream tasks among the noteworthy contenders. Many characteristics of the V-L model have been explored in existing research including the challenge of the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Guiming Cao , Kaize Shi , Hong Fu , Huaiwen Zhang , Guandong Xu

Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present Twin-Co, a framework…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianhui Wang , Yangfan He , Yan Zhong , Xinyuan Song , Jiayi Su , Yuheng Feng , Ruoyu Wang , Hongyang He , Wenyu Zhu , Xinhang Yuan , Miao Zhang , Keqin Li , Jiaqi Chen , Tianyu Shi , Xueqian Wang

Conceptual architecture involves a highly creative exploration of novel ideas, often taken from other disciplines as architects consider radical new forms, materials, textures and colors for buildings. While today's generative AI systems…

Neural and Evolutionary Computing · Computer Science 2024-04-03 Soo Ling Lim , Peter J Bentley , Fuyuki Ishikawa

Generating high-fidelity images of humans with fine-grained control over attributes such as hairstyle and clothing remains a core challenge in personalized text-to-image synthesis. While prior methods emphasize identity preservation from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Guocheng Gordon Qian , Daniil Ostashev , Egor Nemchinov , Avihay Assouline , Sergey Tulyakov , Kuan-Chieh Jackson Wang , Kfir Aberman

Achieving precise alignment between user intent and generated visuals remains a central challenge in text-to-visual generation, as a single attempt often fails to produce the desired output. To handle this, prior approaches mainly scale the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Subin Kim , Sangwoo Mo , Mamshad Nayeem Rizve , Yiran Xu , Difan Liu , Jinwoo Shin , Tobias Hinz

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

Conditional generative models such as DALL-E and Stable Diffusion generate images based on a user-defined text, the prompt. Finding and refining prompts that produce a desired image has become the art of prompt engineering. Generative…

Information Retrieval · Computer Science 2023-01-24 Niklas Deckers , Maik Fröbe , Johannes Kiesel , Gianluca Pandolfo , Christopher Schröder , Benno Stein , Martin Potthast

The evolution of prompt learning methodologies has driven exploration of deeper prompt designs to enhance model performance. However, current deep text prompting approaches suffer from two critical limitations: Over-reliance on constrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Qiqi Zhan , Shiwei Li , Qingjie Liu , Yunhong Wang

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the…

Artificial Intelligence · Computer Science 2025-04-30 Khoi Trinh , Scott Seidenberger , Raveen Wijewickrama , Murtuza Jadliwala , Anindya Maiti

Despite substantial progress in text-to-image generation, achieving precise text-image alignment remains challenging, particularly for prompts with rich compositional structure or imaginative elements. To address this, we introduce Negative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Sangha Park , Eunji Kim , Yeongtak Oh , Jooyoung Choi , Sungroh Yoon

Generative AI often produces results misaligned with user intentions, for example, resolving ambiguous prompts in unexpected ways. Despite existing approaches to clarify intent, a major challenge remains: understanding and influencing AI's…

Human-Computer Interaction · Computer Science 2026-02-10 Lena Hegemann , Xinyi Wen , Michael A. Hedderich , Tarmo Nurmi , Hariharan Subramonyam

Text-to-image (T2I) diffusion models have demonstrated impressive capabilities in generating high-quality images given a text prompt. However, ensuring the prompt-image alignment remains a considerable challenge, i.e., generating images…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Liyao Jiang , Negar Hassanpour , Mohammad Salameh , Mohan Sai Singamsetti , Fengyu Sun , Wei Lu , Di Niu

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei