English
Related papers

Related papers: Preference-Guided Prompt Optimization for Text-to-…

200 papers

Generative recommendation has recently emerged as a promising paradigm for sequential recommendation. It formulates the task as an autoregressive generation process, predicting tokens of the next item conditioned on user interaction…

Information Retrieval · Computer Science 2026-05-29 Yuanqing Yu , Yifan Wang , Weizhi Ma , Zhiqiang Guo , Min Zhang

The evolution of Text-to-video (T2V) generative models, trained on large-scale datasets, has been marked by significant progress. However, the sensitivity of T2V generative models to input prompts highlights the critical role of prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Bingjie Gao , Xinyu Gao , Xiaoxue Wu , Yujie Zhou , Yu Qiao , Li Niu , Xinyuan Chen , Yaohui Wang

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

Human-Computer Interaction · Computer Science 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

Large language models have demonstrated remarkable capabilities, but their performance is heavily reliant on effective prompt engineering. Automatic prompt optimization (APO) methods are designed to automate this and can be broadly…

Computation and Language · Computer Science 2024-11-08 Xingchen Wan , Ruoxi Sun , Hootan Nakhost , Sercan O. Arik

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes a Prompt Expansion framework that helps users generate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Siddhartha Datta , Alexander Ku , Deepak Ramachandran , Peter Anderson

Prompt design plays a crucial role in text-to-video (T2V) generation, yet user-provided prompts are often short, unstructured, and misaligned with training data, limiting the generative potential of diffusion-based T2V models. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Bingjie Gao , Qianli Ma , Xiaoxue Wu , Shuai Yang , Guanzhou Lan , Haonan Zhao , Jiaxuan Chen , Qingyang Liu , Yu Qiao , Xinyuan Chen , Yaohui Wang , Li Niu

Large Language Models (LLMs) have shown impressive performance as general purpose agents, but their abilities remain highly dependent on prompts which are hand written with onerous trial-and-error effort. We propose a simple and…

Computation and Language · Computer Science 2023-10-20 Reid Pryzant , Dan Iter , Jerry Li , Yin Tat Lee , Chenguang Zhu , Michael Zeng

Prompt engineering has made significant contributions to the era of large language models, yet its effectiveness depends on the skills of a prompt author. This paper introduces $\textit{iPrOp}$, a novel interactive prompt optimization…

Computation and Language · Computer Science 2025-06-30 Jiahui Li , Roman Klinger

Recent advances in large language models have highlighted the critical need for precise control over model outputs through predefined constraints. While existing methods attempt to achieve this through either direct instruction-response…

Computation and Language · Computer Science 2025-03-27 Zhouhong Gu , Xingzhou Chen , Xiaoran Shi , Tao Wang , Suhang Zheng , Tianyu Li , Hongwei Feng , Yanghua Xiao

Text-to-image models are enabling efficient design space exploration, rapidly generating images from text prompts. However, many generative AI tools are imperfect for product design applications as they are not built for the goals and…

Human-Computer Interaction · Computer Science 2025-01-22 Leah Chong , I-Ping Lo , Jude Rayan , Steven Dow , Faez Ahmed , Ioanna Lykourentzou

Text-to-3D generation automates 3D content creation from textual descriptions, which offers transformative potential across various fields. However, existing methods often struggle to align generated content with human preferences, limiting…

Computation and Language · Computer Science 2025-02-10 Zhenglin Zhou , Xiaobo Xia , Fan Ma , Hehe Fan , Yi Yang , Tat-Seng Chua

Preference learning from human feedback has the ability to align generative models with the needs of end-users. Human feedback is costly and time-consuming to obtain, which creates demand for data-efficient query selection methods. This…

Machine Learning · Computer Science 2026-02-18 Guy Schacht , Ziyad Sheebaelhamd , Riccardo De Santi , Mojmír Mutný , Andreas Krause

Optimization is fundamental across numerous disciplines, typically following an iterative process of refining an initial solution to enhance performance. This principle is equally critical in prompt engineering, where designing effective…

Artificial Intelligence · Computer Science 2026-01-07 Dongyu Chen , Jian Ma , Xianpeng Zhang , Lei Zhang , Haonan Lu , Chen Chen , Chuangchuang Wang , Kai Tang

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often…

Multiagent Systems · Computer Science 2025-09-25 Dawei Xiang , Wenyan Xu , Kexin Chu , Tianqi Ding , Zixu Shen , Yiming Zeng , Jianchang Su , Wei Zhang

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

How emotions are expressed depends on the context and domain. On X (formerly Twitter), for instance, an author might simply use the hashtag #anger, while in a news headline, emotions are typically written in a more polite, indirect manner.…

Computation and Language · Computer Science 2024-12-18 Yarik Menchaca Resendiz , Roman Klinger

Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present Twin-Co, a framework…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianhui Wang , Yangfan He , Yan Zhong , Xinyuan Song , Jiayi Su , Yuheng Feng , Ruoyu Wang , Hongyang He , Wenyu Zhu , Xinhang Yuan , Miao Zhang , Keqin Li , Jiaqi Chen , Tianyu Shi , Xueqian Wang

Prompting is fundamental to unlocking the full potential of large language models. To automate and enhance this process, automatic prompt optimization (APO) has been developed, demonstrating effectiveness primarily in text-only input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qipeng Zhu , Yanzhe Chen , Huasong Zhong , Yan Li , Jie Chen , Zhixin Zhang , Junping Zhang , Zhenheng Yang

Large language models (LLMs) have achieved great success across diverse tasks, and fine-tuning is sometimes needed to further enhance generation quality. Most existing methods rely on human supervision or parameter retraining, both of which…

Computation and Language · Computer Science 2025-05-27 Zhen-Yu Zhang , Jiandong Zhang , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Text-to-image generative models, specifically those based on diffusion models like Imagen and Stable Diffusion, have made substantial advancements. Recently, there has been a surge of interest in the delicate refinement of text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen , Qing Yang