English
Related papers

Related papers: IP-Prompter: Training-Free Theme-Specific Image Ge…

200 papers

In the realm of image generation, creating customized images from visual prompt with additional textual instruction emerges as a promising endeavor. However, existing methods, both tuning-based and tuning-free, struggle with interpreting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jing He , Haodong Li , Yongzhe Hu , Guibao Shen , Yingjie Cai , Weichao Qiu , Ying-Cong Chen

Recent text-to-image generation models like DreamBooth have made remarkable progress in generating highly customized images of a target subject, by fine-tuning an ``expert model'' for a given subject from a few examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Wenhu Chen , Hexiang Hu , Yandong Li , Nataniel Ruiz , Xuhui Jia , Ming-Wei Chang , William W. Cohen

We introduce a method for composing object-level visual prompts within a text-to-image diffusion model. Our approach addresses the task of generating semantically coherent compositions across diverse scenes and styles, similar to the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Gaurav Parmar , Or Patashnik , Kuan-Chieh Wang , Daniil Ostashev , Srinivasa Narasimhan , Jun-Yan Zhu , Daniel Cohen-Or , Kfir Aberman

Although Multimodal Large Language Models (MLLMs) have demonstrated promising versatile capabilities, their performance is still inferior to specialized models on downstream tasks, which makes adaptation necessary to enhance their utility.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yichi Zhang , Yinpeng Dong , Siyuan Zhang , Tianzan Min , Hang Su , Jun Zhu

Personalizing diffusion models allows users to generate new images that incorporate a given subject, allowing more control than a text prompt. These models often suffer somewhat when they end up just recreating the subject image and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 James Baker

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

For text-to-image generation, automatically refining user-provided natural language prompts into the keyword-enriched prompts favored by systems is essential for the user experience. Such a prompt refinement process is analogous to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Yingwei Pan , Ting Yao , Jiaxin Mao , Shaoping Ma , Tao Mei

Recent advances in text-to-image generation models have unlocked vast potential for visual creativity. However, the users that use these models struggle with the generation of consistent characters, a crucial aspect for numerous real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Omri Avrahami , Amir Hertz , Yael Vinker , Moab Arar , Shlomi Fruchter , Ohad Fried , Daniel Cohen-Or , Dani Lischinski

The integration of generative artificial intelligence (AI) into architectural design has advanced significantly, enabling the generation of text, images, and 3D models. However, prior AI applications lack support for text-to-parametric…

Human-Computer Interaction · Computer Science 2025-05-20 Guangxi Feng , Wei Yan

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often…

Multiagent Systems · Computer Science 2025-09-25 Dawei Xiang , Wenyan Xu , Kexin Chu , Tianqi Ding , Zixu Shen , Yiming Zeng , Jianchang Su , Wei Zhang

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Text-to-image generative models often present issues regarding fairness with respect to certain sensitive attributes, such as gender or skin tone. This study aims to reproduce the results presented in "ITI-GEN: Inclusive Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Daniel Gallo Fernández , Răzvan-Andrei Matisan , Alejandro Monroy Muñoz , Janusz Partyka

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Customized image generation, which seeks to synthesize images with consistent characters, holds significant relevance for applications such as storytelling, portrait generation, and character design. However, previous approaches have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yuhang Ma , Wenting Xu , Jiji Tang , Qinfeng Jin , Rongsheng Zhang , Zeng Zhao , Changjie Fan , Zhipeng Hu

Textual Inversion (TI) is an efficient approach to text-to-image personalization but often fails on complex prompts. We trace these failures to embedding norm inflation: learned tokens drift to out-of-distribution magnitudes, degrading…

Machine Learning · Computer Science 2026-03-11 Kunhee Kim , NaHyeon Park , Kibeom Hong , Hyunjung Shim

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Shounak Chatterjee

We present Infinite-Story, a training-free framework for consistent text-to-image (T2I) generation tailored for multi-prompt storytelling scenarios. Built upon a scale-wise autoregressive model, our method addresses two key challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jihun Park , Kyoungmin Lee , Jongmin Gim , Hyeonseo Jo , Minseok Oh , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Minwoo Choi , Sunghoon Im

The diversity, quantity, and quality of manipulation data are critical for training effective robot policies. However, due to hardware and physical setup constraints, collecting large-scale real-world manipulation data remains difficult to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Boyang Wang , Haoran Zhang , Shujie Zhang , Jinkun Hao , Mingda Jia , Qi Lv , Yucheng Mao , Zhaoyang Lyu , Jia Zeng , Xudong Xu , Jiangmiao Pang

Open-world object counting leverages the robust text-image alignment of pre-trained vision-language models (VLMs) to enable counting of arbitrary categories in images specified by textual queries. However, widely adopted naive fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Yiming Zhao , Guorong Li , Laiyun Qing , Amin Beheshti , Jian Yang , Michael Sheng , Yuankai Qi , Qingming Huang