English
Related papers

Related papers: InstantBooth: Personalized Text-to-Image Generatio…

200 papers

Diffusion models have demonstrated remarkable efficacy across various image-to-image tasks. In this research, we introduce Imagine yourself, a state-of-the-art model designed for personalized image generation. Unlike conventional…

Recent text-to-image generation models like DreamBooth have made remarkable progress in generating highly customized images of a target subject, by fine-tuning an ``expert model'' for a given subject from a few examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Wenhu Chen , Hexiang Hu , Yandong Li , Nataniel Ruiz , Xuhui Jia , Ming-Wei Chang , William W. Cohen

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , Ilya Sutskever

Fine-tuning facilitates the adaptation of text-to-image generative models to novel concepts (e.g., styles and portraits), empowering users to forge creatively customized content. Recent efforts on fine-tuning focus on reducing training data…

Human-Computer Interaction · Computer Science 2024-01-30 Xingchen Zeng , Ziyao Gao , Yilin Ye , Wei Zeng

This paper proposes a method for generating images of customized objects specified by users. The method is based on a general framework that bypasses the lengthy optimization required by previous approaches, which often employ a per-object…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Xuhui Jia , Yang Zhao , Kelvin C. K. Chan , Yandong Li , Han Zhang , Boqing Gong , Tingbo Hou , Huisheng Wang , Yu-Chuan Su

Text-to-image (T2I) diffusion models have shown significant success in personalized text-to-image generation, which aims to generate novel images with human identities indicated by the reference images. Despite promising identity fidelity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hongzhi Zhang , Lei Zhang , Wangmeng Zuo

Diffusion models excel at text-to-image generation, especially in subject-driven generation for personalized images. However, existing methods are inefficient due to the subject-specific fine-tuning, which is computationally intensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Guangxuan Xiao , Tianwei Yin , William T. Freeman , Frédo Durand , Song Han

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi

Diffusion models have demonstrated impressive image generation capabilities. Personalized approaches, such as textual inversion and Dreambooth, enhance model individualization using specific images. These methods enable generating images of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yan Zeng , Masanori Suganuma , Takayuki Okatani

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

We present OmniBooth, an image generation framework that enables spatial control with instance-level multi-modal customization. For all instances, the multimodal instruction can be described through text prompts or image references. Given a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Leheng Li , Weichao Qiu , Xu Yan , Jing He , Kaiqiang Zhou , Yingjie Cai , Qing Lian , Bingbing Liu , Ying-Cong Chen

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Personalized text-to-image generation aims to synthesize images of user-provided concepts in diverse contexts. Despite recent progress in multi-concept personalization, most are limited to object concepts and struggle to customize abstract…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Weizhi Zhong , Huan Yang , Zheng Liu , Huiguo He , Zijian He , Xuesong Niu , Di Zhang , Guanbin Li

Despite the recent progress in text-to-video generation, existing studies usually overlook the issue that only spatial contents but not temporal motions in synthesized videos are under the control of text. Towards such a challenge, this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Xi Chen , Zhiheng Liu , Mengting Chen , Yutong Feng , Yu Liu , Yujun Shen , Hengshuang Zhao

Given an original image, image editing aims to generate an image that align with the provided instruction. The challenges are to accept multimodal inputs as instructions and a scarcity of high-quality training data, including crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhen Han , Chaojie Mao , Zeyinzi Jiang , Yulin Pan , Jingfeng Zhang

Integrating multiple personalized concepts into a single image has recently gained attention in text-to-image (T2I) generation. However, existing methods often suffer from performance degradation in complex scenes due to distortions in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Young Beom Woo , Sun Eung Kim , Seong-Whan Lee

Text-to-image models offer unprecedented freedom to guide creation through natural language. Yet, it is unclear how such freedom can be exercised to generate images of specific unique concepts, modify their appearance, or compose them in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Rinon Gal , Yuval Alaluf , Yuval Atzmon , Or Patashnik , Amit H. Bermano , Gal Chechik , Daniel Cohen-Or

Recent diffusion-based text-to-image customization methods have achieved significant success in understanding concrete concepts to control generation processes, such as styles and shapes. However, few efforts dive into the realistic yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fan Wu , Cheng Chen , Zhoujie Fu , Jiacheng Wei , Yi Xu , Deheng Ye , Guosheng Lin

Personalized image generation with text-to-image diffusion models generates unseen images based on reference image content. Zero-shot adapter methods such as IP-Adapter and OminiControl are especially interesting because they do not require…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Qiyuan He , Angela Yao