English
Related papers

Related papers: Identity Decoupling for Multi-Subject Personalizat…

200 papers

Recent text-to-image diffusion models have demonstrated remarkable generation of realistic facial images conditioned on textual prompts and human identities, enabling creating personalized facial imagery. However, existing prompt-based…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Han-Wei Kung , Tuomas Varanka , Nicu Sebe

Most text-to-image customization techniques fine-tune models on a small set of \emph{personal concept} images captured in minimal contexts. This often results in the model becoming overfitted to these training images and unable to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Taewook Kim , Wei Chen , Qiang Qiu

Text-to-image diffusion models have made significant progress in generating naturalistic images from textual inputs, and demonstrate the capacity to learn and represent complex visual-semantic relationships. While these diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Rushikesh Zawar , Shaurya Dewan , Prakanshul Saxena , Yingshan Chang , Andrew Luo , Yonatan Bisk

Multi-subject personalized generation presents unique challenges in maintaining identity fidelity and semantic coherence when synthesizing images conditioned on multiple reference subjects. Existing methods often suffer from identity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Dong She , Siming Fu , Mushui Liu , Qiaoqiao Jin , Hualiang Wang , Mu Liu , Jidong Jiang

Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which makes pure…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yiyang Ma , Huan Yang , Wenjing Wang , Jianlong Fu , Jiaying Liu

Generating customized content in videos has received increasing attention recently. However, existing works primarily focus on customized text-to-video generation for single subject, suffering from subject-missing and attribute-binding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hong Chen , Xin Wang , Yipeng Zhang , Yuwei Zhou , Zeyang Zhang , Siao Tang , Wenwu Zhu

Many applications can benefit from personalized image generation models, including image enhancement, video conferences, just to name a few. Existing works achieved personalization by fine-tuning one model for each person. While being…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yu-Chuan Su , Kelvin C. K. Chan , Yandong Li , Yang Zhao , Han Zhang , Boqing Gong , Huisheng Wang , Xuhui Jia

Text-to-image model personalization aims to introduce a user-provided concept to the model, allowing its synthesis in diverse contexts. However, current methods primarily focus on the case of learning a single concept from multiple images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Omri Avrahami , Kfir Aberman , Ohad Fried , Daniel Cohen-Or , Dani Lischinski

Current multi-subject customization approaches encounter two critical challenges: the difficulty in acquiring diverse multi-subject training data, and attribute entanglement across different subjects. To bridge these gaps, we propose MUSAR…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Zinan Guo , Pengze Zhang , Yanze Wu , Chong Mou , Songtao Zhao , Qian He

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

Multi-subject image generation aims to synthesize user-provided subjects in a single image while preserving subject fidelity, ensuring prompt consistency, and aligning with human aesthetic preferences. Existing In-Context-Learning based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tao Wu , Yibo Jiang , Yehao Lu , Zhizhong Wang , Zeyi Huang , Zequn Qin , Xi Li

State-of-the-art text-to-image models suffer from a persistent identity crisis when generating scenes with multiple humans: producing duplicate faces, merging identities, and miscounting individuals. We present DisCo (Reinforcement with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shubhankar Borse , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Subject-driven image generation is increasingly expected to support fine-grained control over multiple entities within a single image. In multi-reference workflows, users may provide several subject images, a background reference, and long,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenqing Tian , Hanyi Mao , Zhaocheng Liu , Lihua Zhang , Qiang Liu , Jian Wu , Liang Wang

Diffusion models have significantly advanced text-to-image generation, laying the foundation for the development of personalized generative frameworks. However, existing methods lack precise layout controllability and overlook the potential…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Wei Li , Hebei Li , Yansong Peng , Siying Wu , Yueyi Zhang , Xiaoyan Sun

Subject-driven text-to-image generation models create novel renditions of an input subject based on text prompts. Existing models suffer from lengthy fine-tuning and difficulties preserving the subject fidelity. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Dongxu Li , Junnan Li , Steven C. H. Hoi

Text-to-image (T2I) diffusion models have shown significant success in personalized text-to-image generation, which aims to generate novel images with human identities indicated by the reference images. Despite promising identity fidelity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hongzhi Zhang , Lei Zhang , Wangmeng Zuo

Employing clustering strategy to assign unlabeled target images with pseudo labels has become a trend for person re-identification (re-ID) algorithms in domain adaptation. A potential limitation of these clustering-based methods is that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Suncheng Xiang , Yuzhuo Fu , Mengyuan Guan , Ting Liu

In the realm of image generation, creating customized images from visual prompt with additional textual instruction emerges as a promising endeavor. However, existing methods, both tuning-based and tuning-free, struggle with interpreting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jing He , Haodong Li , Yongzhe Hu , Guibao Shen , Yingjie Cai , Weichao Qiu , Ying-Cong Chen

Recent advances in text-to-image (T2I) diffusion models have significantly improved the quality of generated images. However, providing efficient control over individual subjects, particularly the attributes characterizing them, remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Stefan Andreas Baumann , Felix Krause , Michael Neumayr , Nick Stracke , Melvin Sevi , Vincent Tao Hu , Björn Ommer

Zero-shot personalized image generation models aim to produce images that align with both a given text prompt and subject image, requiring the model to incorporate both sources of guidance. Existing methods often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Zicheng Duan , Yuxuan Ding , Chenhui Gou , Ziqin Zhou , Ethan Smith , Lingqiao Liu