English
Related papers

Related papers: Subject-Diffusion:Open Domain Personalized Text-to…

200 papers

Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qiaoqiao Jin , Siming Fu , Dong She , Weinan Jia , Hualiang Wang , Mu Liu , Jidong Jiang

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Weijie Chen , Haoyu Wang , Shicai Yang , Lei Zhang , Wei Wei , Yanning Zhang , Luojun Lin , Di Xie , Yueting Zhuang

Modern diffusion-based image generative models have made significant progress and become promising to enrich training data for the object detection task. However, the generation quality and the controllability for complex scenes containing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Jingyuan Zhu , Shiyu Li , Yuxuan Liu , Ping Huang , Jiulong Shan , Huimin Ma , Jian Yuan

Text-driven diffusion models have exhibited impressive generative capabilities, enabling various image editing tasks. In this paper, we propose TF-ICON, a novel Training-Free Image COmpositioN framework that harnesses the power of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Shilin Lu , Yanzhu Liu , Adams Wai-Kin Kong

Diffusion models have achieved remarkable success in text-to-image generation, enabling the creation of high-quality images from text prompts or other modalities. However, existing methods for customizing these models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Ligong Han , Yinxiao Li , Han Zhang , Peyman Milanfar , Dimitris Metaxas , Feng Yang

Curating datasets for object segmentation is a difficult task. With the advent of large-scale pre-trained generative models, conditional image generation has been given a significant boost in result quality and ease of use. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mischa Dombrowski , Hadrien Reynaud , Matthew Baugh , Bernhard Kainz

Text-to-image diffusion models have shown remarkable success in generating personalized subjects based on a few reference images. However, current methods often fail when generating multiple subjects simultaneously, resulting in mixed…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Sangwon Jang , Jaehyeong Jo , Kimin Lee , Sung Ju Hwang

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Stable Diffusion has advanced text-to-image synthesis, but training models to generate images with accurate object quantity is still difficult due to the high computational cost and the challenge of teaching models the abstract concept of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yanyu Li , Pencheng Wan , Liang Han , Yaowei Wang , Liqiang Nie , Min Zhang

Recently, text-to-image models based on diffusion have achieved remarkable success in generating high-quality images. However, the challenge of personalized, controllable generation of instances within these images remains an area in need…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Fan Deng , Yaguang Wu , Xinyang Yu , Xiangjun Huang , Jian Yang , Guangyu Yan , Qiang Xu

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xin Ma , Yaohui Wang , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

In human-centric content generation, the pre-trained text-to-image models struggle to produce user-wanted portrait images, which retain the identity of individuals while exhibiting diverse expressions. This paper introduces our efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Renshuai Liu , Bowen Ma , Wei Zhang , Zhipeng Hu , Changjie Fan , Tangjie Lv , Yu Ding , Xuan Cheng

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

Recent advances in diffusion models have enhanced multimodal-guided visual generation, enabling customized subject insertion that seamlessly "brushes" user-specified objects into a given image guided by textual prompts. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yu Xu , Fan Tang , You Wu , Lin Gao , Oliver Deussen , Hongbin Yan , Jintao Li , Juan Cao , Tong-Yee Lee

Text-to-image diffusion models have been shown to suffer from sample-level memorization, possibly reproducing near-perfect replica of images that they are trained on, which may be undesirable. To remedy this issue, we develop the first…

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Personalized text-to-image generation methods can generate customized images based on the reference images, which have garnered wide research interest. Recent methods propose a finetuning-free approach with a decoupled cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Qihan Huang , Siming Fu , Jinlong Liu , Hao Jiang , Yipeng Yu , Jie Song

The recent progress in text-to-image models pretrained on large-scale datasets has enabled us to generate various images as long as we provide a text prompt describing what we want. Nevertheless, the availability of these models is still…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yuxuan Duan , Yan Hong , Bo Zhang , Jun Lan , Huijia Zhu , Weiqiang Wang , Jianfu Zhang , Li Niu , Liqing Zhang