English
Related papers

Related papers: DreamEdit: Subject-driven Image Editing

200 papers

Recent advancements in text-to-image diffusion models have shown remarkable creative capabilities with textual prompts, but generating personalized instances based on specific subjects, known as subject-driven generation, remains…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Shanyan Guan , Yanhao Ge , Ying Tai , Jian Yang , Wei Li , Mingyu You

Customized image generation is essential for creating personalized content based on user prompts, allowing large-scale text-to-image diffusion models to more effectively meet individual needs. However, existing models often neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Qingyu Shi , Lu Qi , Jianzong Wu , Jinbin Bai , Jingbo Wang , Yunhai Tong , Xiangtai Li

The goal of image composition is merging a foreground object into a background image to obtain a realistic composite image. Recently, generative composition methods are built on large pretrained diffusion models, due to their unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Lu , Jiangtong Li , Bo Zhang , Li Niu

Generating customized content in videos has received increasing attention recently. However, existing works primarily focus on customized text-to-video generation for single subject, suffering from subject-missing and attribute-binding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hong Chen , Xin Wang , Yipeng Zhang , Yuwei Zhou , Zeyang Zhang , Siao Tang , Wenwu Zhu

Recent advancements in generative models have enabled high-fidelity text-to-image generation. However, open-source image-editing models still lag behind their proprietary counterparts, primarily due to limited high-quality data and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yang Ye , Xianyi He , Zongjian Li , Bin Lin , Shenghai Yuan , Zhiyuan Yan , Bohan Hou , Li Yuan

Personalizing image generation and editing is particularly challenging when we only have a few images of the subject, or even a single image. A common approach to personalization is concept learning, which can integrate the subject into…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yair Shpitzer , Gal Chechik , Idan Schwartz

Instruction-guided image editing methods have demonstrated significant potential by training diffusion models on automatically synthesized or manually annotated image editing pairs. However, these methods remain far from practical,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Cong Wei , Zheyang Xiong , Weiming Ren , Xinrun Du , Ge Zhang , Wenhu Chen

Synthesizing images with user-specified subjects has received growing attention due to its practical applications. Despite the recent success in single subject customization, existing algorithms suffer from high training cost and low…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Zhiheng Liu , Yifei Zhang , Yujun Shen , Kecheng Zheng , Kai Zhu , Ruili Feng , Yu Liu , Deli Zhao , Jingren Zhou , Yang Cao

Subject-driven text-to-image generation models create novel renditions of an input subject based on text prompts. Existing models suffer from lengthy fine-tuning and difficulties preserving the subject fidelity. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Dongxu Li , Junnan Li , Steven C. H. Hoi

Recent progress in generative models has significantly advanced image editing capabilities, yet precise and intuitive user control remains difficult. Specifically, users often struggle to communicate both exact spatial layouts and specific…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Anya Ji , George Ma , Téa Wright , Yiming Zhang , David M. Chan , Alane Suhr , Somayeh Sojoudi

This paper introduces a tuning-free method for both object insertion and subject-driven generation. The task involves composing an object, given multiple views, into a scene specified by either an image or text. Existing methods struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Daniel Winter , Asaf Shul , Matan Cohen , Dana Berman , Yael Pritch , Alex Rav-Acha , Yedid Hoshen

Existing image editing tools, while powerful, typically disregard the underlying 3D geometry from which the image is projected. As a result, edits made using these tools may become detached from the geometry and lighting conditions that are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Oscar Michel , Anand Bhattad , Eli VanderBilt , Ranjay Krishna , Aniruddha Kembhavi , Tanmay Gupta

Significant progress has been achieved in subject-driven text-to-image (T2I) generation, which aims to synthesize new images depicting target subjects according to user instructions. However, evaluating these models remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zhenyu Hu , Qing Wang , Te Cao , Luo Liao , Longfei Lu , Liqun Liu , Shuang Li , Hang Chen , Mengge Xue , Yuan Chen , Chao Deng , Peng Shu , Huan Yu , Jie Jiang

Existing subject-driven text-to-image generation models suffer from tedious fine-tuning steps and struggle to maintain both text-image alignment and subject fidelity. For generating compositional subjects, it often encounters problems such…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Shengyuan Liu , Bo Wang , Ye Ma , Te Yang , Xipeng Cao , Quan Chen , Han Li , Di Dong , Peng Jiang

Instruction-based image editing holds immense potential for a variety of applications, as it enables users to perform any editing operation using a natural language instruction. However, current models in this domain often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Shelly Sheynin , Adam Polyak , Uriel Singer , Yuval Kirstain , Amit Zohar , Oron Ashual , Devi Parikh , Yaniv Taigman

Text-driven image synthesis has made significant advancements with the development of diffusion models, transforming how visual content is generated from text prompts. Despite these advances, text-driven image editing, a key area in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Mingzhen Huang , Jialing Cai , Shan Jia , Vishnu Suresh Lokhande , Siwei Lyu

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Subject-driven image generation (SDIG) aims to manipulate specific subjects within images while adhering to textual instructions, a task crucial for advancing text-to-image diffusion models. SDIG requires reconciling the tension between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jibai Lin , Bo Ma , Yating Yang , Xi Zhou , Rong Ma , Turghun Osman , Ahtamjan Ahmat , Rui Dong , Lei Wang

Text-guided image editing can have a transformative impact in supporting creative applications. A key challenge is to generate edits that are faithful to input text prompts, while consistent with input images. We present Imagen Editor, a…

With the great success of text-conditioned diffusion models in creative text-to-image generation, various text-driven image editing approaches have attracted the attentions of many researchers. However, previous works mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhiyuan Ma , Guoli Jia , Bowen Zhou