English
Related papers

Related papers: DreamEdit: Subject-driven Image Editing

200 papers

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Subject-driven text-to-image generation has witnessed remarkable advancements in its ability to learn and capture characteristics of a subject using only a limited number of images. However, existing methods commonly rely on high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shuya Yang , Shaozhe Hao , Yukang Cao , Kwan-Yee K. Wong

Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "prompt engineering,"…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Michelle Shu , Charles Herrmann , Richard Strong Bowen , Forrester Cole , Ramin Zabih

Recent years have witnessed the strong power of 3D generation models, which offer a new level of creative flexibility by allowing users to guide the 3D content generation process through a single image or natural language. However, it…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fangfu Liu , Hanyang Wang , Weiliang Chen , Haowen Sun , Yueqi Duan

Simple as it seems, moving an object to another location within an image is, in fact, a challenging image-editing task that requires re-harmonizing the lighting, adjusting the pose based on perspective, accurately filling occluded regions,…

Graphics · Computer Science 2025-03-12 Xin Yu , Tianyu Wang , Soo Ye Kim , Paul Guerrero , Xi Chen , Qing Liu , Zhe Lin , Xiaojuan Qi

Diffusion models have demonstrated impressive image generation capabilities. Personalized approaches, such as textual inversion and Dreambooth, enhance model individualization using specific images. These methods enable generating images of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yan Zeng , Masanori Suganuma , Takayuki Okatani

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

Our work addresses limitations seen in previous approaches for object-centric editing problems, such as unrealistic results due to shape discrepancies and limited control in object replacement or insertion. To this end, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Trong-Tung Nguyen , Duc-Anh Nguyen , Anh Tran , Cuong Pham

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

Sketch-based image editing aims to synthesize and modify photos based on the structural information provided by the human-drawn sketches. Since sketches are difficult to collect, previous methods mainly use edge maps instead of sketches to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Shuai Yang , Zhangyang Wang , Jiaying Liu , Zongming Guo

Diffusion-based image editing models have achieved significant progress in real world applications. However, conventional models typically rely on natural language prompts, which often lack the precision required to localize target objects.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haohang Xu , Lin Liu , Zhibo Zhang , Rong Cong , Xiaopeng Zhang , Qi Tian

Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a specific image domain or can only do global retouching. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jing Shi , Ning Xu , Trung Bui , Franck Dernoncourt , Zheng Wen , Chenliang Xu

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Recent advancements in subject-driven image generation have led to zero-shot generation, yet precise selection and focus on crucial subject representations remain challenging. Addressing this, we introduce the SSR-Encoder, a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yuxuan Zhang , Yiren Song , Jiaming Liu , Rui Wang , Jinpeng Yu , Hao Tang , Huaxia Li , Xu Tang , Yao Hu , Han Pan , Zhongliang Jing

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We introduce PhotoDoodle, a novel image editing framework designed to facilitate photo doodling by enabling artists to overlay decorative elements onto photographs. Photo doodling is challenging because the inserted elements must appear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Shijie Huang , Yiren Song , Yuxuan Zhang , Hailong Guo , Xueyin Wang , Mike Zheng Shou , Jiaming Liu

Recent advancements in text-to-image generation models have dramatically enhanced the generation of photorealistic images from textual prompts, leading to an increased interest in personalized text-to-image applications, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xierui Wang , Siming Fu , Qihan Huang , Wanggui He , Hao Jiang

Despite recent advancements in text-to-image generation, most existing methods struggle to create images with multiple objects and complex spatial relationships in the 3D world. To tackle this limitation, we introduce a generic AI system,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yanbo Ding , Shaobin Zhuang , Kunchang Li , Zhengrong Yue , Yu Qiao , Yali Wang

Despite significant progress in diffusion-based image generation, subject-driven generation and instruction-based editing remain challenging. Existing methods typically treat them separately, struggling with limited high-quality data and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xueyun Tian , Wei Li , Bingbing Xu , Yige Yuan , Yuanzhuo Wang , Huawei Shen