English
Related papers

Related papers: DreamInpainter: Text-Guided Subject-Driven Image I…

200 papers

With the advancements in denoising diffusion probabilistic models (DDPMs), image inpainting has significantly evolved from merely filling information based on nearby regions to generating content conditioned on various prompts such as text,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Lingzhi Pan , Tong Zhang , Bingyuan Chen , Qi Zhou , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

With the advent of diffusion models, Text-to-Image (T2I) generation has seen substantial advancements. Current T2I models allow users to specify object colors using linguistic color names, and some methods aim to personalize color-object…

Graphics · Computer Science 2025-08-13 Qianru Qiu , Jiafeng Mao , Xueting Wang

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Advancements in generative models have enabled image inpainting models to generate content within specific regions of an image based on provided prompts and masks. However, existing inpainting methods often suffer from problems such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jun Huang , Ting Liu , Yihang Wu , Xiaochao Qu , Luoqi Liu , Xiaolin Hu

Advancing image inpainting is challenging as it requires filling user-specified regions for various intents, such as background filling and object synthesis. Existing approaches focus on either context-aware filling or object synthesis…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Junhao Zhuang , Yanhong Zeng , Wenran Liu , Chun Yuan , Kai Chen

Recent advancements in text-to-image generation models have dramatically enhanced the generation of photorealistic images from textual prompts, leading to an increased interest in personalized text-to-image applications, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xierui Wang , Siming Fu , Qihan Huang , Wanggui He , Hao Jiang

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

Recent advances in text-to-image models have enabled high-quality personalized image synthesis of user-provided concepts with flexible textual control. In this work, we analyze the limitations of two primary techniques in text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Lianyu Pang , Jian Yin , Baoquan Zhao , Feize Wu , Fu Lee Wang , Qing Li , Xudong Mao

Digital versions of real-world text documents often suffer from issues like environmental corrosion of the original document, low-quality scanning, or human interference. Existing document restoration and inpainting methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Wanglong Lu , Lingming Su , Jingjing Zheng , Vinícius Veloso de Melo , Farzaneh Shoeleh , John Hawkin , Terrence Tricco , Hanli Zhao , Xianta Jiang

Existing learning-based image inpainting methods are still in challenge when facing complex semantic environments and diverse hole patterns. The prior information learned from the large scale training data is still insufficient for these…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Taorong Liu , Liang Liao , Zheng Wang , Shin'ichi Satoh

Real-world text can be damaged by corrosion issues caused by environmental or human factors, which hinder the preservation of the complete styles of texts, e.g., texture and structure. These corrosion issues, such as graffiti signs and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shipeng Zhu , Pengfei Fang , Chenjie Zhu , Zuoyan Zhao , Qiang Xu , Hui Xue

While language-guided image manipulation has made remarkable progress, the challenge of how to instruct the manipulation process faithfully reflecting human intentions persists. An accurate and comprehensive description of a manipulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yasheng Sun , Yifan Yang , Houwen Peng , Yifei Shen , Yuqing Yang , Han Hu , Lili Qiu , Hideki Koike

Text-guided image editing, fueled by recent advancements in generative AI, is becoming increasingly widespread. This trend highlights the need for a comprehensive framework to verify text-guided edits and assess their quality. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ron Yosef , Moran Yanuka , Yonatan Bitton , Dani Lischinski

Recent advances in diffusion models have enhanced multimodal-guided visual generation, enabling customized subject insertion that seamlessly "brushes" user-specified objects into a given image guided by textual prompts. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yu Xu , Fan Tang , You Wu , Lin Gao , Oliver Deussen , Hongbin Yan , Jintao Li , Juan Cao , Tong-Yee Lee

Text-driven image generation methods have shown impressive results recently, allowing casual users to generate high quality images by providing textual descriptions. However, similar capabilities for editing existing images are still out of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Dani Valevski , Matan Kalman , Eyal Molad , Eyal Segalis , Yossi Matias , Yaniv Leviathan

Recently, text-to-image (T2I) editing has been greatly pushed forward by applying diffusion models. Despite the visual promise of the generated images, inconsistencies with the expected textual prompt remain prevalent. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Aoxue Li , Mingyang Yi , Zhenguo Li

Personalizing text-to-image models using a limited set of images for a specific object has been explored in subject-specific image generation. However, existing methods often face challenges in aligning with text prompts due to overfitting…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Daewon Chae , Nokyung Park , Jinkyu Kim , Kimin Lee

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

Diffusion models have demonstrated impressive image generation capabilities. Personalized approaches, such as textual inversion and Dreambooth, enhance model individualization using specific images. These methods enable generating images of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yan Zeng , Masanori Suganuma , Takayuki Okatani

Image inpainting, the task of reconstructing missing segments in corrupted images using available data, faces challenges in ensuring consistency and fidelity, especially under information-scarce conditions. Traditional evaluation methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Tianyi Chen , Jianfu Zhang , Yan Hong , Yiyi Zhang , Liqing Zhang