English
Related papers

Related papers: CLIPAway: Harmonizing Focused Embeddings for Remov…

200 papers

Generating background scenes for salient objects plays a crucial role across various domains including creative design and e-commerce, as it enhances the presentation and context of subjects by integrating them into tailored environments.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Amir Erfan Eshratifar , Joao V. B. Soares , Kapil Thadani , Shaunak Mishra , Mikhail Kuznetsov , Yueh-Ning Ku , Paloma de Juan

Creative image generation has emerged as a compelling area of research, driven by the need to produce novel and high-quality images that expand the boundaries of imagination. In this work, we propose a novel framework for creative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Kunpeng Song , Ahmed Elgammal

Video object removal and inpainting are critical tasks in the fields of computer vision and multimedia processing, aimed at restoring missing or corrupted regions in video sequences. Traditional methods predominantly rely on flow-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jie Liu , Zheng Hui

This study introduces Text-Guided Subject-Driven Image Inpainting, a novel task that combines text and exemplar images for image inpainting. While both text and exemplar images have been used independently in previous efforts, their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shaoan Xie , Yang Zhao , Zhisheng Xiao , Kelvin C. K. Chan , Yandong Li , Yanwu Xu , Kun Zhang , Tingbo Hou

We provide a theoretical justification for sample recovery using diffusion based image inpainting in a linear model setting. While most inpainting algorithms require retraining with each new mask, we prove that diffusion based inpainting…

Machine Learning · Statistics 2023-02-03 Litu Rout , Advait Parulekar , Constantine Caramanis , Sanjay Shakkottai

Dataset bias is a significant challenge in machine learning, where specific attributes, such as texture or color of the images are unintentionally learned resulting in detrimental performance. To address this, previous efforts have focused…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Donggeun Ko , Sangwoo Jo , Dongjun Lee , Namjun Park , Jaekwang Kim

Video inpainting has been challenged by complex scenarios like large movements and low-light conditions. Current methods, including emerging diffusion models, face limitations in quality and efficiency. This paper introduces the Flow-Guided…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Bohai Gu , Yongsheng Yu , Heng Fan , Libo Zhang

Recent advances in image editing have been driven by the development of denoising diffusion models, marking a significant leap forward in this field. Despite these advances, the generalization capabilities of recent image editing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Changdi Yang , Jun Liu , Hao Tang , Pu Zhao , Yanzhi Wang

Current 3D inpainting and object removal methods are largely limited to front-facing scenes, facing substantial challenges when applied to diverse, "unconstrained" scenes where the camera orientation and trajectory are unrestricted. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhihao Shi , Dong Huo , Yuhongze Zhou , Kejia Yin , Yan Min , Juwei Lu , Xinxin Zuo

Object tracking is a fundamental task in computer vision, requiring the localization of objects of interest across video frames. Diffusion models have shown remarkable capabilities in visual generation, making them well-suited for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Pha Nguyen , Ngan Le , Jackson Cothren , Alper Yilmaz , Khoa Luu

We present a diffusion-based portrait shadow removal approach that can robustly produce high-fidelity results. Unlike previous methods, we cast shadow removal as diffusion-based inpainting. To this end, we first train a shadow-independent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Wanchang Yu , Qing Zhang , Rongjia Zheng , Wei-Shi Zheng

Text-to-image generative models have attracted rising attention for flexible image editing via user-specified descriptions. However, text descriptions alone are not enough to elaborate the details of subjects, often compromising the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Xin Zhang , Jiaxian Guo , Paul Yoo , Yutaka Matsuo , Yusuke Iwasawa

Embodied visual planning aims to enable manipulation tasks by imagining how a scene evolves toward a desired goal and using the imagined trajectories to guide actions. Video diffusion models, through their image-to-video generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yuming Gu , Yizhi Wang , Yining Hong , Yipeng Gao , Hao Jiang , Angtian Wang , Bo Liu , Nathaniel S. Dennler , Zhengfei Kuang , Hao Li , Gordon Wetzstein , Chongyang Ma

In recent years, personalized diffusion-based text-to-image generative tasks have been a hot topic in computer vision studies. A robust diffusion model is determined by its ability to perform near-perfect reconstruction of certain product…

Popularized by their strong image generation performance, diffusion and related methods for generative modeling have found widespread success in visual media applications. In particular, diffusion methods have enabled new approaches to data…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Yibo Yang , Stephan Mandt

The rapid advancement in image generation models has predominantly been driven by diffusion models, which have demonstrated unparalleled success in generating high-fidelity, diverse images from textual prompts. Despite their success,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yusuf Dalva , Hidir Yesiltepe , Pinar Yanardag

Diffusion models have shown great promise in synthesizing visually appealing images. However, it remains challenging to condition the synthesis at a fine-grained level, for instance, synthesizing image pixels following some generic color…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ka Chun Shum , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Generating and inserting new objects into 3D content is a compelling approach for achieving versatile scene recreation. Existing methods, which rely on SDS optimization or single-view inpainting, often struggle to produce high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Hongliang Zhong , Can Wang , Jingbo Zhang , Jing Liao

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

Radiance field methods, such as Neural Radiance Field or 3D Gaussian Splatting, have emerged as seminal 3D representations for synthesizing realistic novel views. For practical applications, there is ongoing research on flexible scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Ji Hyun Seo , Byounhyun Yoo , Gerard Jounghyun Kim