English
Related papers

Related papers: CoreEditor: Correspondence-constrained Diffusion f…

200 papers

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Existing diffusion-based video editing models have made gorgeous advances for editing attributes of a source video over time but struggle to manipulate the motion information while preserving the original protagonist's appearance and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shuyuan Tu , Qi Dai , Zhi-Qi Cheng , Han Hu , Xintong Han , Zuxuan Wu , Yu-Gang Jiang

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Recent advances in diffusion models have significantly improved image generation and editing, but extending these capabilities to 3D assets remains challenging, especially for fine-grained edits that require multi-view consistency. Existing…

Graphics · Computer Science 2025-07-01 Junchao Huang , Xinting Hu , Shaoshuai Shi , Zhuotao Tian , Li Jiang

Despite advances in neural rendering, due to the scarcity of high-quality 3D datasets and the inherent limitations of multi-view diffusion models, view synthesis and 3D model generation are restricted to low resolutions with suboptimal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yihang Luo , Shangchen Zhou , Yushi Lan , Xingang Pan , Chen Change Loy

This paper proposes ProEdit - a simple yet effective framework for high-quality 3D scene editing guided by diffusion distillation in a novel progressive manner. Inspired by the crucial observation that multi-view inconsistency in scene…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Jun-Kun Chen , Yu-Xiong Wang

Model customization introduces new concepts to existing text-to-image models, enabling the generation of these new concepts/objects in novel contexts. However, such methods lack accurate camera view control with respect to the new object,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Nupur Kumari , Grace Su , Richard Zhang , Taesung Park , Eli Shechtman , Jun-Yan Zhu

Text-to-Image (T2I) diffusion models have recently gained traction for their versatility and user-friendliness in 2D content generation and editing. However, training a diffusion model specifically for 3D scene editing is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Nazmul Karim , Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Diffusion-based image editing is a composite process of preserving the source image content and generating new content or applying modifications. While current editing approaches have made improvements under text guidance, most of them have…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianrui Huang , Pu Cao , Lu Yang , Chun Liu , Mengjie Hu , Zhiwei Liu , Qing Song

Text-driven multi-object image editing which aims to precisely modify multiple objects within an image based on text descriptions, has recently attracted considerable interest. Existing works primarily follow the localize-editing paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Fengyi Fu , Mengqi Huang , Lei Zhang , Zhendong Mao

Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. However, one critical limitation of these models is the low fidelity of generated images with respect to the text description, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Qiucheng Wu , Yujian Liu , Handong Zhao , Trung Bui , Zhe Lin , Yang Zhang , Shiyu Chang

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Our work addresses limitations seen in previous approaches for object-centric editing problems, such as unrealistic results due to shape discrepancies and limited control in object replacement or insertion. To this end, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Trong-Tung Nguyen , Duc-Anh Nguyen , Anh Tran , Cuong Pham

Fashion image editing is a crucial tool for designers to convey their creative ideas by visualizing design concepts interactively. Current fashion image editing techniques, though advanced with multimodal prompts and powerful diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiaolong Wang , Zhi-Qi Cheng , Jue Wang , Xiaojiang Peng

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu

We introduce MD-ProjTex, a method for fast and consistent text-guided texture generation for 3D shapes using pretrained text-to-image diffusion models. At the core of our approach is a multi-view consistency mechanism in UV space, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ahmet Burak Yildirim , Mustafa Utku Aydogdu , Duygu Ceylan , Aysegul Dundar