English
Related papers

Related papers: h-Edit: Effective and Flexible Diffusion-Based Edi…

200 papers

Stable Diffusion fine-tuning technique is tried to assist bridge-type innovation. The bridge real photo dataset is built, and Stable Diffusion is fine tuned by using four methods that are Textual Inversion, Dreambooth, Hypernetwork and…

Machine Learning · Computer Science 2024-09-25 Leye Zhang , Xiangxiang Tian , Chengli Zhang , Hongjun Zhang

Existing diffusion-based methods have achieved impressive results in human motion editing. However, these methods often exhibit significant ghosting and body distortion in unseen in-the-wild cases. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yi Zuo , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Wenping Ma , Shuyuan Yang , Yuwei Guo

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

Recently, GAN inversion methods combined with Contrastive Language-Image Pretraining (CLIP) enables zero-shot image manipulation guided by text prompts. However, their applications to diverse real images are still difficult due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Gwanghyun Kim , Taesung Kwon , Jong Chul Ye

Recent advances in diffusion models for image generation have led to detailed examinations of several components within the U-Net architecture for image editing. While previous studies have focused on the bottleneck layer (h-space),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Ludovica Schaerf , Andrea Alfarano , Fabrizio Silvestri , Leonardo Impett

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Point-based interactive editing serves as an essential tool to complement the controllability of existing generative models. A concurrent work, DragDiffusion, updates the diffusion latent map in response to user inputs, causing global…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Haofeng Liu , Chenshu Xu , Yifei Yang , Lihua Zeng , Shengfeng He

We introduce InstructVid2Vid, an end-to-end diffusion-based methodology for video editing guided by human language instructions. Our approach empowers video manipulation guided by natural language directives, eliminating the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Bosheng Qin , Juncheng Li , Siliang Tang , Tat-Seng Chua , Yueting Zhuang

We propose a simple but effective training-free approach tailored to diffusion-based image-to-image translation. Our approach revises the original noise prediction network of a pretrained diffusion model by introducing a noise correction…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Junsung Lee , Minsoo Kang , Bohyung Han

Recent developments in the field of diffusion models have demonstrated an exceptional capacity to generate high-quality prompt-conditioned image edits. Nevertheless, previous approaches have primarily relied on textual prompts for image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Goirik Chakrabarty , Aditya Chandrasekar , Ramya Hebbalaguppe , Prathosh AP

Text-driven diffusion models have exhibited impressive generative capabilities, enabling various image editing tasks. In this paper, we propose TF-ICON, a novel Training-Free Image COmpositioN framework that harnesses the power of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Shilin Lu , Yanzhu Liu , Adams Wai-Kin Kong

Video editing is an emerging task, in which most current methods adopt the pre-trained text-to-image (T2I) diffusion model to edit the source video in a zero-shot manner. Despite extensive efforts, maintaining the temporal consistency of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jiangshan Wang , Yue Ma , Jiayi Guo , Yicheng Xiao , Gao Huang , Xiu Li

Diffusion bridge models establish probabilistic paths between arbitrary paired distributions and exhibit great potential for universal image restoration. Most existing methods merely treat them as simple variants of stochastic interpolants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Hebaixu Wang , Jing Zhang , Haoyang Chen , Haonan Guo , Di Wang , Jiayi Ma , Bo Du

We introduce a new class of generative diffusion models that, unlike conventional denoising diffusion models, achieve a time-homogeneous structure for both the noising and denoising processes, allowing the number of steps to adaptively…

Machine Learning · Statistics 2026-01-23 Sören Christensen , Jan Kallsen , Claudia Strauch , Lukas Trottner

Adapting pretrained diffusion-based generative models for text-driven image editing with negligible tuning overhead has demonstrated remarkable potential. A classical adaptation paradigm, as followed by these methods, first infers the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jiahuan Wang , Yuxin Chen , Jun Yu , Guangming Lu , Wenjie Pei

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

In this paper, we address the problem of face aging: generating past or future facial images by incorporating age-related changes to the given face. Previous aging methods rely solely on human facial image datasets and are thus constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Xiangyi Chen , Stéphane Lathuilière