English
Related papers

Related papers: FlexiEdit: Frequency-Aware Latent Refinement for E…

200 papers

Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration. To address these issues, we propose a robust and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hai Jiang , Ao Luo , Songchen Han , Haoqiang Fan , Shuaicheng Liu

While Diffusion Large Language Models (DLLMs) have demonstrated remarkable capabilities in multi-modal generation, performing precise, training-free image editing remains an open challenge. Unlike continuous diffusion models, the discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zifeng Zhu , Jiaming Han , Jiaxiang Zhao , Minnan Luo , Xiangyu Yue

There is a growing interest in the use of latent diffusion models (LDMs) for image restoration (IR) tasks due to their ability to model effectively the distribution of natural images. While significant progress has been made, there are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Di You , Daniel Siromani , Pier Luigi Dragotti

Editing real images using a pre-trained text-to-image (T2I) diffusion/flow model often involves inverting the image into its corresponding noise map. However, inversion by itself is typically insufficient for obtaining satisfactory results,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Vladimir Kulikov , Matan Kleiner , Inbar Huberman-Spiegelglas , Tomer Michaeli

Objective: Most deep neural network-based diffusion tensor imaging methods require the diffusion gradients' number and directions in the data to be reconstructed to match those in the training data. This work aims to develop and evaluate a…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Zejun Wu , Jiechao Wang , Zunquan Chen , Qinqin Yang , Zhen Xing , Dairong Cao , Jianfeng Bao , Taishan Kang , Jianzhong Lin , Shuhui Cai , Zhong Chen , Congbo Cai

Instructional video editing applies edits to an input video using only text prompts, enabling intuitive natural-language control. Despite rapid progress, most methods still require fixed-length inputs and substantial compute. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mohammadreza Salehi , Mehdi Noroozi , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Alberto Gil Ramos , Abhinav Mehrotra

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according to a target prompt,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Xuan Ju , Ailing Zeng , Yuxuan Bian , Shaoteng Liu , Qiang Xu

This paper enables high-fidelity, transferable NeRF editing by frequency decomposition. Recent NeRF editing pipelines lift 2D stylization results to 3D scenes while suffering from blurry results, and fail to capture detailed structures…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yisheng He , Weihao Yuan , Siyu Zhu , Zilong Dong , Liefeng Bo , Qixing Huang

Diffusion Models achieve state-of-the-art performance in generating new samples but lack a low-dimensional latent space that encodes the data into editable features. Inversion-based methods address this by reversing the denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Łukasz Staniszewski , Łukasz Kuciński , Kamil Deja

Text-conditional image editing is a practical AIGC task that has recently emerged with great commercial and academic value. For real image editing, most diffusion model-based methods use DDIM Inversion as the first stage before editing.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiancheng Huang , Yi Huang , Jianzhuang Liu , Donghao Zhou , Yifan Liu , Shifeng Chen

Image-to-image translation has been revolutionized with GAN-based methods. However, existing methods lack the ability to preserve the identity of the source domain. As a result, synthesized images can often over-adapt to the reference…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Mu Cai , Hong Zhang , Huijuan Huang , Qichuan Geng , Yixuan Li , Gao Huang

Diffusion models have achieved remarkable success in image generation and editing tasks. Inversion within these models aims to recover the latent noise representation for a real or generated image, enabling reconstruction, editing, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zixiang Li , Haoyu Wang , Wei Wang , Chuangchuang Tan , Yunchao Wei , Yao Zhao

Transformer-based diffusion models have recently superseded traditional U-Net architectures, with multimodal diffusion transformers (MM-DiT) emerging as the dominant approach in state-of-the-art models like Stable Diffusion 3 and Flux.1.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joonghyuk Shin , Alchan Hwang , Yujin Kim , Daneul Kim , Jaesik Park

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

Despite their remarkable performance, modern Diffusion Transformers are hindered by substantial resource requirements during inference, stemming from the fixed and large amount of compute needed for each denoising step. In this work, we…

Current instruction-based editing methods, such as InstructPix2Pix, often fail to produce satisfactory results in complex scenarios due to their dependence on the simple CLIP text encoder in diffusion models. To rectify this, this paper…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Yuzhou Huang , Liangbin Xie , Xintao Wang , Ziyang Yuan , Xiaodong Cun , Yixiao Ge , Jiantao Zhou , Chao Dong , Rui Huang , Ruimao Zhang , Ying Shan

This paper introduces EasyInv, an easy yet novel approach that significantly advances the field of DDIM Inversion by addressing the inherent inefficiencies and performance limitations of traditional iterative optimization methods. At the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ziyue Zhang , Mingbao Lin , Shuicheng Yan , Rongrong Ji

Many real-world applications, such as interactive photo retouching, artistic content creation, and product design, require flexible and iterative image editing. However, existing image editing methods primarily focus on achieving the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zijun Zhou , Yingying Deng , Xiangyu He , Weiming Dong , Fan Tang

Semantic-rich features from Vision Foundation Models (VFMs) have been leveraged to enhance Latent Diffusion Models (LDMs). However, raw VFM features are typically high-dimensional and redundant, increasing the difficulty of learning and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Guanfang Dong , Luke Schultz , Negar Hassanpour , Chao Gao