English
Related papers

Related papers: Task-Oriented Diffusion Inversion for High-Fidelit…

200 papers

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Large-scale text-to-video models have shown remarkable abilities, but their direct application in video editing remains challenging due to limited available datasets. Current video editing methods commonly require per-video fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zhenghao Zhang , Zuozhuo Dai , Long Qin , Weizhi Wang

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

This paper introduces TurboFill, a fast image inpainting model that enhances a few-step text-to-image diffusion model with an inpainting adapter for high-quality and efficient inpainting. While standard diffusion models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Liangbin Xie , Daniil Pakhomov , Zhonghao Wang , Zongze Wu , Ziyan Chen , Yuqian Zhou , Haitian Zheng , Zhifei Zhang , Zhe Lin , Jiantao Zhou , Chao Dong

Recent research has shown that text-to-image diffusion models are capable of generating high-quality images guided by text prompts. But can they be used to generate or approximate real-world images from the seed noise? This is known as the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Weiming Chen , Qifan Liu , Siyi Liu , Yushun Tang , Yijia Wang , Zhihan Zhu , Zhihai He

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hanyi Wang , Han Fang , Zheng Wang , Shilin Wang , Ee-Chien Chang

Diffusion distillation represents a highly promising direction for achieving faithful text-to-image generation in a few sampling steps. However, despite recent successes, existing distilled models still do not provide the full spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Nikita Starodubcev , Mikhail Khoroshikh , Artem Babenko , Dmitry Baranchuk

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

Inversion methods, such as Textual Inversion, generate personalized images by incorporating concepts of interest provided by user images. However, existing methods often suffer from overfitting issues, where the dominant presence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Xulu Zhang , Xiao-Yong Wei , Jinlin Wu , Tianyi Zhang , Zhaoxiang Zhang , Zhen Lei , Qing Li

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Text-to-image diffusion models have achieved remarkable success in generating high-quality and diverse images. Building on these advancements, diffusion models have also demonstrated exceptional performance in text-guided image editing. A…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Mingyu Kang , Yong Suk Choi

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Semantic communication enhances transmission efficiency by conveying semantic information rather than raw input symbol sequences. Task-oriented semantic communication is a variant that tries to retains only task-specific information, thus…

Cryptography and Security · Computer Science 2025-10-06 Xuesong Wang , Mo Li , Xingyan Shi , Zhaoqian Liu , Shenghao Yang

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Precise image editing with text-to-image models has attracted increasing interest due to their remarkable generative capabilities and user-friendly nature. However, such attempts face the pivotal challenge of misalignment between the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Wei Wu , Qingnan Fan , Shuai Qin , Hong Gu , Ruoyu Zhao , Antoni B. Chan

Text-to-image synthesis has witnessed remarkable advancements in recent years. Many attempts have been made to adopt text-to-image models to support multiple tasks. However, existing approaches typically require resource-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruchika Chavhan , Abhinav Mehrotra , Malcolm Chadwick , Alberto Gil Ramos , Luca Morreale , Mehdi Noroozi , Sourav Bhattacharya

Diffusion models are the go-to method for Text-to-Image generation, but their iterative denoising processes has high inference latency. Quantization reduces compute time by using lower bitwidths, but applies a fixed precision across all…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Basile Lewandowski , Simon Kurz , Aditya Shankar , Robert Birke , Jian-Jia Chen , Lydia Y. Chen