English
Related papers

Related papers: DICE: Discrete Inversion Enabling Controllable Edi…

200 papers

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Consistent editing of real images is a challenging task, as it requires performing non-rigid edits (e.g., changing postures) to the main objects in the input image without changing their identity or attributes. To guarantee consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xiaoyue Duan , Shuhao Cui , Guoliang Kang , Baochang Zhang , Zhengcong Fei , Mingyuan Fan , Junshi Huang

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Large text-to-image diffusion models have demonstrated remarkable image synthesis capabilities, but their indiscriminate training on Internet-scale data has led to learned concepts that enable harmful, copyrighted, or otherwise undesirable…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Finn Carter

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

Due to the high potential for abuse of GenAI systems, the task of detecting synthetic images has recently become of great interest to the research community. Unfortunately, existing image-space detectors quickly become obsolete as new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 George Cazenavette , Avneesh Sud , Thomas Leung , Ben Usman

Generative artificial intelligence (AI) refers to algorithms that create synthetic but realistic output. Diffusion models currently offer state of the art performance in generative AI for images. They also form a key component in more…

Machine Learning · Computer Science 2023-12-27 Catherine F. Higham , Desmond J. Higham , Peter Grindrod

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Diffusion models have emerged as a powerful generative technology and have been found to be applicable in various scenarios. Most existing foundational diffusion models are primarily designed for text-guided visual generation and do not…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zhen Han , Zeyinzi Jiang , Yulin Pan , Jingfeng Zhang , Chaojie Mao , Chenwei Xie , Yu Liu , Jingren Zhou

Discrete diffusion models form a powerful class of generative models across diverse domains, including text and graphs. However, existing approaches face fundamental limitations. Masked diffusion models suffer from irreversible errors due…

Machine Learning · Computer Science 2026-04-21 Marcel Kollovieh , Sirine Ayadi , Stephan Günnemann

Diffusion models have enabled high-quality, conditional image editing capabilities. We propose to expand their arsenal, and demonstrate that off-the-shelf diffusion models can be used for a wide range of cross-domain compositing tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Roy Hachnochi , Mingrui Zhao , Nadav Orzech , Rinon Gal , Ali Mahdavi-Amiri , Daniel Cohen-Or , Amit Haim Bermano

Deep generative models have garnered significant attention in low-level vision tasks due to their generative capabilities. Among them, diffusion model-based solutions, characterized by a forward diffusion process and a reverse denoising…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Chunming He , Yuqi Shen , Chengyu Fang , Fengyang Xiao , Longxiang Tang , Yulun Zhang , Wangmeng Zuo , Zhenhua Guo , Xiu Li

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

Text-guided diffusion models have significantly advanced image editing, enabling highly realistic and local modifications based on textual prompts. While these developments expand creative possibilities, their malicious use poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Valentina Bazyleva , Nicolo Bonettini , Gaurav Bharaj

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

Diffusion large language models (dLLMs) have emerged as a compelling alternative to autoregressive (AR) LLMs, owing to their capacity for parallel token generation. This paradigm is particularly well-suited for code generation, where…

Machine Learning · Computer Science 2026-02-13 Haolei Bai , Lingcheng Kong , Xueyi Chen , Jianmian Wang , Zhiqiang Tao , Huan Wang

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

Diffusion models have demonstrated impressive performance in various image generation, editing, enhancement and translation tasks. In particular, the pre-trained text-to-image stable diffusion models provide a potential solution to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tao Yang , Rongyuan Wu , Peiran Ren , Xuansong Xie , Lei Zhang