English
Related papers

Related papers: Inversion-Free Image Editing with Natural Language

200 papers

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

We present FreeMorph, the first tuning-free method for image morphing that accommodates inputs with different semantics or layouts. Unlike existing methods that rely on finetuning pre-trained diffusion models and are limited by time…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Yukang Cao , Chenyang Si , Jinghao Wang , Ziwei Liu

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Guidance in image generation steers models towards higher-quality or more targeted outputs, typically achieved in Diffusion Models (DMs) via Classifier-free Guidance (CFG). However, recent Consistency Models (CMs), which offer fewer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Chia-Hong Hsu , Shiu-hong Kao , Randall Balestriero

Recent advancements in diffusion and flow models have greatly improved text-based image editing, yet methods that edit images independently often produce geometrically and photometrically inconsistent results across different views of the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Josef Bengtson , David Nilsson , Dong In Lee , Yaroslava Lochman , Fredrik Kahl

Image inpainting is the task of reconstructing missing or damaged parts of an image in a way that seamlessly blends with the surrounding content. With the advent of advanced generative models, especially diffusion models and generative…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xingzhong Hou , Jie Wu , Boxiao Liu , Yi Zhang , Guanglu Song , Yunpeng Liu , Yu Liu , Haihang You

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Face recognition models embed a face image into a low-dimensional identity vector containing abstract encodings of identity-specific facial features that allow individuals to be distinguished from one another. We tackle the challenging task…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Manuel Kansy , Anton Raël , Graziana Mignone , Jacek Naruniec , Christopher Schroers , Markus Gross , Romann M. Weber

Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Haoyu Ma , Shahin Mahdizadehaghdam , Bichen Wu , Zhipeng Fan , Yuchao Gu , Wenliang Zhao , Lior Shapira , Xiaohui Xie

Recent text-to-image (T2I) diffusion models have achieved remarkable advancement, yet faithfully following complex textual descriptions remains challenging due to insufficient interactions between textual and visual features. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gyeongman Kim , Hajin Shim , Hyunsu Kim , Yunjey Choi , Junho Kim , Eunho Yang

Recent advances in text-to-image diffusion models have substantially improved the quality of image customization, enabling the synthesis of highly realistic images. Despite this progress, achieving fast and efficient personalization remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Aniket Roy , Maitreya Suin , Rama Chellappa

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities, yet balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yangyang Xu , Wenqi Shao , Yong Du , Haiming Zhu , Yang Zhou , Ping Luo , Shengfeng He

Recent advances in diffusion models have revolutionized text-guided image editing, yet existing editing methods face critical challenges in hyperparameter identification. To get the reasonable editing performance, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Chau Pham , Quan Dao , Mahesh Bhosale , Yunjie Tian , Dimitris Metaxas , David Doermann

Text-guided diffusion models have significantly advanced image editing, enabling highly realistic and local modifications based on textual prompts. While these developments expand creative possibilities, their malicious use poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Valentina Bazyleva , Nicolo Bonettini , Gaurav Bharaj

Text-guided color editing in images and videos is a fundamental yet unsolved problem, requiring fine-grained manipulation of color attributes, including albedo, light source color, and ambient lighting, while preserving physical consistency…

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yigit Ekin , Yossi Gandelsman

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Image generation and editing have seen a great deal of advancements with the rise of large-scale diffusion models that allow user control of different modalities such as text, mask, depth maps, etc. However, controlled editing of videos…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 AmirHossein Zamani , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky