English
Related papers

Related papers: Open-Source Image Editing Models Are Zero-Shot Vis…

200 papers

Text-based editing diffusion models exhibit limited performance when the user's input instruction is ambiguous. To solve this problem, we propose $\textit{Specify ANd Edit}$ (SANE), a zero-shot inference pipeline for diffusion-based editing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ekaterina Iakovleva , Fabio Pizzati , Philip Torr , Stéphane Lathuilière

Introducing user-specified visual concepts in image editing is highly practical as these concepts convey the user's intent more precisely than text-based descriptions. We propose FreeEdit, a novel approach for achieving such reference-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Runze He , Kai Ma , Linjiang Huang , Shaofei Huang , Jialin Gao , Xiaoming Wei , Jiao Dai , Jizhong Han , Si Liu

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chengyu Bai , Jintao Chen , Xiang Bai , Yilong Chen , Qi She , Ming Lu , Shanghang Zhang

Text-to-Image (T2I) diffusion models have recently gained traction for their versatility and user-friendliness in 2D content generation and editing. However, training a diffusion model specifically for 3D scene editing is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Nazmul Karim , Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Recent image editing models have achieved impressive results while following natural language editing instructions, but they rely on supervised fine-tuning with large datasets of input-target pairs. This is a critical bottleneck, as such…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Nupur Kumari , Sheng-Yu Wang , Nanxuan Zhao , Yotam Nitzan , Yuheng Li , Krishna Kumar Singh , Richard Zhang , Eli Shechtman , Jun-Yan Zhu , Xun Huang

The quality and diversity of instruction-based image editing datasets are continuously increasing, yet large-scale, high-quality datasets for instruction-based video editing remain scarce. To address this gap, we introduce OpenVE-3M, an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Haoyang He , Jie Wang , Jiangning Zhang , Zhucun Xue , Xingyuan Bu , Qiangpeng Yang , Shilei Wen , Lei Xie

Forensic analysis of AI-edited images requires more than binary real-versus-fake prediction: a useful system should localize the edit, identify its semantic type, and ground its decisions in visual evidence. Existing image-forensics…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Van-Loc Nguyen , AprilPyone MaungMaung , Minh-Triet Tran , Isao Echizen

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

Recent advances in vision-language models like Stable Diffusion have shown remarkable power in creative image synthesis and editing.However, most existing text-to-image editing methods encounter two obstacles: First, the text prompt needs…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Shanglin Li , Bohan Zeng , Yutang Feng , Sicheng Gao , Xuhui Liu , Jiaming Liu , Li Lin , Xu Tang , Yao Hu , Jianzhuang Liu , Baochang Zhang

Recent advances in large multimodal models (LMMs) have enabled instruction-based image editing, allowing users to modify visual content via natural language descriptions. However, existing approaches often struggle with high-level semantic…

Human-Computer Interaction · Computer Science 2026-03-09 Minheng Ni , Yutao Fan , Zhengyuan Yang , Yeli Shen , Yuxiang Wei , Yaowen Zhang , Lijuan Wang , Lei Zhang , Wangmeng Zuo

Video recognition models are typically trained on fixed taxonomies which are often too coarse, collapsing distinctions in object, manner or outcome under a single label. As tasks and definitions evolve, such models cannot accommodate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Kaiting Liu , Hazel Doughty

Large-scale contrastive vision-language pre-trained models provide the zero-shot model achieving competitive performance across a range of image classification tasks without requiring training on downstream data. Recent works have confirmed…

Machine Learning · Computer Science 2024-04-02 Giung Nam , Byeongho Heo , Juho Lee

In recent years, it has become popular to tackle image restoration tasks with a single pretrained diffusion model (DM) and data-fidelity guidance, instead of training a dedicated deep neural network per task. However, such "zero-shot"…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Tomer Garber , Tom Tirer

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attributes: manually encoded…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Scott Reed , Zeynep Akata , Bernt Schiele , Honglak Lee

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Instruction-based image editing (IIE) has advanced rapidly with the success of diffusion models. However, existing efforts primarily focus on simple and explicit instructions to execute editing operations such as adding, deleting, moving,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Qingdong He , Xueqin Chen , Chaoyi Wang , Yanjie Pan , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Xiangtai Li , Jiangning Zhang

Diffusion-based image editing models have achieved significant progress in real world applications. However, conventional models typically rely on natural language prompts, which often lack the precision required to localize target objects.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haohang Xu , Lin Liu , Zhibo Zhang , Rong Cong , Xiaopeng Zhang , Qi Tian

Vision-language models (VLMs) are increasingly proposed as general-purpose solutions for visual recognition tasks, yet their reliability for agricultural decision support remains poorly understood. We benchmark a diverse set of open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Earl Ranario , Mason J. Earles

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang