English
Related papers

Related papers: WeEdit: A Dataset, Benchmark and Glyph-Guided Fram…

200 papers

We introduce $\texttt{Complex-Edit}$, a comprehensive benchmark designed to systematically evaluate instruction-based image editing models across instructions of varying complexity. To develop this benchmark, we harness GPT-4o to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Siwei Yang , Mude Hui , Bingchen Zhao , Yuyin Zhou , Nataniel Ruiz , Cihang Xie

Instruction-based image editing holds immense potential for a variety of applications, as it enables users to perform any editing operation using a natural language instruction. However, current models in this domain often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Shelly Sheynin , Adam Polyak , Uriel Singer , Yuval Kirstain , Amit Zohar , Oron Ashual , Devi Parikh , Yaniv Taigman

Instruction-based video editing has witnessed rapid progress, yet current methods often struggle with precise visual control, as natural language is inherently limited in describing complex visual nuances. Although reference-guided editing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yiqi Lin , Guoqiang Liang , Ziyun Zeng , Zechen Bai , Yanzhe Chen , Mike Zheng Shou

Text-driven image manipulation remains challenging in training or inference flexibility. Conditional generative models depend heavily on expensive annotated training data. Meanwhile, recent frameworks, which leverage pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yueming Lyu , Tianwei Lin , Fu Li , Dongliang He , Jing Dong , Tieniu Tan

Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal…

Sound · Computer Science 2026-01-21 Ye Tao , Wen Wu , Chao Zhang , Mengyue Wu , Shuai Wang , Xuenan Xu

Despite the progress in text-to-image generation, semantic image editing remains a challenge. Inversion-based algorithms unavoidably introduce reconstruction errors, while instruction-based models mainly suffer from limited dataset quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 En Ci , Shanyan Guan , Yanhao Ge , Yilin Zhang , Wei Li , Zhenyu Zhang , Jian Yang , Ying Tai

In this technical report, we introduce SEED-Data-Edit: a unique hybrid dataset for instruction-guided image editing, which aims to facilitate image manipulation using open-form language. SEED-Data-Edit is composed of three distinct types of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yuying Ge , Sijie Zhao , Chen Li , Yixiao Ge , Ying Shan

Currently, instruction-based image editing methods have made significant progress by leveraging the powerful cross-modal understanding capabilities of vision language models (VLMs). However, they still face challenges in three key areas: 1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jun Zhou , Jiahao Li , Zunnan Xu , Hanhui Li , Yiji Cheng , Fa-Ting Hong , Qin Lin , Qinglin Lu , Xiaodan Liang

We present FireRed-Image-Edit, a diffusion transformer for instruction-based image editing that achieves state-of-the-art performance through systematic optimization of data curation, training methodology, and evaluation design. We…

Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Rui Gui , Yang Wan , Haochen Han , Dongxing Mao , Fangming Liu , Min Li , Alex Jinpeng Wang

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "Make the sentence simpler" or "Write it in a more neutral…

Computation and Language · Computer Science 2023-10-25 Vipul Raheja , Dhruv Kumar , Ryan Koo , Dongyeop Kang

We present HumanEdit, a high-quality, human-rewarded dataset specifically designed for instruction-guided image editing, enabling precise and diverse image manipulations through open-form language instructions. Previous large-scale editing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Jinbin Bai , Wei Chow , Ling Yang , Xiangtai Li , Juncheng Li , Hanwang Zhang , Shuicheng Yan

Text-guided image editing, a pivotal task in modern multimedia content creation, has seen remarkable progress with training-free methods that eliminate the need for additional optimization. Despite recent progress, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Jinhao Shen , Haoqian Du , Xulu Zhang , Xiao-Yong Wei , Qing Li

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Instruction-based image editing enables precise modifications via natural language prompts, but existing methods face a precision-efficiency tradeoff: fine-tuning demands massive datasets (>10M) and computational resources, while…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zechuan Zhang , Ji Xie , Yu Lu , Zongxin Yang , Yi Yang

We present Qwen-Image, an image generation foundation model in the Qwen series that achieves significant advances in complex text rendering and precise image editing. To address the challenges of complex text rendering, we design a…

Text-guided image editing faces significant challenges when considering training and inference flexibility. Much literature collects large amounts of annotated image-text pairs to train text-conditioned generative models from scratch, which…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yueming Lyu , Kang Zhao , Bo Peng , Huafeng Chen , Yue Jiang , Yingya Zhang , Jing Dong , Caifeng Shan

While real-world applications increasingly demand intricate scene manipulation, existing instruction-guided image editing benchmarks often oversimplify task complexity and lack comprehensive, fine-grained instructions. To bridge this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Bohan Jia , Wenxuan Huang , Yuntian Tang , Junbo Qiao , Jincheng Liao , Shaosheng Cao , Fei Zhao , Zhaopeng Feng , Zhouhong Gu , Zhenfei Yin , Lei Bai , Wanli Ouyang , Lin Chen , Fei Zhao , Yao Hu , Zihan Wang , Yuan Xie , Shaohui Lin

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min