English
Related papers

Related papers: UltraEdit: Instruction-based Fine-Grained Image Ed…

200 papers

Forensic analysis of AI-edited images requires more than binary real-versus-fake prediction: a useful system should localize the edit, identify its semantic type, and ground its decisions in visual evidence. Existing image-forensics…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Van-Loc Nguyen , AprilPyone MaungMaung , Minh-Triet Tran , Isao Echizen

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Diffusion models have demonstrated outstanding performance in generative tasks, making them ideal candidates for image editing. Recent studies highlight their ability to apply desired edits effectively by following textual instructions, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Mohammadreza Samadi , Fred X. Han , Mohammad Salameh , Hao Wu , Fengyu Sun , Chunhua Zhou , Di Niu

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We propose a novel algorithm, named Open-Edit, which is the first attempt on open-domain image manipulation with open-vocabulary instructions. It is a challenging task considering the large variation of image domains and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Xihui Liu , Zhe Lin , Jianming Zhang , Handong Zhao , Quan Tran , Xiaogang Wang , Hongsheng Li

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

With the rapid advancement of commercial multi-modal models, image editing has garnered significant attention due to its widespread applicability in daily life. Despite impressive progress, existing image editing systems, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yiran Zhao , Yaoqi Ye , Xiang Liu , Michael Qizhe Shieh , Trung Bui

We present InstructHumans, a novel framework for instruction-driven {animatable} 3D human texture editing. Existing text-based 3D editing methods often directly apply Score Distillation Sampling (SDS). SDS, designed for generation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jiayin Zhu , Linlin Yang , Angela Yao

This paper introduces a novel dataset construction pipeline that samples pairs of frames from videos and uses multimodal large language models (MLLMs) to generate editing instructions for training instruction-based image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mingdeng Cao , Xuaner Zhang , Yinqiang Zheng , Zhihao Xia

Text-guided diffusion models have significantly advanced image editing, enabling highly realistic and local modifications based on textual prompts. While these developments expand creative possibilities, their malicious use poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Valentina Bazyleva , Nicolo Bonettini , Gaurav Bharaj

Instruction-based image editing (IIE) aims to modify images according to textual instructions while preserving irrelevant content. Despite recent advances in diffusion transformers, existing methods often suffer from over-editing,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jingxuan He , Xiyu Wang , Mengyu Zheng , Xiangyu Zeng , Yunke Wang , Chang Xu

Ultra-high-resolution image synthesis holds significant potential, yet remains an underexplored challenge due to the absence of standardized benchmarks and computational constraints. In this paper, we establish Aesthetic-4K, a meticulously…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jinjin Zhang , Qiuyu Huang , Junjie Liu , Xiefan Guo , Di Huang

Instruction tuning enables pretrained language models to perform new tasks from inference-time natural language descriptions. These approaches rely on vast amounts of human supervision in the form of crowdsourced datasets or user…

Computation and Language · Computer Science 2022-12-20 Or Honovich , Thomas Scialom , Omer Levy , Timo Schick

Instruction-based image editing offers a powerful and intuitive way to manipulate images through natural language. Yet, relying solely on text instructions limits fine-grained control over the extent of edits. We introduce Kontinuous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Rishubh Parihar , Or Patashnik , Daniil Ostashev , R. Venkatesh Babu , Daniel Cohen-Or , Kuan-Chieh Wang

Recent advances in diffusion models have enabled high-quality generation and manipulation of images guided by texts, as well as concept learning from images. However, naive applications of existing methods to editing tasks that require…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Xudong Liu , Zikun Chen , Ruowei Jiang , Ziyi Wu , Kejia Yin , Han Zhao , Parham Aarabi , Igor Gilitschenski

While diffusion models show promising results in image editing given a target prompt, achieving both prompt fidelity and background preservation remains difficult. Recent works have introduced score distillation techniques that leverage the…

Instruction-based image editing enables intuitive manipulation through natural language commands. However, text instructions alone often lack the precision required for fine-grained control over edit intensity. We introduce NumeriKontrol, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenyu Xu , Xiaoqi Shen , Haotian Nan , Xinyu Zhang

We address the task of multi-view image editing from sparse input views, where the inputs can be seen as a mix of images capturing the scene from different viewpoints. The goal is to modify the scene according to a textual instruction while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Daniel Gilo , Or Litany

Despite recent advances in large-scale text-to-image generative models, manipulating real images with these models remains a challenging problem. The main limitations of existing editing methods are that they either fail to perform with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Vadim Titov , Madina Khalmatova , Alexandra Ivanova , Dmitry Vetrov , Aibek Alanov

Existing image editing tools, while powerful, typically disregard the underlying 3D geometry from which the image is projected. As a result, edits made using these tools may become detached from the geometry and lighting conditions that are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Oscar Michel , Anand Bhattad , Eli VanderBilt , Ranjay Krishna , Aniruddha Kembhavi , Tanmay Gupta