English
Related papers

Related papers: Visual Instruction Inversion: Image Editing via Vi…

200 papers

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Text-driven diffusion models have significantly advanced the image editing performance by using text prompts as inputs. One crucial step in text-driven image editing is to invert the original image into a latent noise code conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Ruibin Li , Ruihuang Li , Song Guo , Lei Zhang

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Image editing is an iterative process that requires precise visual evaluation and manipulation for the output to match the editing intent. However, current image editing tools do not provide accessible interaction nor sufficient feedback…

Human-Computer Interaction · Computer Science 2024-08-14 Ruei-Che Chang , Yuxuan Liu , Lotus Zhang , Anhong Guo

Fashion illustration is a crucial medium for designers to convey their creative vision and transform design concepts into tangible representations that showcase the interplay between clothing and the human body. In the context of fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Alberto Baldrati , Davide Morelli , Marcella Cornia , Marco Bertini , Rita Cucchiara

Text-conditional image editing is a practical AIGC task that has recently emerged with great commercial and academic value. For real image editing, most diffusion model-based methods use DDIM Inversion as the first stage before editing.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiancheng Huang , Yi Huang , Jianzhuang Liu , Donghao Zhou , Yifan Liu , Shifeng Chen

We investigate the efficacy of visual prompting to adapt large-scale models in vision. Following the recent approach from prompt tuning and adversarial reprogramming, we learn a single image perturbation such that a frozen model prompted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Hyojin Bahng , Ali Jahanian , Swami Sankaranarayanan , Phillip Isola

This paper presents SPIE: a novel approach for semantic and structural post-training of instruction-based image editing diffusion models, addressing key challenges in alignment with user prompts and consistency with input images. We…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Elior Benarous , Yilun Du , Heng Yang

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

Diffusion models have significantly improved the performance of image editing. Existing methods realize various approaches to achieve high-quality image editing, including but not limited to text control, dragging operation, and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Bohan Zeng , Jiaming Liu , Hong Li , Minghao Xu , Wentao Zhang , Shuicheng Yan

Generative text-to-image models, which allow users to create appealing images through a text prompt, have seen a dramatic increase in popularity in recent years. However, most users have a limited understanding of how such models work and…

Human-Computer Interaction · Computer Science 2024-03-15 Yuhan Guo , Hanning Shao , Can Liu , Kai Xu , Xiaoru Yuan

Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Linn Bieske , Carla Lorente

We propose an interactive image-manipulation system with natural language instruction, which can generate a target image from a source image and an instruction that describes the difference between the source and the target image. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Seitaro Shinagawa , Koichiro Yoshino , Sakriani Sakti , Yu Suzuki , Satoshi Nakamura

The diversity, quantity, and quality of manipulation data are critical for training effective robot policies. However, due to hardware and physical setup constraints, collecting large-scale real-world manipulation data remains difficult to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Boyang Wang , Haoran Zhang , Shujie Zhang , Jinkun Hao , Mingda Jia , Qi Lv , Yucheng Mao , Zhaoyang Lyu , Jia Zeng , Xudong Xu , Jiangmiao Pang

Text-conditioned image editing is a recently emerged and highly practical task, and its potential is immeasurable. However, most of the concurrent methods are unable to perform action editing, i.e. they can not produce results that conform…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Jiancheng Huang , Yifan Liu , Jin Qin , Shifeng Chen

Recent advancements in text-guided image editing have achieved notable success by leveraging natural language prompts for fine-grained semantic control. However, certain editing semantics are challenging to specify precisely using textual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Haoguang Lu , Jiacheng Chen , Zhenguo Yang , Aurele Tohokantche Gnanha , Fu Lee Wang , Li Qing , Xudong Mao

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

Visually-guided image editing, where edits are conditioned on both visual cues and textual prompts, has emerged as a powerful paradigm for fine-grained, controllable content generation. Although recent generative models have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sara Ghazanfari , Wei-An Lin , Haitong Tian , Ersin Yumer

Image restoration has always been a cutting-edge topic in the academic and industrial fields of computer vision. Since degradation signals are often random and diverse, "all-in-one" models that can do blind image restoration have been…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Qiuhai Yan , Aiwen Jiang , Kang Chen , Long Peng , Qiaosi Yi , Chunjie Zhang

Fashion-image editing represents a challenging computer vision task, where the goal is to incorporate selected apparel into a given input image. Most existing techniques, known as Virtual Try-On methods, deal with this task by first…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Martin Pernuš , Clinton Fookes , Vitomir Štruc , Simon Dobrišek