English
Related papers

Related papers: LimeCross: Context-Conditioned Layered Image Editi…

200 papers

Diffusion models have enabled high-quality, conditional image editing capabilities. We propose to expand their arsenal, and demonstrate that off-the-shelf diffusion models can be used for a wide range of cross-domain compositing tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Roy Hachnochi , Mingrui Zhao , Nadav Orzech , Rinon Gal , Ali Mahdavi-Amiri , Daniel Cohen-Or , Amit Haim Bermano

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglin Wang , Yucheng Zhou , Qianning Wang , Zhe Wang , Kai Zhang

Image captioning has emerged as an interesting research field in recent years due to its broad application scenarios. The traditional paradigm of image captioning relies on paired image-caption datasets to train the model in a supervised…

Computation and Language · Computer Science 2022-02-08 Jiahui Gao , Yi Zhou , Philip L. H. Yu , Shafiq Joty , Jiuxiang Gu

Recent developments in the field of diffusion models have demonstrated an exceptional capacity to generate high-quality prompt-conditioned image edits. Nevertheless, previous approaches have primarily relied on textual prompts for image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Goirik Chakrabarty , Aditya Chandrasekar , Ramya Hebbalaguppe , Prathosh AP

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yigit Ekin , Yossi Gandelsman

We seek to give users precise control over diffusion-based image generation by modeling complex scenes as sequences of layers, which define the desired spatial arrangement and visual attributes of objects in the scene. Collage Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vishnu Sarukkai , Linden Li , Arden Ma , Christopher Ré , Kayvon Fatahalian

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Recent diffusion-based image editing approaches have exhibited impressive editing capabilities in images with simple compositions. However, localized editing in complex scenarios has not been well-studied in the literature, despite its…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Qi Mao , Lan Chen , Yuchao Gu , Zhen Fang , Mike Zheng Shou

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content. Among various editing methods, editing within the prompt space gains more…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Aosong Feng , Weikang Qiu , Jinbin Bai , Xiao Zhang , Zhen Dong , Kaicheng Zhou , Rex Ying , Leandros Tassiulas

With the surge of pre-trained text-to-image flow matching models, text-based image editing performance has gained remarkable improvement, especially for \underline{simple editing} that only contains a single editing target. To satisfy the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yilei Jiang , Zhen Wang , Yanghao Wang , Jun Yu , Yueting Zhuang , Jun Xiao , Long Chen

Recent advances in diffusion-based text-to-image generation have demonstrated promising results through visual condition control. However, existing ControlNet-like methods struggle with compositional visual conditioning - simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yanjie Pan , Qingdong He , Zhengkai Jiang , Pengcheng Xu , Chaoyi Wang , Jinlong Peng , Haoxuan Wang , Yun Cao , Zhenye Gan , Mingmin Chi , Bo Peng , Yabiao Wang

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Lvmin Zhang , Maneesh Agrawala

The recent success of text-to-image generation diffusion models has also revolutionized semantic image editing, enabling the manipulation of images based on query/target texts. Despite these advancements, a significant challenge lies in the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zuopeng Yang , Tianshu Chu , Xin Lin , Erdun Gao , Daqing Liu , Jie Yang , Chaoyue Wang

Region-instructed layout control in text-to-image generation is highly practical, yet existing methods suffer from limitations: (i) training-based approaches inherit data bias and often degrade image quality, and (ii) current techniques…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruidong Chen , Yancheng Bai , Xuanpu Zhang , Jianhao Zeng , Lanjun Wang , Dan Song , Lei Sun , Xiangxiang Chu , Anan Liu

Recent advances in instruction-based image editing have shown remarkable progress. However, existing methods remain limited to relatively simple editing operations, hindering real-world applications that require complex and compositional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xuehai Bai , Xiaoling Gu , Akide Liu , Hangjie Yuan , YiFan Zhang , Jack Ma

Text-to-image diffusion models allow seamless generation of personalized images from scant reference photos. Yet, these tools, in the wrong hands, can fabricate misleading or harmful content, endangering individuals. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yixin Liu , Chenrui Fan , Yutong Dai , Xun Chen , Pan Zhou , Lichao Sun

The rapid advancement of diffusion models has increased the need for customized image generation. However, current customization methods face several limitations: 1) typically accept either image or text conditions alone; 2) customization…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Han Yang , Chuanguang Yang , Qiuli Wang , Zhulin An , Weilun Feng , Libo Huang , Yongjun Xu