English
Related papers

Related papers: ControlEdit: A MultiModal Local Clothing Image Edi…

200 papers

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

While text-to-image diffusion models can generate highquality images from textual descriptions, they generally lack fine-grained control over the visual composition of the generated images. Some recent works tackle this problem by training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Denis Lukovnikov , Asja Fischer

Training of large-scale text-to-image and image-to-image models requires a huge amount of annotated data. While text-to-image datasets are abundant, data available for instruction-based image-to-image tasks like object addition and removal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Aniruddha Bala , Rohan Jaiswal , Siddharth Roheda , Rohit Chowdhury , Loay Rashid

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Recent advances in diffusion models have revolutionized text-guided image editing, yet existing editing methods face critical challenges in hyperparameter identification. To get the reasonable editing performance, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Chau Pham , Quan Dao , Mahesh Bhosale , Yunjie Tian , Dimitris Metaxas , David Doermann

Image style transfer is a challenging task in computational vision. Existing algorithms transfer the color and texture of style images by controlling the neural network's feature layers. However, they fail to control the strength of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Junjie Kang , Jinsong Wu , Shiqi Jiang

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min

Diffusion models have shown great results in image generation and in image editing. However, current approaches are limited to low resolutions due to the computational cost of training diffusion models for high-resolution generation. We…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Johannes Ackermann , Minjun Li

We consider the targeted image editing problem: blending a region in a source image with a driver image that specifies the desired change. Differently from prior works, we solve this problem by learning a conditional probability…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Andrew Brown , Cheng-Yang Fu , Omkar Parkhi , Tamara L. Berg , Andrea Vedaldi

We introduce PhotoDoodle, a novel image editing framework designed to facilitate photo doodling by enabling artists to overlay decorative elements onto photographs. Photo doodling is challenging because the inserted elements must appear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Shijie Huang , Yiren Song , Yuxuan Zhang , Hailong Guo , Xueyin Wang , Mike Zheng Shou , Jiaming Liu

We present a simple, yet effective diffusion-based method for fine-grained, parametric control over light sources in an image. Existing relighting methods either rely on multiple input views to perform inverse rendering at inference time,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Nadav Magar , Amir Hertz , Eric Tabellion , Yael Pritch , Alex Rav-Acha , Ariel Shamir , Yedid Hoshen

Multimodal Model Editing (MMED) aims to correct erroneous knowledge in multimodal models. Existing evaluation methods, adapted from textual model editing, overstate success by relying on low-similarity or random inputs, obscure overfitting.…

Machine Learning · Computer Science 2025-11-18 Xiaoqi Han , Ru Li , Ran Yi , Hongye Tan , Zhuomin Liang , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Multi-object images are prevalent in various real-world scenarios, including augmented reality, advertisement design, and medical imaging. Efficient and precise editing of these images is critical for these applications. With the advent of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yanfeng Li , Kahou Chan , Yue Sun , Chantong Lam , Tong Tong , Zitong Yu , Keren Fu , Xiaohong Liu , Tao Tan

Instruction-guided image editing consists in taking an image and an instruction and deliverring that image altered according to that instruction. State-of-the-art approaches to this task suffer from the typical scaling up and domain…

Computation and Language · Computer Science 2025-03-05 Rodrigo Santos , António Branco , João Silva , João Rodrigues

Recent advancements in large-scale text-to-image diffusion models have enabled many applications in image editing. However, none of these methods have been able to edit the layout of single existing images. To address this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Zhiyuan Zhang , Zhitong Huang , Jing Liao

Text-guided motion editing enables high-level semantic control and iterative modifications beyond traditional keyframe animation. Existing methods rely on limited pre-collected training triplets, which severely hinders their versatility in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Nan Jiang , Hongjie Li , Ziye Yuan , Zimo He , Yixin Chen , Tengyu Liu , Yixin Zhu , Siyuan Huang

Natural language offers a highly intuitive interface for enabling localized fine-grained edits of 3D shapes. However, prior works face challenges in preserving global coherence while locally modifying the input 3D shape. In this work, we…

Graphics · Computer Science 2025-07-22 Etai Sella , Noam Atia , Ron Mokady , Hadar Averbuch-Elor

Image diffusion models have been utilized in various tasks, such as text-to-image generation and controllable image synthesis. Recent research has introduced tuning methods that make subtle adjustments to the original models, yielding…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zeyinzi Jiang , Chaojie Mao , Yulin Pan , Zhen Han , Jingfeng Zhang

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

Recent advances in text-to-image (T2I) models have enabled training-free regional image editing by leveraging the generative priors of foundation models. However, existing methods struggle to balance text adherence in edited regions,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Weiyan Xie , Han Gao , Didan Deng , Kaican Li , April Hua Liu , Yongxiang Huang , Nevin L. Zhang