English
Related papers

Related papers: Stylistic Attribute Control in Latent Diffusion Mo…

200 papers

Recent advances in image editing leverage latent diffusion models (LDMs) for versatile, text-prompt-driven edits across diverse tasks. Yet, maintaining pixel-level edge structures-crucial for tasks such as photorealistic style transfer or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Minsu Gong , Nuri Ryu , Jungseul Ok , Sunghyun Cho

Color and tone stylization strives to enhance unique themes with artistic color and tone adjustments. It has a broad range of applications from professional image postprocessing to photo sharing over social networks. Mainstream photo…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Feida Zhu , Yizhou Yu

Long-tailed class imbalance remains a fundamental obstacle in semantic segmentation of high-resolution remote-sensing imagery, where dominant classes shape learned representations and rare classes are systematically under-segmented. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Buddhi Wijenayake , Nichula Wasalathilake , Roshan Godaliyadda , Vijitha Herath , Parakrama Ekanayake , Vishal M. Patel

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Haitian Zheng , Yuan Yao , Yongsheng Yu , Yuqian Zhou , Jiebo Luo , Zhe Lin

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Diffusion models demonstrate impressive image generation performance with text guidance. Inspired by the learning process of diffusion, existing images can be edited according to text by DDIM inversion. However, the vanilla DDIM inversion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qi Qian , Haiyang Xu , Ming Yan , Juhua Hu

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

Text-to-Image Diffusion Models such as Stable-Diffusion and Imagen have achieved unprecedented quality of photorealism with state-of-the-art FID scores on MS-COCO and other generation benchmarks. Given a caption, image generation requires…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Samyadeep Basu , Nanxuan Zhao , Vlad Morariu , Soheil Feizi , Varun Manjunatha

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Sherry X. Chen , Yaron Vaxman , Elad Ben Baruch , David Asulin , Aviad Moreshet , Kuo-Chin Lien , Misha Sra , Pradeep Sen

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

The dominant approach to unsupervised "style transfer" in text is based on the idea of learning a latent representation, which is independent of the attributes specifying its "style". In this paper, we show that this condition is not…

Computation and Language · Computer Science 2019-09-23 Sandeep Subramanian , Guillaume Lample , Eric Michael Smith , Ludovic Denoyer , Marc'Aurelio Ranzato , Y-Lan Boureau

We consider the problem of independently, in a disentangled fashion, controlling the outputs of text-to-image diffusion models with color and style attributes of a user-supplied reference image. We present the first training-free,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan