English
Related papers

Related papers: SCAdapter: Content-Style Disentanglement for Diffu…

200 papers

Recent advances in diffusion models for image generation have led to detailed examinations of several components within the U-Net architecture for image editing. While previous studies have focused on the bottleneck layer (h-space),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Ludovica Schaerf , Andrea Alfarano , Fabrizio Silvestri , Leonardo Impett

In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Trevor D. Canham , Adrián Martín , Marcelo Bertalmío , Javier Portilla

3D Human motion style transfer is a fundamental problem in computer graphic and animation processing. Existing AdaIN- based methods necessitate datasets with balanced style distribution and content/style labels to train the clustered latent…

Graphics · Computer Science 2024-08-08 Lei Hu , Zihao Zhang , Yongjing Ye , Yiwen Xu , Shihong Xia

In recent years, language-driven artistic style transfer has emerged as a new type of style transfer technique, eliminating the need for a reference style image by using natural language descriptions of the style. The first model to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ananda Padhmanabhan Suresh , Sanjana Jain , Pavit Noinongyao , Ankush Ganguly , Ukrit Watchareeruetai , Aubin Samacoits

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Onkar Susladkar , Gayatri Deshmukh , Sparsh Mittal , Parth Shastri

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

Transferring visual style between images while preserving semantic correspondence between similar objects remains a central challenge in computer vision. While existing methods have made great strides, most of them operate at global level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Wenbo Nie , Zixiang Li , Renshuai Tao , Bin Wu , Yunchao Wei , Yao Zhao

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

Ultra-high quality artistic style transfer refers to repainting an ultra-high quality content image using the style information learned from the style image. Existing artistic style transfer methods can be categorized into style…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhanjie Zhang , Ao Ma , Ke Cao , Jing Wang , Shanyuan Liu , Yuhang Ma , Bo Cheng , Dawei Leng , Yuhui Yin

Image completion is a challenging task, particularly when ensuring that generated content seamlessly integrates with existing parts of an image. While recent diffusion models have shown promise, they often struggle with maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Pourya Shamsolmoali , Masoumeh Zareapoor , Huiyu Zhou , Michael Felsberg , Dacheng Tao , Xuelong Li

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

CLIPStyler demonstrated image style transfer with realistic textures using only a style text description (instead of requiring a reference style image). However, the ground semantics of objects in the style transfer output is lost due to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Chanda Grover Kamra , Indra Deep Mastan , Debayan Gupta

This paper reports on the development of \textbf{a novel style guided diffusion model (SGDiff)} which overcomes certain weaknesses inherent in existing models for image synthesis. The proposed SGDiff combines image modality with a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhengwentai Sun , Yanghong Zhou , Honghong He , P. Y. Mok

Recent advances in latent diffusion models have enabled exciting progress in image style transfer. However, several key issues remain. For example, existing methods still struggle to accurately match styles. They are often limited in the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Dan Ruta , Abdelaziz Djelouah , Raphael Ortiz , Christopher Schroers

The slow inference process of image diffusion models significantly degrades interactive user experiences. To address this, we introduce Diffusion Preview, a novel paradigm employing rapid, low-step sampling to generate preliminary outputs…

Machine Learning · Computer Science 2026-04-08 Fu-Yun Wang , Hao Zhou , Liangzhe Yuan , Sanghyun Woo , Boqing Gong , Bohyung Han , Ming-Hsuan Yang , Han Zhang , Yukun Zhu , Ting Liu , Long Zhao

Diffusion models have emerged as the dominant paradigm for style transfer, but their text-driven mechanism is hindered by a core limitation: it treats textual descriptions as uniform, monolithic guidance. This limitation overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuanlin Yang , Quanjian Song , Zhexian Gao , Ge Wang , Shanshan Li , Xiaoyan Zhang

Explicitly disentangling style and content in vision models remains challenging due to their semantic overlap and the subjectivity of human perception. Existing methods propose separation through generative or discriminative objectives, but…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Pingchuan Ma , Xiaopei Yang , Yusong Li , Ming Gui , Felix Krause , Johannes Schusterbauer , Björn Ommer

Inspired by the in-context learning mechanism of large language models (LLMs), a new paradigm of generalizable visual prompt-based image editing is emerging. Existing single-reference methods typically focus on style or appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yan Gong , Yiren Song , Yicheng Li , Chenglin Li , Yin Zhang

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Current face reenactment and swapping methods mainly rely on GAN frameworks, but recent focus has shifted to pre-trained diffusion models for their superior generation capabilities. However, training these models is resource-intensive, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Han , Junwei Zhu , Keke He , Xu Chen , Yanhao Ge , Wei Li , Xiangtai Li , Jiangning Zhang , Chengjie Wang , Yong Liu