English
Related papers

Related papers: U-StyDiT: Ultra-high Quality Artistic Style Transf…

200 papers

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Diffusion Transformers (DiTs) excel at generation, but their global self-attention makes controllable, reference-image-based editing a distinct challenge. Unlike U-Nets, naively injecting local appearance into a DiT can disrupt its holistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shengrong Gu , Ye Wang , Song Wu , Rui Ma , Qian Wang , Lanjun Wang , Zili Yi

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

Diffusion Transformer (DiT), an emerging diffusion model for image generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs stem from the static inference…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Yibing Song , Gao Huang , Fan Wang , Yang You

Artistic style transfer aims to transfer the learned style onto an arbitrary content image. However, most existing style transfer methods can only render consistent artistic stylized images, making it difficult for users to get enough…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhanjie Zhang , Quanwei Zhang , Guangyuan Li , Junsheng Luan , Mengyuan Yang , Yun Wang , Lei Zhao

Despite their generative power, diffusion models struggle to maintain style consistency across images conditioned on the same style prompt, hindering their practical deployment in creative workflows. While several training-free methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiexuan Zhang , Yiheng Du , Qian Wang , Weiqi Li , Yu Gu , Jian Zhang

The stylization of 3D scenes is an increasingly attractive topic in 3D vision. Although image style transfer has been extensively researched with promising results, directly applying 2D style transfer methods to 3D scenes often fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yushen Zuo , Jun Xiao , Kin-Chung Chan , Rongkang Dong , Cuixin Yang , Zongqi He , Hao Xie , Kin-Man Lam

Transformer-based diffusion models have recently superseded traditional U-Net architectures, with multimodal diffusion transformers (MM-DiT) emerging as the dominant approach in state-of-the-art models like Stable Diffusion 3 and Flux.1.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joonghyuk Shin , Alchan Hwang , Yujin Kim , Daneul Kim , Jaesik Park

Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion frameworks. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Marvin Seyfarth , Salman Ul Hassan Dar , Yannik Frisch , Philipp Wild , Norbert Frey , Florian André , Sandy Engelhardt

Diffusion models have recently shown the ability to generate high-quality images. However, controlling its generation process still poses challenges. The image style transfer task is one of those challenges that transfers the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Kento Masui , Mayu Otani , Masahiro Nomura , Hideki Nakayama

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kunxiao Liu , Guowu Yuan , Hao Wu , Wenhua Qian

Although image-based virtual try-on has made considerable progress, emerging approaches still encounter challenges in producing high-fidelity and robust fitting images across diverse scenarios. These methods often struggle with issues such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Boyuan Jiang , Xiaobin Hu , Donghao Luo , Qingdong He , Chengming Xu , Jinlong Peng , Jiangning Zhang , Chengjie Wang , Yunsheng Wu , Yanwei Fu

Recent studies have shown remarkable success in universal style transfer which transfers arbitrary visual styles to content images. However, existing approaches suffer from the aesthetic-unrealistic problem that introduces disharmonious…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Zhizhong Wang , Zhanjie Zhang , Lei Zhao , Zhiwen Zuo , Ailin Li , Wei Xing , Dongming Lu

Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Gihyun Kwon , Jong Chul Ye

Image-based fashion design with AI techniques has attracted increasing attention in recent years. We focus on a new fashion design task, where we aim to transfer a reference appearance image onto a clothing image while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Shidong Cao , Wenhao Chai , Shengyu Hao , Yanting Zhang , Hangyue Chen , Gaoang Wang

The concept of waterbody style transfer remains largely unexplored in the underwater imaging and vision literature. Traditional image style transfer (STx) methods primarily focus on artistic and photorealistic blending, often failing to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Md Abu Bakr Siddique , Vaishnav Ramesh , Junliang Liu , Piyush Singh , Md Jahidul Islam

Despite recent advances in UNet-based image editing, methods for shape-aware object editing in high-resolution images are still lacking. Compared to UNet, Diffusion Transformers (DiT) demonstrate superior capabilities to effectively capture…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Kunyu Feng , Yue Ma , Bingyuan Wang , Chenyang Qi , Haozhe Chen , Qifeng Chen , Zeyu Wang

Although remarkable progress has been made in image style transfer, style is just one of the components of artistic paintings. Directly transferring extracted style features to natural images often results in outputs with obvious synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Nisha Huang , Weiming Dong , Yuxin Zhang , Fan Tang , Ronghui Li , Chongyang Ma , Xiu Li , Tong-Yee Lee , Changsheng Xu

In layout-to-image (L2I) synthesis, controlled complex scenes are generated from coarse information like bounding boxes. Such a task is exciting to many downstream applications because the input layouts offer strong guidance to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruyu Wang , Xuefeng Hou , Sabrina Schmedding , Marco F. Huber

Training-free diffusion-based methods have achieved remarkable success in style transfer, eliminating the need for extensive training or fine-tuning. However, due to the lack of targeted training for style information extraction and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ruojun Xu , Weijie Xi , Xiaodi Wang , Yongbo Mao , Zach Cheng