English
Related papers

Related papers: StylerDALLE: Language-Guided Style Transfer Using …

200 papers

Style transfer TTS has shown impressive performance in recent years. However, style control is often restricted to systems built on expressive speech recordings with discrete style categories. In practical situations, users may be…

Sound · Computer Science 2023-06-02 Guanghou Liu , Yongmao Zhang , Yi Lei , Yunlin Chen , Rui Wang , Zhifei Li , Lei Xie

Non-parallel text style transfer has attracted increasing research interests in recent years. Despite successes in transferring the style based on the encoder-decoder framework, current approaches still lack the ability to preserve the…

Computation and Language · Computer Science 2021-02-02 Yukai Shi , Sen Zhang , Chenxing Zhou , Xiaodan Liang , Xiaojun Yang , Liang Lin

Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Silky Singh , Surgan Jandial , Simra Shahid , Abhinav Java

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Onkar Susladkar , Gayatri Deshmukh , Sparsh Mittal , Parth Shastri

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

Despite having promising results, style transfer, which requires preparing style images in advance, may result in lack of creativity and accessibility. Following human instruction, on the other hand, is the most natural way to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsu-Jui Fu , Xin Eric Wang , William Yang Wang

Convolutional neural networks (CNNs) have proven highly effective at image synthesis and style transfer. For most users, however, using them as tools can be a challenging task due to their unpredictable behavior that goes against common…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Alex J. Champandard

Diffusion models have emerged as the dominant paradigm for style transfer, but their text-driven mechanism is hindered by a core limitation: it treats textual descriptions as uniform, monolithic guidance. This limitation overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuanlin Yang , Quanjian Song , Zhexian Gao , Ge Wang , Shanshan Li , Xiaoyan Zhang

Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content. Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey…

Computation and Language · Computer Science 2023-06-16 Yazheng Yang , Zhou Zhao , Qi Liu

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Recent years have witnessed significant advancements in text-guided style transfer, primarily attributed to innovations in diffusion models. These models excel in conditional guidance, utilizing text or images to direct the sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Nisha Huang , Kaer Huang , Yifan Pu , Jiangshan Wang , Jie Guo , Yiqiang Yan , Xiu Li , Tong-Yee Lee

In this pioneering study, we introduce StyleWallfacer, a groundbreaking unified training and inference framework, which not only addresses various issues encountered in the style transfer process of traditional methods but also unifies the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Gary Song Yan , Yusen Zhang , Jinyu Zhao , Hao Zhang , Zhangping Yang , Guanye Xiong , Yanfei Liu , Tao Zhang , Yujie He , Siyuan Tian , Yao Gou , Min Li

Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhanjie Zhang , Jiakai Sun , Guangyuan Li , Lei Zhao , Quanwei Zhang , Zehua Lan , Haolin Yin , Wei Xing , Huaizhong Lin , Zhiwen Zuo

We present StyleClone, a method for training image-to-image translation networks to stylize faces in a specific style, even with limited style images. Our approach leverages textual inversion and diffusion-based guided image generation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Neeraj Matiyali , Siddharth Srivastava , Gaurav Sharma

Modern works on style transfer focus on transferring style from a single image. Recently, some approaches study multiple style transfer; these, however, are either too slow or fail to mix multiple styles. We propose ST-VAE, a Variational…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Zhi-Song Liu , Vicky Kalogeiton , Marie-Paule Cani

Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Kunhee Kim , Sanghun Park , Eunyeong Jeon , Taehun Kim , Daijin Kim

The mechanism of existing style transfer algorithms is by minimizing a hybrid loss function to push the generated image toward high similarities in both content and style. However, this type of approach cannot guarantee visual fidelity,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Siyu Huang , Jie An , Donglai Wei , Jiebo Luo , Hanspeter Pfister

We present an approach to example-based stylization of images that uses a single pair of a source image and its stylized counterpart. We demonstrate how to train an image translation network that can perform real-time semantically…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 David Futschik , Michal Kučera , Michal Lukáč , Zhaowen Wang , Eli Shechtman , Daniel Sýkora

Universal style transfer methods typically leverage rich representations from deep Convolutional Neural Network (CNN) models (e.g., VGG-19) pre-trained on large collections of images. Despite the effectiveness, its application is heavily…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Huan Wang , Yijun Li , Yuehai Wang , Haoji Hu , Ming-Hsuan Yang