English
Related papers

Related papers: Deep Image Style Transfer from Freeform Text

200 papers

The diffusion-based text-to-image model harbors immense potential in transferring reference style. However, current encoder-based approaches significantly impair the text controllability of text-to-image models while transferring styles. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Tianhao Qi , Shancheng Fang , Yanze Wu , Hongtao Xie , Jiawei Liu , Lang Chen , Qian He , Yongdong Zhang

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Photorealistic style transfer is the task of synthesizing a realistic-looking image when adapting the content from one image to appear in the style of another image. Modern models commonly embed a transformation that fuses features…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Tai-Yin Chiu , Danna Gurari

Neural style transfer draws researchers' attention, but the interest focuses on bitmap images. Various models have been developed for bitmap image generation both online and offline with arbitrary and pre-trained styles. However, the style…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Valeria Efimova , Artyom Chebykin , Ivan Jarsky , Evgenii Prosvirnin , Andrey Filchenkov

In this work we introduce a novel medical image style transfer method, StyleMapper, that can transfer medical scans to an unseen style with access to limited training data. This is made possible by training our model on unlimited…

Image and Video Processing · Electrical Eng. & Systems 2024-02-08 Shixing Cao , Nicholas Konz , James Duncan , Maciej A. Mazurowski

In this pioneering study, we introduce StyleWallfacer, a groundbreaking unified training and inference framework, which not only addresses various issues encountered in the style transfer process of traditional methods but also unifies the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Gary Song Yan , Yusen Zhang , Jinyu Zhao , Hao Zhang , Zhangping Yang , Guanye Xiong , Yanfei Liu , Tao Zhang , Yujie He , Siyuan Tian , Yao Gou , Min Li

Unsupervised image-to-image translation methods have achieved tremendous success in recent years. However, it can be easily observed that their models contain significant entanglement which often hurts the translation performance. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Aviv Gabbay , Yedid Hoshen

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu

This study investigates how artificial intelligence (AI) recognizes style through style transfer-an AI technique that generates a new image by applying the style of one image to another. Despite the considerable interest that style transfer…

Graphics · Computer Science 2025-04-22 Yunha Yeo , Daeho Um

Text style transfer without parallel data has achieved some practical success. However, in the scenario where less data is available, these methods may yield poor performance. In this paper, we examine domain adaptation for text style…

Computation and Language · Computer Science 2019-08-27 Dianqi Li , Yizhe Zhang , Zhe Gan , Yu Cheng , Chris Brockett , Ming-Ting Sun , Bill Dolan

Recently, methods have been proposed that perform texture synthesis and style transfer by using convolutional neural networks (e.g. Gatys et al. [2015,2016]). These methods are exciting because they can in some cases create results with…

Graphics · Computer Science 2017-02-09 Eric Risser , Pierre Wilmot , Connelly Barnes

While many recent any-to-any voice conversion models succeed in transferring some target speech's style information to the converted speech, they still lack the ability to faithfully reproduce the speaking style of the target speaker. In…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Hyungseob Lim , Kyungguen Byun , Sunkuk Moon , Erik Visser

Diffusion models have revolted the field of text-to-image generation recently. The unique way of fusing text and image information contributes to their remarkable capability of generating highly text-related images. From another…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Changming Xiao , Qi Yang , Feng Zhou , Changshui Zhang

It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Although many such texts contain stereotypes and biases that inherently exist in natural language for reasons…

Computation and Language · Computer Science 2022-01-24 Ewoenam Kwaku Tokpo , Toon Calders

Attribute-controlled text rewriting, also known as text style-transfer, has a crucial role in regulating attributes and biases of textual training data and a machine generated text. In this work we present SimpleStyle, a minimalist yet…

Computation and Language · Computer Science 2022-12-23 Elron Bandel , Yoav Katz , Noam Slonim , Liat Ein-Dor

As light field images continue to increase in use and application, it becomes necessary to adapt existing image processing methods to this unique form of photography. In this paper we explore methods for applying neural style transfer to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 David Hart , Jessica Greenland , Bryan Morse

Transferring visual style between images while preserving semantic correspondence between similar objects remains a central challenge in computer vision. While existing methods have made great strides, most of them operate at global level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Wenbo Nie , Zixiang Li , Renshuai Tao , Bin Wu , Yunchao Wei , Yao Zhao

We address the problem of unpaired geometric image-to-image translation. Rather than transferring the style of an image as a whole, our goal is to translate the geometry of an object as depicted in different domains while preserving its…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Kaili Wang , Liqian Ma , Jose Oramas , Luc Van Gool , Tinne Tuytelaars

While recent text-to-image models can generate photorealistic images from text prompts that reflect detailed instructions, they still face significant challenges in accurately rendering words in the image. In this paper, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Wataru Shimoda , Naoto Inoue , Daichi Haraguchi , Hayato Mitani , Seiichi Uchida , Kota Yamaguchi