English
Related papers

Related papers: TextStyleBrush: Transfer of Text Aesthetics from a…

200 papers

In this work, we introduce an important but still unexplored research task -- image sentiment transfer. Compared with other related tasks that have been well-studied, such as image-to-image translation and image style transfer, transferring…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Tianlang Chen , Wei Xiong , Haitian Zheng , Jiebo Luo

Content and style (C-S) disentanglement is a fundamental problem and critical challenge of style transfer. Existing approaches based on explicit definitions (e.g., Gram matrix) or implicit learning (e.g., GANs) are neither interpretable nor…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhizhong Wang , Lei Zhao , Wei Xing

Existing handwritten text generation methods primarily focus on isolated words. However, realistic handwritten text demands attention not only to individual words but also to the relationships between them, such as vertical alignment and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Gang Dai , Yifan Zhang , Yutao Qin , Qiangya Guo , Shuangping Huang , Shuicheng Yan

We consider the problem of independently, in a disentangled fashion, controlling the outputs of text-to-image diffusion models with color and style attributes of a user-supplied reference image. We present the first training-free,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

A recent spate of state-of-the-art semi- and un-supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially equivariant tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Xiao Liu , Spyridon Thermos , Gabriele Valvano , Agisilaos Chartsias , Alison O'Neil , Sotirios A. Tsaftaris

This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label…

Computation and Language · Computer Science 2018-09-12 Vineet John , Lili Mou , Hareesh Bahuleyan , Olga Vechtomova

In this paper, we demonstrate a total disentanglement of font images. Total disentanglement is a neural network-based method for decomposing each font image nonlinearly and completely into its style and content (i.e., character class)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Daichi Haraguchi , Wataru Shimoda , Kota Yamaguchi , Seiichi Uchida

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Yunpeng Bai , Jiayue Liu , Chao Dong , Chun Yuan

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

While many recent any-to-any voice conversion models succeed in transferring some target speech's style information to the converted speech, they still lack the ability to faithfully reproduce the speaking style of the target speaker. In…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Hyungseob Lim , Kyungguen Byun , Sunkuk Moon , Erik Visser

Recent progresses in large-scale text-to-image models have yielded remarkable accomplishments, finding various applications in art domain. However, expressing unique characteristics of an artwork (e.g. brushwork, colortone, or composition)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Namhyuk Ahn , Junsoo Lee , Chunggi Lee , Kunhee Kim , Daesik Kim , Seung-Hun Nam , Kibeom Hong

Transfer learning of StyleGAN has recently shown great potential to solve diverse tasks, especially in domain translation. Previous methods utilized a source model by swapping or freezing weights during transfer learning, however, they have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Dongyeun Lee , Jae Young Lee , Doyeon Kim , Jaehyun Choi , Junmo Kim

Scene text images contain not only style information (font, background) but also content information (character, texture). Different scene text tasks need different information, but previous representation learning methods use tightly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Boqiang Zhang , Hongtao Xie , Zuan Gao , Yuxin Wang

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

Style transfer has been widely applied to give real-world images a new artistic look. However, given a stylized image, the attempts to use typical style transfer methods for de-stylization or transferring it again into another style usually…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Hung-Yu Chen , I-Sheng Fang , Wei-Chen Chiu

We propose a way of learning disentangled content-style representation of image, allowing us to extrapolate images to any style as well as interpolate between any pair of styles. By augmenting data set in a supervised setting and imposing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sailun Xu , Jiazhi Zhang , Jiamei Liu

The rapid development of generative diffusion models has significantly advanced the field of style transfer. However, most current style transfer methods based on diffusion models typically involve a slow iterative optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Feihong He , Gang Li , Fuhui Sun , Mengyuan Zhang , Lingyu Si , Xiaoyan Wang , Li Shen

We consider the problem of constraining diffusion model outputs with a user-supplied reference image. Our key objective is to extract multiple attributes (e.g., color, object, layout, style) from this single reference image, and then…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Aishwarya Agarwal , Srikrishna Karanam , Tripti Shukla , Balaji Vasan Srinivasan

We propose a novel, zero-shot image generation technique called "Visual Concept Blending" that provides fine-grained control over which features from multiple reference images are transferred to a source image. If only a single reference…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Hiroya Makino , Takahiro Yamaguchi , Hiroyuki Sakai

This paper presents an automatic image synthesis method to transfer the style of an example image to a content image. When standard neural style transfer approaches are used, the textures and colours in different semantic regions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Huihuang Zhao , Paul L. Rosin , Yu-Kun Lai