English
Related papers

Related papers: TextStyleBrush: Transfer of Text Aesthetics from a…

200 papers

Voice style conversion aims to transform an input utterance to match a target speaker's timbre, accent, and emotion, with a central challenge being the disentanglement of linguistic content from style. While prior work has explored this…

Sound · Computer Science 2026-02-24 Yisi Liu , Nicholas Lee , Gopala Anumanchipalli

Pre-trained large text-to-image models synthesize impressive images with an appropriate use of text prompts. However, ambiguities inherent in natural language and out-of-distribution effects make it hard to synthesize image styles, that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kihyuk Sohn , Nataniel Ruiz , Kimin Lee , Daniel Castro Chin , Irina Blok , Huiwen Chang , Jarred Barber , Lu Jiang , Glenn Entis , Yuanzhen Li , Yuan Hao , Irfan Essa , Michael Rubinstein , Dilip Krishnan

Recent advances in style and appearance transfer are impressive, but most methods isolate global style and local appearance transfer, neglecting semantic correspondence. Additionally, image and video tasks are typically handled in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Huiang He , Minghui Hu , Chuanxia Zheng , Chaoyue Wang , Tat-Jen Cham

In this paper, we show that, a good style representation is crucial and sufficient for generalized style transfer without test-time tuning. We achieve this through constructing a style-aware encoder and a well-organized style dataset called…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Junyao Gao , Yanchen Liu , Yanan Sun , Yinhao Tang , Yanhong Zeng , Kai Chen , Cairong Zhao

In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Trevor D. Canham , Adrián Martín , Marcelo Bertalmío , Javier Portilla

We contribute an unsupervised method that effectively learns disentangled content and style representations from sequences of observations. Unlike most disentanglement algorithms that rely on domain-specific labels or knowledge, our method…

Machine Learning · Computer Science 2025-03-18 Yuxuan Wu , Ziyu Wang , Bhiksha Raj , Gus Xia

Motivated by recent advancements in text-to-image diffusion, we study erasure of specific concepts from the model's weights. While Stable Diffusion has shown promise in producing explicit or realistic artwork, it has raised concerns…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Rohit Gandikota , Joanna Materzynska , Jaden Fiotto-Kaufman , David Bau

Text style transfer is the task that generates a sentence by preserving the content of the input sentence and transferring the style. Most existing studies are progressing on non-parallel datasets because parallel datasets are limited and…

Computation and Language · Computer Science 2020-11-30 Joosung Lee

For speaker recognition, it is difficult to extract an accurate speaker representation from speech because of its mixture of speaker traits and content. This paper proposes a disentanglement framework that simultaneously models speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-02 Tianchi Liu , Kong Aik Lee , Qiongqiong Wang , Haizhou Li

This paper describes a new technique for finding disentangled semantic directions in the latent space of StyleGAN. Our method identifies meaningful orthogonal subspaces that allow editing of one human face attribute, while minimizing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Chen Naveh , Yacov Hel-Or

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

One-shot voice conversion (VC) aims to convert speech from any source speaker to an arbitrary target speaker with only a few seconds of reference speech from the target speaker. This relies heavily on disentangling the speaker's identity…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-02 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Style transfer is the task of rephrasing the text to contain specific stylistic properties without changing the intent or affect within the context. This paper introduces a new method for automatic style transfer. We first learn a latent…

Computation and Language · Computer Science 2018-05-25 Shrimai Prabhumoye , Yulia Tsvetkov , Ruslan Salakhutdinov , Alan W Black

Recent years have witnessed significant advancements in text-guided style transfer, primarily attributed to innovations in diffusion models. These models excel in conditional guidance, utilizing text or images to direct the sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Nisha Huang , Kaer Huang , Yifan Pu , Jiangshan Wang , Jie Guo , Yiqiang Yan , Xiu Li , Tong-Yee Lee

Despite the advancements in diffusion-based image style transfer, existing methods are commonly limited by 1) semantic gap: the style reference could miss proper content semantics, causing uncontrollable stylization; 2) reliance on extra…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Boyu He , Yunfan Ye , Chang Liu , Weishang Wu , Fang Liu , Zhiping Cai

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

This paper focuses on latent representations that could effectively decompose different aspects of textual information. Using a framework of style transfer for texts, we propose several empirical methods to assess information decomposition…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Aleksander Nagaev , Jürgen Jost , Alexey Tikhonov

This is to present a text image classifier device that identifies textual content in images and then categorizes each image into one of four predefined categories, including Invoice, Form, Letter, or Report. The device supports a gallery…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Aya Kaysan Bahjat

Despite the impressive results of arbitrary image-guided style transfer methods, text-driven image stylization has recently been proposed for transferring a natural image into a stylized one according to textual descriptions of the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Nisha Huang , Yuxin Zhang , Fan Tang , Chongyang Ma , Haibin Huang , Yong Zhang , Weiming Dong , Changsheng Xu

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Konstantina Nikolaidou , George Retsinas , Vincent Christlein , Mathias Seuret , Giorgos Sfikas , Elisa Barney Smith , Hamam Mokayed , Marcus Liwicki