English
Related papers

Related papers: STEER: Unified Style Transfer with Expert Reinforc…

200 papers

To preserve anonymity and obfuscate their identity on online platforms users may morph their text and portray themselves as a different gender or demographic. Similarly, a chatbot may need to customize its communication style to improve…

Computation and Language · Computer Science 2020-01-22 Karan Dabas , Nishtha Madan , Vijay Arya , Sameep Mehta , Gautam Singh , Tanmoy Chakraborty

Style transfer aims to transfer arbitrary visual styles to content images. We explore algorithms adapted from two papers that try to solve the problem of style transfer while generalizing on unseen styles or compromised visual quality.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Somshubra Majumdar , Amlaan Bhoi , Ganesh Jagadeesan

We present a general framework for unsupervised text style transfer with deep generative models. The framework models each sentence-label pair in the non-parallel corpus as partially observed from a complete quadruplet which additionally…

Computation and Language · Computer Science 2023-09-01 Zhongtao Jiang , Yuanzhe Zhang , Yiming Ju , Kang Liu

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based STE methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Weichao Zeng , Yan Shu , Zhenhang Li , Dongbao Yang , Yu Zhou

Unsupervised text style transfer aims to alter text styles while preserving the content, without aligned data for supervision. Existing seq2seq methods face three challenges: 1) the transfer is weakly interpretable, 2) generated outputs…

Computation and Language · Computer Science 2019-06-06 Chen Wu , Xuancheng Ren , Fuli Luo , Xu Sun

Current multi-reference style transfer models for Text-to-Speech (TTS) perform sub-optimally on disjoints datasets, where one dataset contains only a single style class for one of the style dimensions. These models generally fail to produce…

Machine Learning · Computer Science 2019-10-29 Matt Whitehill , Shuang Ma , Daniel McDuff , Yale Song

Batch reinforcement learning (RL) aims at leveraging pre-collected data to find an optimal policy that maximizes the expected total rewards in a dynamic environment. The existing methods require absolutely continuous assumption (e.g., there…

Machine Learning · Statistics 2024-06-27 Xiaohong Chen , Zhengling Qi , Runzhe Wan

We present a deep generative model for unsupervised text style transfer that unifies previously proposed non-generative techniques. Our probabilistic approach models non-parallel data from two domains as a partially observed parallel…

Computation and Language · Computer Science 2020-05-01 Junxian He , Xinyi Wang , Graham Neubig , Taylor Berg-Kirkpatrick

Transformer-based models achieve favorable performance in artistic style transfer recently thanks to its global receptive field and powerful multi-head/layer attention operations. Nevertheless, the over-paramerized multi-layer structure…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Hao Tang , Songhua Liu , Tianwei Lin , Shaoli Huang , Fu Li , Dongliang He , Xinchao Wang

Given a random pair of images, an arbitrary style transfer method extracts the feel from the reference image to synthesize an output based on the look of the other content image. Recent arbitrary style transfer methods transfer second order…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Xueting Li , Sifei Liu , Jan Kautz , Ming-Hsuan Yang

Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Silky Singh , Surgan Jandial , Simra Shahid , Abhinav Java

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

Computation and Language · Computer Science 2021-05-14 Yixin Liu , Graham Neubig , John Wieting

Diffusion-based stylization has advanced significantly, yet existing methods are limited to color-driven transformations, neglecting complex semantics and material details. We introduce StyleExpert, a semantic-aware framework based on the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shihao Zhu , Ziheng Ouyang , Yijia Kang , Qilong Wang , Mi Zhou , Bo Li , Ming-Ming Cheng , Qibin Hou

Multi-Style Transfer (MST) intents to capture the high-level visual vocabulary of different styles and expresses these vocabularies in a joint model to transfer each specific style. Recently, Style Embedding Learning (SEL) based methods…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Hongmin Xu , Qiang Li , Wenbo Zhang , Wen Zheng

In light of the widespread application of Automatic Speech Recognition (ASR) systems, their security concerns have received much more attention than ever before, primarily due to the susceptibility of Deep Neural Networks. Previous studies…

Sound · Computer Science 2024-05-16 Weifei Jin , Yuxin Cao , Junjie Su , Qi Shen , Kai Ye , Derui Wang , Jie Hao , Ziyao Liu

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extracting and maintaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yingying Deng , Fan Tang , Weiming Dong , Chongyang Ma , Xingjia Pan , Lei Wang , Changsheng Xu

Current hair transfer methods struggle to handle diverse and intricate hairstyles, limiting their applicability in real-world scenarios. In this paper, we propose a novel diffusion-based hair transfer framework, named \textit{Stable-Hair},…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yuxuan Zhang , Qing Zhang , Yiren Song , Jichao Zhang , Hao Tang , Jiaming Liu

Unsupervised text attribute transfer automatically transforms a text to alter a specific attribute (e.g. sentiment) without using any parallel data, while simultaneously preserving its attribute-independent content. The dominant approaches…

Computation and Language · Computer Science 2019-12-13 Ke Wang , Hang Hua , Xiaojun Wan

We propose a fast feed-forward network for arbitrary style transfer, which can generate stylized image for previously unseen content and style image pairs. Besides the traditional content and style representation based on deep features and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Zheng Xu , Michael Wilber , Chen Fang , Aaron Hertzmann , Hailin Jin

Photorealistic style transfer aims to apply stylization while preserving the realism and structure of input content. However, existing methods often encounter challenges such as color tone distortions, dependency on pair-wise pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Rong Liu , Enyu Zhao , Zhiyuan Liu , Andrew Feng , Scott John Easley