English
Related papers

Related papers: Controllable Unsupervised Text Attribute Transfer …

200 papers

Text style transfer is an important task in controllable language generation. Supervised approaches have pushed performance improvement on style-oriented rewriting such as formality conversion. However, challenges remain due to the scarcity…

Computation and Language · Computer Science 2022-05-20 Zhengyuan Liu , Nancy F. Chen

Current learning-based subject customization approaches, predominantly relying on U-Net architectures, suffer from limited generalization ability and compromised image quality. Meanwhile, optimization-based methods require subject-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Jiale Tao , Yanbing Zhang , Qixun Wang , Yiji Cheng , Haofan Wang , Xu Bai , Zhengguang Zhou , Ruihuang Li , Linqing Wang , Chunyu Wang , Qin Lin , Qinglin Lu

In this paper, we investigate self-supervised pre-training methods for document text recognition. Nowadays, large unlabeled datasets can be collected for many research tasks, including text recognition, but it is costly to annotate them.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Martin Kišš , Michal Hradiš

We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Zongze Wu , Nicholas Kolkin , Jonathan Brandt , Richard Zhang , Eli Shechtman

The variational autoencoder (VAE) can learn the manifold of natural images on certain datasets, as evidenced by meaningful interpolating or extrapolating in the continuous latent space. However, on discrete data such as text, it is unclear…

Computation and Language · Computer Science 2020-08-10 Peng Xu , Jackie Chi Kit Cheung , Yanshuai Cao

Text style transfer task requires the model to transfer a sentence of one style to another style while retaining its original content meaning, which is a challenging problem that has long suffered from the shortage of parallel data. In this…

Computation and Language · Computer Science 2019-09-26 Mingyue Shang , Piji Li , Zhenxin Fu , Lidong Bing , Dongyan Zhao , Shuming Shi , Rui Yan

Style transfer deals with the algorithms to transfer the stylistic properties of a piece of text into that of another while ensuring that the core content is preserved. There has been a lot of interest in the field of text style transfer…

Computation and Language · Computer Science 2020-05-12 Abhilasha Sancheti , Kundan Krishna , Balaji Vasan Srinivasan , Anandhavelu Natarajan

Domain adaptation refers to the process of learning prediction models in a target domain by making use of data from a source domain. Many classic methods solve the domain adaptation problem by establishing a common latent space, which may…

Machine Learning · Computer Science 2018-08-21 Pan Xiao , Bo Du , Jia Wu , Lefei Zhang , Ruimin Hu , Xuelong Li

Unconscious biases continue to be prevalent in modern text and media, calling for algorithms that can assist writers with bias correction. For example, a female character in a story is often portrayed as passive and powerless ("She…

Computation and Language · Computer Science 2020-10-28 Xinyao Ma , Maarten Sap , Hannah Rashkin , Yejin Choi

We present a method that computes an interpretable representation of material appearance within a highly compact, disentangled latent space. This representation is learned in a self-supervised fashion using an adapted FactorVAE. We train…

Graphics · Computer Science 2025-07-18 Santiago Jimenez-Navarro , Julia Guerrero-Viu , Belen Masia

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Cross-lingual transfer is a leading technique for parsing low-resource languages in the absence of explicit supervision. Simple `direct transfer' of a learned model based on a multilingual input encoding has provided a strong benchmark.…

Computation and Language · Computer Science 2021-01-28 Kemal Kurniawan , Lea Frermann , Philip Schulz , Trevor Cohn

Recent unsupervised representation learning methods have shown to be effective in a range of vision tasks by learning representations invariant to data augmentations such as random cropping and color jittering. However, such invariance…

Machine Learning · Computer Science 2021-11-19 Hankook Lee , Kibok Lee , Kimin Lee , Honglak Lee , Jinwoo Shin

We present a novel approach to the problem of text style transfer. Unlike previous approaches requiring style-labeled training data, our method makes use of readily-available unlabeled text by relying on the implicit connection in style…

Computation and Language · Computer Science 2021-06-24 Parker Riley , Noah Constant , Mandy Guo , Girish Kumar , David Uthus , Zarana Parekh

Text style transfer is a challenging text generation problem, which aims at altering the style of a given sentence to a target one while keeping its content unchanged. Since there is a natural scarcity of parallel datasets, recent works…

Computation and Language · Computer Science 2022-02-02 Chenghao Fan , Ziao Li , Wei wei

The Swapping Autoencoder achieved state-of-the-art performance in deep image manipulation and image-to-image translation. We improve this work by introducing a simple yet effective auxiliary module based on gradient reversal layers. The…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Shima Shahfar , Charalambos Poullis

Learning disentangled representations of natural language is essential for many NLP tasks, e.g., conditional text generation, style transfer, personalized dialogue systems, etc. Similar problems have been studied extensively for other forms…

Machine Learning · Computer Science 2022-01-13 Pengyu Cheng , Martin Renqiang Min , Dinghan Shen , Christopher Malon , Yizhe Zhang , Yitong Li , Lawrence Carin

In this paper, we address the problem of unsupervised Domain Adaptation. The need for such an adaptation arises when the distribution of the target data differs from that which is used to develop the model and the ground truth information…

Machine Learning · Computer Science 2022-10-04 Siddharth Roheda , Ashkan Panahi , Hamid Krim

We propose a controllable style transfer framework based on Implicit Neural Representation that pixel-wisely controls the stylized output via test-time training. Unlike traditional image optimization methods that often suffer from unstable…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sunwoo Kim , Youngjo Min , Younghun Jung , Seungryong Kim