English
Related papers

Related papers: Multiple-Attribute Text Style Transfer

200 papers

We study the problem of learning disentangled representations for data across multiple domains and its applications in human retargeting. Our goal is to map an input image to an identity-invariant latent representation that captures…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

We present a novel method of learning style-agnostic representation using both style transfer and adversarial learning in the reinforcement learning framework. The style, here, refers to task-irrelevant details such as the color of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Juyong Lee , Seokjun Ahn , Jaesik Park

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-19 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Facial makeup transfer aims to render a non-makeup face image in an arbitrary given makeup one while preserving face identity. The most advanced method separates makeup style information from face images to realize makeup transfer. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Zhaoyang Sun , Wenxuan Liu , Feng Liu , Ryan Wen Liu , Shengwu Xiong

Unsupervised style transfer models are mainly based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases.…

Computation and Language · Computer Science 2021-09-17 Fei Xiao , Liang Pang , Yanyan Lan , Yan Wang , Huawei Shen , Xueqi Cheng

Real-world objects perform complex motions that involve multiple independent motion components. For example, while talking, a person continuously changes their expressions, head, and body pose. In this work, we propose a novel method to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Rishubh Parihar , Raghav Magazine , Piyush Tiwari , R. Venkatesh Babu

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

Machine Learning · Computer Science 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

Disentangled representations seek to recover latent factors of variation underlying observed data, yet their identifiability is still not fully understood. We introduce a unified framework in which disentanglement is achieved through…

Machine Learning · Computer Science 2026-05-12 Stefan Matthes , Zhiwei Han , Hao Shen

Music creation involves not only composing the different parts (e.g., melody, chords) of a musical work but also arranging/selecting the instruments to play the different parts. While the former has received increasing attention, the latter…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-03 Yun-Ning Hung , I-Tung Chiang , Yi-An Chen , Yi-Hsuan Yang

Text attribute transfer is modifying certain linguistic attributes (e.g. sentiment, style, authorship, etc.) of a sentence and transforming them from one type to another. In this paper, we aim to analyze and interpret what is changed during…

Computation and Language · Computer Science 2019-09-30 Yao Fu , Hao Zhou , Jiaze Chen , Lei Li

We seek to learn a representation on a large annotated data source that generalizes to a target domain using limited new supervision. Many prior approaches to this problem have focused on learning "disentangled" representations so that as…

Machine Learning · Computer Science 2020-02-28 Or Litany , Ari Morcos , Srinath Sridhar , Leonidas Guibas , Judy Hoffman

Style transfer is an inventive process designed to create an image that maintains the essence of the original while embracing the visual style of another. Although diffusion models have demonstrated impressive generative power in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Haofan Wang , Peng Xing , Renyuan Huang , Hao Ai , Qixun Wang , Xu Bai

Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Shuai Yang , Zhangyang Wang , Zhaowen Wang , Ning Xu , Jiaying Liu , Zongming Guo

Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhi-Song Liu , Li-Wen Wang , Wan-Chi Siu , Vicky Kalogeiton

With the development of diffusion models, text-guided image style transfer has demonstrated high-quality controllable synthesis results. However, the utilization of text for diverse music style transfer poses significant challenges,…

Sound · Computer Science 2024-02-22 Sifei Li , Yuxin Zhang , Fan Tang , Chongyang Ma , Weiming dong , Changsheng Xu

In this paper, we propose a method that disentangles the effects of multiple input conditions in Generative Adversarial Networks (GANs). In particular, we demonstrate our method in controlling color, texture, and shape of a generated…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Gökhan Yildirim , Calvin Seward , Urs Bergmann

Language style is necessary for AI systems to understand and generate diverse human language accurately. However, previous text style transfer primarily focused on sentence-level data-driven approaches, limiting exploration of potential…

Computation and Language · Computer Science 2024-10-15 Huashan Sun , Yixiao Wu , Yuhao Ye , Yizhe Yang , Yinghao Li , Jiawei Li , Yang Gao

We present an approach to example-based stylization of images that uses a single pair of a source image and its stylized counterpart. We demonstrate how to train an image translation network that can perform real-time semantically…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 David Futschik , Michal Kučera , Michal Lukáč , Zhaowen Wang , Eli Shechtman , Daniel Sýkora