English
Related papers

Related papers: StylerDALLE: Language-Guided Style Transfer Using …

200 papers

Motion style transfer is a common method for enriching character animation. Motion style transfer algorithms are often designed for offline settings where motions are processed in segments. However, for online animation applications, such…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Tianxin Tao , Xiaohang Zhan , Zhongquan Chen , Michiel van de Panne

The performance of existing text style transfer models is severely limited by the non-parallel datasets on which the models are trained. In non-parallel datasets, no direct mapping exists between sentences of the source and target style;…

Computation and Language · Computer Science 2022-04-19 Ruibo Liu , Chongyang Gao , Chenyan Jia , Guangxuan Xu , Soroush Vosoughi

We present StyleBabel, a unique open access dataset of natural language captions and free-form tags describing the artistic style of over 135K digital artworks, collected via a novel participatory method from experts studying at specialist…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Dan Ruta , Andrew Gilbert , Pranav Aggarwal , Naveen Marri , Ajinkya Kale , Jo Briggs , Chris Speed , Hailin Jin , Baldo Faieta , Alex Filipkowski , Zhe Lin , John Collomosse

3D Human motion style transfer is a fundamental problem in computer graphic and animation processing. Existing AdaIN- based methods necessitate datasets with balanced style distribution and content/style labels to train the clustered latent…

Graphics · Computer Science 2024-08-08 Lei Hu , Zihao Zhang , Yongjing Ye , Yiwen Xu , Shihong Xia

Since visual perception can give rich information beyond text descriptions for world understanding, there has been increasing interest in leveraging visual grounding for language learning. Recently, vokenization (Tan and Bansal, 2020) has…

Computation and Language · Computer Science 2021-10-20 Zineng Tang , Jaemin Cho , Hao Tan , Mohit Bansal

With the demand for autonomous control and personalized speech generation, the style control and transfer in Text-to-Speech (TTS) is becoming more and more important. In this paper, we propose a new TTS system that can perform style…

Sound · Computer Science 2023-07-12 Wenhao Guan , Tao Li , Yishuang Li , Hukai Huang , Qingyang Hong , Lin Li

GAN-based image editing task aims at manipulating image attributes in the latent space of generative models. Most of the previous 2D and 3D-aware approaches mainly focus on editing attributes in images with ambiguous semantics or regions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhijun Zhai , Zengmao Wang , Xiaoxiao Long , Kaixuan Zhou , Bo Du

Text style transfer without parallel data has achieved some practical success. However, in the scenario where less data is available, these methods may yield poor performance. In this paper, we examine domain adaptation for text style…

Computation and Language · Computer Science 2019-08-27 Dianqi Li , Yizhe Zhang , Zhe Gan , Yu Cheng , Chris Brockett , Ming-Ting Sun , Bill Dolan

Text style transfer task requires the model to transfer a sentence of one style to another style while retaining its original content meaning, which is a challenging problem that has long suffered from the shortage of parallel data. In this…

Computation and Language · Computer Science 2019-09-26 Mingyue Shang , Piji Li , Zhenxin Fu , Lidong Bing , Dongyan Zhao , Shuming Shi , Rui Yan

The dominant approach to unsupervised "style transfer" in text is based on the idea of learning a latent representation, which is independent of the attributes specifying its "style". In this paper, we show that this condition is not…

Computation and Language · Computer Science 2019-09-23 Sandeep Subramanian , Guillaume Lample , Eric Michael Smith , Ludovic Denoyer , Marc'Aurelio Ranzato , Y-Lan Boureau

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extracting and maintaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yingying Deng , Fan Tang , Weiming Dong , Chongyang Ma , Xingjia Pan , Lei Wang , Changsheng Xu

We introduce ReStyle3D, a novel framework for scene-level appearance transfer from a single style image to a real-world scene represented by multiple views. The method combines explicit semantic correspondences with multi-view consistency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Liyuan Zhu , Shengqu Cai , Shengyu Huang , Gordon Wetzstein , Naji Khosravan , Iro Armeni

Synthesizing visually impressive images that seamlessly align both text prompts and specific artistic styles remains a significant challenge in Text-to-Image (T2I) diffusion models. This paper introduces StyleBlend, a method designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Zichong Chen , Shijin Wang , Yang Zhou

These days deep learning is the fastest-growing area in the field of Machine Learning. Convolutional Neural Networks are currently the main tool used for image analysis and classification purposes. Although great achievements and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Agnieszka Mikołajczyk , Michał Grochowski

Prompting approaches have been recently explored in text style transfer, where a textual prompt is used to query a pretrained language model to generate style-transferred texts word by word in an autoregressive manner. However, such a…

Computation and Language · Computer Science 2023-12-25 Guoqing Luo , Yu Tong Han , Lili Mou , Mauajama Firdaus

Supervised training of abstractive language generation models results in learning conditional probabilities over language sequences based on the supervised training signal. When the training signal contains a variety of writing styles, such…

Computation and Language · Computer Science 2018-04-12 Ye Zhang , Nan Ding , Radu Soricut

Artistic style transfer has long been possible with the advancements of convolution- and transformer-based neural networks. Most algorithms apply the artistic style transfer to the whole image, but individual users may only need to apply a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Seyed Hadi Seyed , Ayberk Cansever , David Hart

Neural style transfer is a powerful computer vision technique that can incorporate the artistic "style" of one image to the "content" of another. The underlying theory behind the approach relies on the assumption that the style of an image…

Machine Learning · Computer Science 2022-09-26 Yousef El-Laham , Svitlana Vyetrenko

Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative optimization or fast…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán