English
Related papers

Related papers: Unsupervised Text Style Transfer for Controllable …

200 papers

We propose a method for arbitrary textual style transfer (TST)--the task of transforming a text into any given style--utilizing general-purpose pre-trained language models. Our method, Prompt-and-Rerank, is based on a mathematical…

Computation and Language · Computer Science 2022-05-24 Mirac Suzgun , Luke Melas-Kyriazi , Dan Jurafsky

The field of prosody transfer in speech synthesis systems is rapidly advancing. This research is focused on evaluating learning methods for adapting pre-trained monolingual text-to-speech (TTS) models to multilingual conditions, i.e.,…

Computation and Language · Computer Science 2024-06-19 Arnav Goel , Medha Hira , Anubha Gupta

Inductive transfer learning has greatly impacted computer vision, but existing approaches in NLP still require task-specific modifications and training from scratch. We propose Universal Language Model Fine-tuning (ULMFiT), an effective…

Computation and Language · Computer Science 2018-05-24 Jeremy Howard , Sebastian Ruder

Current emotional text-to-speech (TTS) models predominantly conduct supervised training to learn the conversion from text and desired emotion to its emotional speech, focusing on a single emotion per text-speech pair. These models only…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Xiaoxue Gao , Chen Zhang , Yiming Chen , Huayun Zhang , Nancy F. Chen

The field of Neural Style Transfer (NST) has witnessed remarkable progress in the past few years, with approaches being able to synthesize artistic and photorealistic images and videos of exceptional quality. To evaluate such results, a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Eleftherios Ioannou , Steve Maddock

Task-adaptive pre-training (TAPT) and Self-training (ST) have emerged as the major semi-supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they…

Computation and Language · Computer Science 2023-02-21 Shiyang Li , Semih Yavuz , Wenhu Chen , Xifeng Yan

Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target domain. However, it does not explicitly maintain other…

Computation and Language · Computer Science 2022-05-10 Abhinav Ramesh Kashyap , Devamanyu Hazarika , Min-Yen Kan , Roger Zimmermann , Soujanya Poria

Existing text style transfer (TST) methods rely on style classifiers to disentangle the text's content and style attributes for text style transfer. While the style classifier plays a critical role in existing TST methods, there is no known…

Computation and Language · Computer Science 2021-08-13 Zhiqiang Hu , Roy Ka-Wei Lee , Charu C. Aggarwal

Neural Style Transfer (NST) has quickly evolved from single-style to infinite-style models, also known as Arbitrary Style Transfer (AST). Although appealing results have been widely reported in literature, our empirical studies on four…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Jiaxin Cheng , Ayush Jaiswal , Yue Wu , Pradeep Natarajan , Prem Natarajan

Text style transfer is the task that generates a sentence by preserving the content of the input sentence and transferring the style. Most existing studies are progressing on non-parallel datasets because parallel datasets are limited and…

Computation and Language · Computer Science 2020-11-30 Joosung Lee

Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Silky Singh , Surgan Jandial , Simra Shahid , Abhinav Java

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Yunpeng Bai , Jiayue Liu , Chao Dong , Chun Yuan

We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches: ($i$) how to…

Computation and Language · Computer Science 2020-05-04 Yu Cheng , Zhe Gan , Yizhe Zhang , Oussama Elachqar , Dianqi Li , Jingjing Liu

While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability. In particular, we demonstrate that categorical…

Machine Learning · Computer Science 2021-03-18 Samuel Lavoie , Faruk Ahmed , Aaron Courville

Image Style Transfer (IST) is an interdisciplinary topic of computer vision and art that continuously attracts researchers' interests. Different from traditional Image-guided Image Style Transfer (IIST) methods that require a style…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hanyu Wang , Pengxiang Wu , Kevin Dela Rosa , Chen Wang , Abhinav Shrivastava

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Direct speech-to-speech translation (S2ST) is among the most challenging problems in the translation paradigm due to the significant scarcity of S2ST data. While effort has been made to increase the data size from unlabeled speech by…

Computation and Language · Computer Science 2022-10-27 Xuan-Phi Nguyen , Sravya Popuri , Changhan Wang , Yun Tang , Ilia Kulikov , Hongyu Gong

Reinforcement Learning (RL) and Supervised Fine-Tuning (SFT) are the two dominant paradigms for enhancing Large Language Model (LLM) performance on downstream tasks. While RL generally preserves broader model capabilities (retention) better…

Machine Learning · Computer Science 2026-02-04 Rana Muhammad Shahroz Khan , Zijie Liu , Zhen Tan , Charles Fleming , Tianlong Chen

Authorship style transfer aims to rewrite a given text into a specified target while preserving the original meaning in the source. Existing approaches rely on the availability of a large number of target style exemplars for model training.…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Shantanu Agarwal , Jonathan May

Large language models (LLMs) exhibit remarkable capabilities in handling natural language tasks; however, they may struggle to consistently follow complex instructions including those involve multiple constraints. Post-training LLMs using…

Computation and Language · Computer Science 2025-05-20 Yuheng Lu , ZiMeng Bai , Caixia Yuan , Huixing Jiang , Xiaojie Wang