English
Related papers

Related papers: Stable Style Transformer: Delete and Generate Appr…

200 papers

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extracting and maintaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yingying Deng , Fan Tang , Weiming Dong , Chongyang Ma , Xingjia Pan , Lei Wang , Changsheng Xu

Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semi-supervised formality…

Computation and Language · Computer Science 2020-10-13 Kunal Chawla , Diyi Yang

Text style transfer is an important task in controllable language generation. Supervised approaches have pushed performance improvement on style-oriented rewriting such as formality conversion. However, challenges remain due to the scarcity…

Computation and Language · Computer Science 2022-05-20 Zhengyuan Liu , Nancy F. Chen

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

While large language models (LLMs) have achieved impressive performance in generating fluent and realistic text, controlling the generated text so that it exhibits properties such as safety, factuality, and non-toxicity remains challenging.…

Computation and Language · Computer Science 2023-11-10 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Unsupervised text style transfer aims at training a generative model that can alter the style of the input sentence while preserving its content without using any parallel data. In this paper, we employ powerful pre-trained large language…

Computation and Language · Computer Science 2023-10-24 Huiyu Mai , Wenhao Jiang , Zhihong Deng

Style-transfer is a process of migrating a style from a given image to the content of another, synthesizing a new image which is an artistic mixture of the two. Recent work on this problem adopting Convolutional Neural-networks (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Michael Elad , Peyman Milanfar

This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-07 Mingyang Zhang , Yi Zhou , Li Zhao , Haizhou Li

We describe an approach for unsupervised learning of a generic, distributed sentence encoder. Using the continuity of text from books, we train an encoder-decoder model that tries to reconstruct the surrounding sentences of an encoded…

Computation and Language · Computer Science 2015-06-23 Ryan Kiros , Yukun Zhu , Ruslan Salakhutdinov , Richard S. Zemel , Antonio Torralba , Raquel Urtasun , Sanja Fidler

Machine transliteration is the process of automatically transforming the script of a word from a source language to a target language, while preserving pronunciation. Sequence to sequence learning has recently emerged as a new paradigm in…

Computation and Language · Computer Science 2016-09-15 Amir H. Jadidinejad

End-to-end speech translation aims to translate speech in one language into text in another language via an end-to-end way. Most existing methods employ an encoder-decoder structure with a single encoder to learn acoustic representation and…

Computation and Language · Computer Science 2020-10-29 Yuchen Liu , Junnan Zhu , Jiajun Zhang , Chengqing Zong

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Konstantina Nikolaidou , George Retsinas , Vincent Christlein , Mathias Seuret , Giorgos Sfikas , Elisa Barney Smith , Hamam Mokayed , Marcus Liwicki

The goal of text style transfer is to transform the style of texts while preserving their original meaning, often with only a few examples of the target style. Existing style transfer methods generally rely on the few-shot capabilities of…

Computation and Language · Computer Science 2024-11-08 Zachary Horvitz , Ajay Patel , Kanishk Singh , Chris Callison-Burch , Kathleen McKeown , Zhou Yu

Diffusion models have emerged as the dominant paradigm for style transfer, but their text-driven mechanism is hindered by a core limitation: it treats textual descriptions as uniform, monolithic guidance. This limitation overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuanlin Yang , Quanjian Song , Zhexian Gao , Ge Wang , Shanshan Li , Xiaoyan Zhang

Scene text editing aims to modify text content within scene images while maintaining style consistency. Traditional methods achieve this by explicitly disentangling style and content from the source image and then fusing the style with the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhengyao Fang , Pengyuan Lyu , Jingjing Wu , Chengquan Zhang , Jun Yu , Guangming Lu , Wenjie Pei

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Style transfer deals with the algorithms to transfer the stylistic properties of a piece of text into that of another while ensuring that the core content is preserved. There has been a lot of interest in the field of text style transfer…

Computation and Language · Computer Science 2020-05-12 Abhilasha Sancheti , Kundan Krishna , Balaji Vasan Srinivasan , Anandhavelu Natarajan

Generating stylized responses is essential to build intelligent and engaging dialogue systems. However, this task is far from well-explored due to the difficulties of rendering a particular style in coherent responses, especially when the…

Computation and Language · Computer Science 2020-12-17 Yinhe Zheng , Zikai Chen , Rongsheng Zhang , Shilei Huang , Xiaoxi Mao , Minlie Huang

Text style transfer (TST) is an important task in controllable text generation, which aims to control selected attributes of language use, such as politeness, formality, or sentiment, without altering the style-independent content of the…

Computation and Language · Computer Science 2024-07-25 Sourabrata Mukherjee , Mateusz Lango , Zdenek Kasner , Ondrej Dušek