English
Related papers

Related papers: Style Transfer as Unsupervised Machine Translation

200 papers

We present a method to generate speech from input text and a style vector that is extracted from a reference speech signal in an unsupervised manner, i.e., no style annotation, such as speaker information, is required. Existing unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-16 Ting-Yao Hu , Ashish Shrivastava , Oncel Tuzel , Chandra Dhir

The stylistic properties of text have intrigued computational linguistics researchers in recent years. Specifically, researchers have investigated the Text Style Transfer (TST) task, which aims to change the stylistic properties of the text…

Computation and Language · Computer Science 2023-01-03 Zhiqiang Hu , Roy Ka-Wei Lee , Charu C. Aggarwal , Aston Zhang

Direct speech-to-speech translation (S2ST) has gradually become popular as it has many advantages compared with cascade S2ST. However, current research mainly focuses on the accuracy of semantic translation and ignores the speech style…

Sound · Computer Science 2023-07-26 Kun Song , Yi Ren , Yi Lei , Chunfeng Wang , Kun Wei , Lei Xie , Xiang Yin , Zejun Ma

Automatic evaluation of ST systems is typically performed by comparing translation hypotheses with one or more reference translations. While effective to some extent, this approach inherits the limitation of reference-based evaluation that…

Computation and Language · Computer Science 2026-04-09 Mauro Cettolo , Marco Gaido , Matteo Negri , Sara Papi , Luisa Bentivogli

Providing technologies to communities or domains where training data is scarce or protected e.g., for privacy reasons, is becoming increasingly important. To that end, we generalise methods for unsupervised transfer from multiple input…

Computation and Language · Computer Science 2021-10-11 Kemal Kurniawan , Lea Frermann , Philip Schulz , Trevor Cohn

We present a novel approach to the problem of text style transfer. Unlike previous approaches requiring style-labeled training data, our method makes use of readily-available unlabeled text by relying on the implicit connection in style…

Computation and Language · Computer Science 2021-06-24 Parker Riley , Noah Constant , Mandy Guo , Girish Kumar , David Uthus , Zarana Parekh

Neural Machine Translation (MT) has radically changed the way systems are developed. A major difference with the previous generation (Phrase-Based MT) is the way monolingual target data, which often abounds, is used in these two paradigms.…

Computation and Language · Computer Science 2019-03-28 Franck Burlot , François Yvon

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

Computation and Language · Computer Science 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

In this paper, we propose a new paradigm for paraphrase generation by treating the task as unsupervised machine translation (UMT) based on the assumption that there must be pairs of sentences expressing the same meaning in a large-scale…

Computation and Language · Computer Science 2022-09-12 Xiaofei Sun , Yufei Tian , Yuxian Meng , Nanyun Peng , Fei Wu , Jiwei Li , Chun Fan

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

Machine Learning · Computer Science 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

'Style transfer' among images has recently emerged as a very active research topic, fuelled by the power of convolution neural networks (CNNs), and has become fast a very popular technology in social media. This paper investigates the…

Sound · Computer Science 2019-04-29 Eric Grinstein , Ngoc Duong , Alexey Ozerov , Patrick Pérez

Sentence embedding is a significant research topic in the field of natural language processing (NLP). Generating sentence embedding vectors reflecting the intrinsic meaning of a sentence is a key factor to achieve an enhanced performance in…

Computation and Language · Computer Science 2019-01-17 Myeongjun Jang , Pilsung Kang

Humans are naturally endowed with the ability to write in a particular style. They can, for instance, re-phrase a formal letter in an informal way, convey a literal message with the use of figures of speech or edit a novel by mimicking the…

Computation and Language · Computer Science 2022-09-30 Enrica Troiano , Aswathy Velutharambath , Roman Klinger

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Songxiang Liu , Yuewen Cao , Shiyin Kang , Na Hu , Xunying Liu , Dan Su , Dong Yu , Helen Meng

It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Although many such texts contain stereotypes and biases that inherently exist in natural language for reasons…

Computation and Language · Computer Science 2022-01-24 Ewoenam Kwaku Tokpo , Toon Calders

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Transformer is eminently suitable for auto-regressive image synthesis which predicts discrete value from the past values recursively to make up full image. Especially, combined with vector quantised latent representation, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Jonghwa Yim , Minjae Kim

Cross-lingual transfer is a leading technique for parsing low-resource languages in the absence of explicit supervision. Simple `direct transfer' of a learned model based on a multilingual input encoding has provided a strong benchmark.…

Computation and Language · Computer Science 2021-01-28 Kemal Kurniawan , Lea Frermann , Philip Schulz , Trevor Cohn

This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Raul Gomez , Ali Furkan Biten , Lluis Gomez , Jaume Gibert , Marçal Rusiñol , Dimosthenis Karatzas

We introduce the task of zero-shot style transfer between different languages. Our training data includes multilingual parallel corpora, but does not contain any parallel sentences between styles, similarly to the recent previous work. We…

Computation and Language · Computer Science 2018-08-02 Elizaveta Korotkova , Maksym Del , Mark Fishel