English
Related papers

Related papers: Evaluating Text Style Transfer Evaluation: Are The…

200 papers

Unsupervised Text Style Transfer (UTST) aims to build a system to transfer the stylistic properties of a given text without parallel text pairs. Compared with text transfer between style polarities, UTST for controllable intensity is more…

Computation and Language · Computer Science 2026-01-06 Shuhuan Gu , Wenbiao Tao , Xinchen Ma , Kangkang He , Ye Guo , Xiang Li , Yunshi Lan

The difficulty of textual style transfer lies in the lack of parallel corpora. Numerous advances have been proposed for the unsupervised generation. However, significant problems remain with the auto-evaluation of style transfer tasks.…

Computation and Language · Computer Science 2019-10-11 Richard Yuanzhe Pang

Text Style Transfer (TST) seeks to alter the style of text while retaining its core content. Given the constraints of limited parallel datasets for TST, we propose CoTeX, a framework that leverages large language models (LLMs) alongside…

Computation and Language · Computer Science 2024-05-07 Chiyu Zhang , Honglong Cai , Yuezhang , Li , Yuexin Wu , Le Hou , Muhammad Abdul-Mageed

A number of recent machine learning papers work with an automated style transfer for texts and, counter to intuition, demonstrate that there is no consensus formulation of this NLP task. Different researchers propose different algorithms,…

Computation and Language · Computer Science 2018-08-15 Alexey Tikhonov , Ivan P. Yamshchikov

This paper proposes a novel method for Text Style Transfer (TST) based on parameter-efficient fine-tuning of Large Language Models (LLMs). Addressing the scarcity of parallel corpora that map between styles, the study employs roundtrip…

Computation and Language · Computer Science 2026-02-17 Ruoxi Liu , Philipp Koehn

An ongoing debate in the NLG community concerns the best way to evaluate systems, with human evaluation often being considered the most reliable method, compared to corpus-based metrics. However, tasks involving subtle textual differences,…

Computation and Language · Computer Science 2021-01-06 Lorenzo De Mattei , Michele Cafagna , Huiyuan Lai , Felice Dell'Orletta , Malvina Nissim , Albert Gatt

Natural Language Processing (NLP) is witnessing a remarkable breakthrough driven by the success of Large Language Models (LLMs). LLMs have gained significant attention across academia and industry for their versatile applications in text…

Computation and Language · Computer Science 2024-04-16 Taojun Hu , Xiao-Hua Zhou

Starting from the 1950s, Machine Translation (MT) was challenged by different scientific solutions, which included rule-based methods, example-based and statistical models (SMT), to hybrid models, and very recent years the neural models…

Computation and Language · Computer Science 2025-08-07 Lifeng Han , Serge Gladkoff

We consider the problem of automatically generating textual paraphrases with modified attributes or properties, focusing on the setting without parallel data (Hu et al., 2017; Shen et al., 2017). This setting poses challenges for…

Computation and Language · Computer Science 2019-10-01 Richard Yuanzhe Pang , Kevin Gimpel

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

The era of Large Language Models (LLMs) raises new demands for automatic evaluation metrics, which should be adaptable to various application scenarios while maintaining low cost and effectiveness. Traditional metrics for automatic text…

Computation and Language · Computer Science 2024-10-29 Shuqian Sheng , Yi Xu , Tianhang Zhang , Zanwei Shen , Luoyi Fu , Jiaxin Ding , Lei Zhou , Xiaoying Gan , Xinbing Wang , Chenghu Zhou

This paper shows that standard assessment methodology for style transfer has several significant problems. First, the standard metrics for style accuracy and semantics preservation vary significantly on different re-runs. Therefore one has…

Computation and Language · Computer Science 2022-11-15 Alexey Tikhonov , Viacheslav Shibaev , Aleksander Nagaev , Aigul Nugmanova , Ivan P. Yamshchikov

Automatic evaluation metrics are crucial for advancing sign language translation (SLT). Current SLT evaluation metrics, such as BLEU and ROUGE, are only text-based, and it remains unclear to what extent text-based metrics can reliably…

Computation and Language · Computer Science 2025-11-17 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Eleftherios Avramidis , Josef van Genabith

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

Computation and Language · Computer Science 2021-05-14 Yixin Liu , Graham Neubig , John Wieting

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

Style is an integral part of natural language. However, evaluation methods for style measures are rare, often task-specific and usually do not control for content. We propose the modular, fine-grained and content-controlled similarity-based…

Computation and Language · Computer Science 2021-09-13 Anna Wegmann , Dong Nguyen

Language style transferring rephrases text with specific stylistic attributes while preserving the original attribute-independent content. One main challenge in learning a style transfer system is a lack of parallel data where the source…

Computation and Language · Computer Science 2018-08-27 Zhirui Zhang , Shuo Ren , Shujie Liu , Jianyong Wang , Peng Chen , Mu Li , Ming Zhou , Enhong Chen

Text style transfer is an important task in natural language generation, which aims to control certain attributes in the generated text, such as politeness, emotion, humor, and many others. It has a long history in the field of natural…

Computation and Language · Computer Science 2021-12-20 Di Jin , Zhijing Jin , Zhiting Hu , Olga Vechtomova , Rada Mihalcea

In this paper we describe how the translation methodology adopted for the Spoken Language Translator (SLT) addresses the characteristics of the speech translation task in a context where it is essential to achieve easy customization to new…