English
Related papers

Related papers: Text Style Transfer with Parameter-efficient LLM F…

200 papers

The training paradigm for machine translation has gradually shifted, from learning neural machine translation (NMT) models with extensive parallel corpora to instruction finetuning on multilingual large language models (LLMs) with…

Computation and Language · Computer Science 2024-02-08 Pengzhi Gao , Zhongjun He , Hua Wu , Haifeng Wang

The stylistic properties of text have intrigued computational linguistics researchers in recent years. Specifically, researchers have investigated the Text Style Transfer (TST) task, which aims to change the stylistic properties of the text…

Computation and Language · Computer Science 2023-01-03 Zhiqiang Hu , Roy Ka-Wei Lee , Charu C. Aggarwal , Aston Zhang

In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires…

Computation and Language · Computer Science 2022-04-01 Emily Reif , Daphne Ippolito , Ann Yuan , Andy Coenen , Chris Callison-Burch , Jason Wei

Since the breakthrough of ChatGPT, large language models (LLMs) have garnered significant attention in the research community. With the development of LLMs, the question of text style transfer for conversational models has emerged as a…

Computation and Language · Computer Science 2024-03-15 Jianlin Chen

Language style is often used by writers to convey their intentions, identities, and mastery of language. In this paper, we show that current large language models struggle to capture some language styles without fine-tuning. To address this…

Computation and Language · Computer Science 2024-06-07 Ruohao Guo , Wei Xu , Alan Ritter

Computational stylometry studies writing style through quantitative textual patterns, enabling applications such as authorship attribution, identity linking, and plagiarism detection. Existing supervised and contrastive approaches often…

Computation and Language · Computer Science 2025-12-19 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Adapting a large language model for multiple-attribute text style transfer via fine-tuning can be challenging due to the significant amount of computational resources and labeled data required for the specific task. In this paper, we…

Computation and Language · Computer Science 2023-05-11 Zhiqiang Hu , Roy Ka-Wei Lee , Nancy F. Chen

Text style transfer (TST) without parallel data has achieved some practical success. However, most of the existing unsupervised text style transfer methods suffer from (i) requiring massive amounts of non-parallel data to guide transferring…

Computation and Language · Computer Science 2022-05-26 Xiangyang Li , Xiang Long , Yu Xia , Sujian Li

Language style is necessary for AI systems to understand and generate diverse human language accurately. However, previous text style transfer primarily focused on sentence-level data-driven approaches, limiting exploration of potential…

Computation and Language · Computer Science 2024-10-15 Huashan Sun , Yixiao Wu , Yuhao Ye , Yizhe Yang , Yinghao Li , Jiawei Li , Yang Gao

Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in conversations such…

Computation and Language · Computer Science 2023-09-25 Shamik Roy , Raphael Shu , Nikolaos Pappas , Elman Mansimov , Yi Zhang , Saab Mansour , Dan Roth

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of parallel data and principle…

Computation and Language · Computer Science 2017-11-28 Zhenxin Fu , Xiaoye Tan , Nanyun Peng , Dongyan Zhao , Rui Yan

Vision-and-language pre-training (VLP) models have experienced a surge in popularity recently. By fine-tuning them on specific datasets, significant performance improvements have been observed in various tasks. However, full fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuan Yuan , Yang Zhan , Zhitong Xiong

Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LRLs). However, conventional single-stage fine-tuning methods…

Computation and Language · Computer Science 2025-03-31 Sarubi Thillainathan , Songchen Yuan , En-Shiun Annie Lee , Sanath Jayasena , Surangika Ranathunga

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Unsupervised text style transfer aims to transfer the underlying style of text but keep its main content unchanged without parallel data. Most existing methods typically follow two steps: first separating the content from the original…

Computation and Language · Computer Science 2019-05-27 Fuli Luo , Peng Li , Jie Zhou , Pengcheng Yang , Baobao Chang , Zhifang Sui , Xu Sun

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Yunpeng Bai , Jiayue Liu , Chao Dong , Chun Yuan

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

Computation and Language · Computer Science 2021-05-14 Yixin Liu , Graham Neubig , John Wieting

Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which…

Computation and Language · Computer Science 2024-12-10 Zhiqiang Wang , Yiran Pang , Yanbin Lin , Xingquan Zhu

Text style transfer, an important research direction in natural language processing, aims to adapt the text to various preferences but often faces challenges with limited resources. In this work, we introduce a novel method termed Style…

Computation and Language · Computer Science 2024-07-23 Chunzhen Jin , Yongfeng Huang , Yaqi Wang , Peng Cao , Osmar Zaiane