中文
相关论文

相关论文: Text Style Transfer with Parameter-efficient LLM F…

200 篇论文

The training paradigm for machine translation has gradually shifted, from learning neural machine translation (NMT) models with extensive parallel corpora to instruction finetuning on multilingual large language models (LLMs) with…

计算与语言 · 计算机科学 2024-02-08 Pengzhi Gao , Zhongjun He , Hua Wu , Haifeng Wang

The stylistic properties of text have intrigued computational linguistics researchers in recent years. Specifically, researchers have investigated the Text Style Transfer (TST) task, which aims to change the stylistic properties of the text…

计算与语言 · 计算机科学 2023-01-03 Zhiqiang Hu , Roy Ka-Wei Lee , Charu C. Aggarwal , Aston Zhang

In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires…

计算与语言 · 计算机科学 2022-04-01 Emily Reif , Daphne Ippolito , Ann Yuan , Andy Coenen , Chris Callison-Burch , Jason Wei

Since the breakthrough of ChatGPT, large language models (LLMs) have garnered significant attention in the research community. With the development of LLMs, the question of text style transfer for conversational models has emerged as a…

计算与语言 · 计算机科学 2024-03-15 Jianlin Chen

Language style is often used by writers to convey their intentions, identities, and mastery of language. In this paper, we show that current large language models struggle to capture some language styles without fine-tuning. To address this…

计算与语言 · 计算机科学 2024-06-07 Ruohao Guo , Wei Xu , Alan Ritter

Computational stylometry studies writing style through quantitative textual patterns, enabling applications such as authorship attribution, identity linking, and plagiarism detection. Existing supervised and contrastive approaches often…

计算与语言 · 计算机科学 2025-12-19 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Adapting a large language model for multiple-attribute text style transfer via fine-tuning can be challenging due to the significant amount of computational resources and labeled data required for the specific task. In this paper, we…

计算与语言 · 计算机科学 2023-05-11 Zhiqiang Hu , Roy Ka-Wei Lee , Nancy F. Chen

Text style transfer (TST) without parallel data has achieved some practical success. However, most of the existing unsupervised text style transfer methods suffer from (i) requiring massive amounts of non-parallel data to guide transferring…

计算与语言 · 计算机科学 2022-05-26 Xiangyang Li , Xiang Long , Yu Xia , Sujian Li

Language style is necessary for AI systems to understand and generate diverse human language accurately. However, previous text style transfer primarily focused on sentence-level data-driven approaches, limiting exploration of potential…

计算与语言 · 计算机科学 2024-10-15 Huashan Sun , Yixiao Wu , Yuhao Ye , Yizhe Yang , Yinghao Li , Jiawei Li , Yang Gao

Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in conversations such…

计算与语言 · 计算机科学 2023-09-25 Shamik Roy , Raphael Shu , Nikolaos Pappas , Elman Mansimov , Yi Zhang , Saab Mansour , Dan Roth

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of parallel data and principle…

计算与语言 · 计算机科学 2017-11-28 Zhenxin Fu , Xiaoye Tan , Nanyun Peng , Dongyan Zhao , Rui Yan

Vision-and-language pre-training (VLP) models have experienced a surge in popularity recently. By fine-tuning them on specific datasets, significant performance improvements have been observed in various tasks. However, full fine-tuning of…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Yuan Yuan , Yang Zhan , Zhitong Xiong

Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LRLs). However, conventional single-stage fine-tuning methods…

计算与语言 · 计算机科学 2025-03-31 Sarubi Thillainathan , Songchen Yuan , En-Shiun Annie Lee , Sanath Jayasena , Surangika Ranathunga

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

计算与语言 · 计算机科学 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Unsupervised text style transfer aims to transfer the underlying style of text but keep its main content unchanged without parallel data. Most existing methods typically follow two steps: first separating the content from the original…

计算与语言 · 计算机科学 2019-05-27 Fuli Luo , Peng Li , Jie Zhou , Pengcheng Yang , Baobao Chang , Zhifang Sui , Xu Sun

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

计算与语言 · 计算机科学 2024-07-30 Shuai Liu , Jonathan May

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Yunpeng Bai , Jiayue Liu , Chao Dong , Chun Yuan

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

计算与语言 · 计算机科学 2021-05-14 Yixin Liu , Graham Neubig , John Wieting

Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which…

计算与语言 · 计算机科学 2024-12-10 Zhiqiang Wang , Yiran Pang , Yanbin Lin , Xingquan Zhu

Text style transfer, an important research direction in natural language processing, aims to adapt the text to various preferences but often faces challenges with limited resources. In this work, we introduce a novel method termed Style…

计算与语言 · 计算机科学 2024-07-23 Chunzhen Jin , Yongfeng Huang , Yaqi Wang , Peng Cao , Osmar Zaiane