中文
相关论文

相关论文: Towards Attribute-Entangled Controllable Text Gene…

200 篇论文

Recent developments in neural networks have led to the advance in data-to-text generation. However, the lack of ability of neural models to control the structure of generated output can be limiting in certain real-world applications. In…

计算与语言 · 计算机科学 2021-09-01 Yixuan Su , David Vandyke , Sihui Wang , Yimai Fang , Nigel Collier

We introduce CGA, a conditional VAE architecture, to control, generate, and augment text. CGA is able to generate natural English sentences controlling multiple semantic and syntactic attributes by combining adversarial learning with a…

计算与语言 · 计算机科学 2020-10-05 Giuseppe Russo , Nora Hollenstein , Claudiu Musat , Ce Zhang

Compositional generalization, representing the model's ability to generate text with new attribute combinations obtained by recombining single attributes from the training data, is a crucial property for multi-aspect controllable text…

计算与语言 · 计算机科学 2024-06-04 Tianqi Zhong , Zhaoyi Li , Quan Wang , Linqi Song , Ying Wei , Defu Lian , Zhendong Mao

In a controllable text generation dataset, there exist unannotated attributes that could provide irrelevant learning signals to models that use it for training and thus degrade their performance. We propose focused prefix tuning(FPT) to…

计算与语言 · 计算机科学 2023-06-13 Congda Ma , Tianyu Zhao , Makoto Shing , Kei Sawada , Manabu Okumura

Recent advances in large pre-trained language models have demonstrated strong results in generating natural languages and significantly improved performances for many natural language generation (NLG) applications such as machine…

计算与语言 · 计算机科学 2022-09-27 Nanyun Peng

Time-series Generation (TSG) is a prominent research area with broad applications in simulations, data augmentation, and counterfactual analysis. While existing methods have shown promise in unconditional single-domain TSG, real-world…

机器学习 · 计算机科学 2025-09-08 Hao Li , Yu-Hao Huang , Chang Xu , Viktor Schlegel , Renhe Jiang , Riza Batista-Navarro , Goran Nenadic , Jiang Bian

In recent years, with the development of deep learning, text generation technology has undergone great changes and provided many kinds of services for human beings, such as restaurant reservation and daily communication. The automatically…

计算与语言 · 计算机科学 2020-12-25 Bin Guo , Hao Wang , Yasan Ding , Wei Wu , Shaoyang Hao , Yueqi Sun , Zhiwen Yu

In E-commerce, a key challenge in text generation is to find a good trade-off between word diversity and accuracy (relevance) in order to make generated text appear more natural and human-like. In order to improve the relevance of generated…

机器学习 · 计算机科学 2021-02-24 Huajie Shao , Jun Wang , Haohong Lin , Xuezhou Zhang , Aston Zhang , Heng Ji , Tarek Abdelzaher

Prior work on controllable text generation usually assumes that the controlled attribute can take on one of a small set of values known a priori. In this work, we propose a novel task, where the syntax of a generated sentence is controlled…

计算与语言 · 计算机科学 2019-06-04 Mingda Chen , Qingming Tang , Sam Wiseman , Kevin Gimpel

NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an…

计算与语言 · 计算机科学 2020-10-07 Tianlu Wang , Xuezhi Wang , Yao Qin , Ben Packer , Kang Li , Jilin Chen , Alex Beutel , Ed Chi

As Large Language Models (LLMs) are deployed more widely, customization with respect to vocabulary, style, and character becomes more important. In this work, we introduce model arithmetic, a novel inference framework for composing and…

计算与语言 · 计算机科学 2024-03-07 Jasper Dekoninck , Marc Fischer , Luca Beurer-Kellner , Martin Vechev

Previous work on controllable text generation has explored the idea of control from the latent space, such as optimizing a representation with attribute-related classifiers or sampling a representation from relevant discrete samples.…

计算与语言 · 计算机科学 2023-05-25 Yuxuan Gu , Xiaocheng Feng , Sicheng Ma , Lingyuan Zhang , Heng Gong , Weihong Zhong , Bing Qin

This work aims to employ natural language generation (NLG) to rapidly generate items for English language learning applications: this requires both language models capable of generating fluent, high-quality English, and to control the…

计算与语言 · 计算机科学 2022-11-30 Kevin Stowe , Debanjan Ghosh , Mengxuan Zhao

Large-scale Causal Language Models (CLMs), e.g., GPT3 and ChatGPT, have brought great success in text generation. However, it is still an open challenge to control the generation process of CLM while balancing flexibility, control…

计算与语言 · 计算机科学 2024-06-27 Hanqing Zhang , Sun Si , Haiming Wu , Dawei Song

Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired…

计算与语言 · 计算机科学 2024-10-07 Lifu Tu , Semih Yavuz , Jin Qu , Jiacheng Xu , Rui Meng , Caiming Xiong , Yingbo Zhou

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

计算机视觉与模式识别 · 计算机科学 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Recent work on controlled text generation has either required attribute-based fine-tuning of the base language model (LM), or has restricted the parameterization of the attribute discriminator to be compatible with the base autoregressive…

计算与语言 · 计算机科学 2022-04-05 Fatemehsadat Mireshghallah , Kartik Goyal , Taylor Berg-Kirkpatrick

Controllable text generation systems often leverage control codes to direct various properties of the output like style and length. Inspired by recent work on causal inference for NLP, this paper reveals a previously overlooked flaw in…

计算与语言 · 计算机科学 2022-10-10 Junyi Chai , Reid Pryzant , Victor Ye Dong , Konstantin Golobokov , Chenguang Zhu , Yi Liu

Multi-aspect controllable text generation aims to control text generation in attributes from multiple aspects, making it a complex but powerful task in natural language processing. Supervised fine-tuning methods are often employed for this…

计算与语言 · 计算机科学 2025-02-20 Chenyu Zhu , Yefeng Liu , Chenyang Lyu , Xue Yang , Guanhua Chen , Longyue Wang , Weihua Luo , Kaifu Zhang

Recent advancements in large language models have revolutionized text generation with their remarkable capabilities. These models can produce controlled texts that closely adhere to specific requirements when prompted appropriately.…

计算与语言 · 计算机科学 2025-03-17 Zhe Yang , Yi Huang , Yaqin Chen , Xiaoting Wu , Junlan Feng , Chao Deng