English
Related papers

Related papers: Controllable Text Generation for Large Language Mo…

200 papers

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

Aligning language models (LMs) with user intent is becoming increasingly relevant to enhance user experience. This calls for designing methods that can allow users to control the properties of the language that LMs generate, for example,…

Computation and Language · Computer Science 2025-09-23 Vinay Samuel , Harshita Diddee , Yiming Zhang , Daphne Ippolito

Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content…

Computation and Language · Computer Science 2025-07-08 Chinnappa Guggilla , Budhaditya Roy , Trupti Ramdas Chavan , Abdul Rahman , Edward Bowen

While large language models (LLMs) have made significant strides in generating coherent and contextually relevant text, they often function as opaque black boxes, trained on vast unlabeled datasets with statistical objectives, lacking an…

Computation and Language · Computer Science 2025-03-03 Yingbing Huang , Deming Chen , Abhishek K. Umrawal

Text generation has become one of the most important yet challenging tasks in natural language processing (NLP). The resurgence of deep learning has greatly advanced this field by neural generation models, especially the paradigm of…

Computation and Language · Computer Science 2021-05-26 Junyi Li , Tianyi Tang , Wayne Xin Zhao , Ji-Rong Wen

Large language models (LLMs) have shown promising results in a wide array of generative NLP tasks, such as summarization and machine translation. In the context of narrative generation, however, existing models still do not capture factors…

Computation and Language · Computer Science 2023-10-23 Joseph Marvin Imperial , Harish Tayyar Madabushi

Controllable text generation (CTG) seeks to craft texts adhering to specific attributes, traditionally employing learning-based techniques such as training, fine-tuning, or prefix-tuning with attribute-specific datasets. These approaches,…

Computation and Language · Computer Science 2024-06-17 Zijian Feng , Hanzhang Zhou , Zixiao Zhu , Kezhi Mao

Content generation conditioning on users's readability is an important application for personalization. In an era of large language models (LLMs), readability-controlled text generation based on LLMs has become increasingly important. This…

Computation and Language · Computer Science 2024-06-14 Hieu Tran , Zonghai Yao , Lingxi Li , Hong Yu

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

Computation and Language · Computer Science 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

Large language models (LLMs) providing generative AI have become popular to support software engineers in creating, summarizing, optimizing, and documenting source code. It is still unknown how LLMs can support control engineers using…

Software Engineering · Computer Science 2023-05-26 Heiko Koziolek , Sten Gruener , Virendra Ashiwal

Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. This advancement has resulted in more fluent, coherent and even properties…

Computation and Language · Computer Science 2022-03-11 Wei Li , Wenhao Wu , Moye Chen , Jiachen Liu , Xinyan Xiao , Hua Wu

While recent advancements in the capabilities and widespread accessibility of generative language models, such as ChatGPT (OpenAI, 2022), have brought about various benefits by generating fluent human-like text, the task of distinguishing…

Computation and Language · Computer Science 2023-09-15 Mahdi Dhaini , Wessel Poelman , Ege Erdogan

As mental health issues continue to rise globally, there is an increasing demand for accessible and scalable therapeutic solutions. Many individuals currently seek support from Large Language Models (LLMs), even though these models have not…

Computation and Language · Computer Science 2026-03-05 Navdeep Singh Bedi , Ana-Maria Bucur , Noriko Kando , Fabio Crestani

Controllable Text Generation (CTG) has obtained great success due to its fine-grained generation ability obtained by focusing on multiple attributes. However, most existing CTG researches overlook how to utilize the attribute entanglement…

Computation and Language · Computer Science 2022-11-01 Shulin Huang , Shirong Ma , Yinghui Li , Yangning Li , Shiyang Lin , Hai-Tao Zheng , Ying Shen

Text generative models (TGMs) excel in producing text that matches the style of human language reasonably well. Such TGMs can be misused by adversaries, e.g., by automatically generating fake news and fake product reviews that can look…

Computation and Language · Computer Science 2020-11-04 Ganesh Jawahar , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

Computation and Language · Computer Science 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

Large language models (LLMs) have demonstrated impressive instruction following capabilities, while still struggling to accurately manage the length of the generated text, which is a fundamental requirement in many real-world applications.…

Computation and Language · Computer Science 2024-12-20 Yuxuan Gu , Wenjie Wang , Xiaocheng Feng , Weihong Zhong , Kun Zhu , Lei Huang , Tat-Seng Chua , Bing Qin

The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As…

Computation and Language · Computer Science 2024-04-22 Junchao Wu , Shu Yang , Runzhe Zhan , Yulin Yuan , Derek F. Wong , Lidia S. Chao

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

Generative Large Language Models (gLLMs), such as ChatGPT, are increasingly being used in communication research for content analysis. Studies show that gLLMs can outperform both crowd workers and trained coders, such as research…

Artificial Intelligence · Computer Science 2025-10-29 Daria Kravets-Meinke , Hannah Schmid-Petri , Sonja Niemann , Ute Schmid