English
Related papers

Related papers: C$^3$TG: Conflict-aware, Composite, and Collaborat…

200 papers

Controlled text generation (CTG) seeks to guide large language model (LLM) output to produce text that conforms to desired criteria. The current study presents a novel CTG algorithm that enforces adherence toward specific rhetorical…

Computation and Language · Computer Science 2024-02-12 Joshua Zingale , Jugal Kalita

Large Language Models(LLMs) have revolutionized text generation and multimodal perception,but their capabilities in 3D content generation remain underexplored. Existing methods compromise by producing either low-resolution meshes or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Junming Huang , Chi Wang , Letian Li , Guangkai Xu , Donglin Huang , Hao Chen , Qiang Dai , Weiwei Xu

Controlled generation refers to the problem of creating text that contains stylistic or semantic attributes of interest. Many approaches reduce this problem to training a predictor of the desired attribute. For example, researchers hoping…

Computation and Language · Computer Science 2023-06-02 Carolina Zheng , Claudia Shi , Keyon Vafa , Amir Feder , David M. Blei

Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired…

Computation and Language · Computer Science 2024-10-07 Lifu Tu , Semih Yavuz , Jin Qu , Jiacheng Xu , Rui Meng , Caiming Xiong , Yingbo Zhou

Prompt learning with immensely large Casual Language Models (CLMs) has been shown promising for attribute-controllable text generation (CTG). However, vanilla prompt tuning tends to imitate training corpus characteristics beyond the control…

Computation and Language · Computer Science 2022-10-19 Hanqing Zhang , Dawei Song

While large language models (LLMs) have made significant strides in generating coherent and contextually relevant text, they often function as opaque black boxes, trained on vast unlabeled datasets with statistical objectives, lacking an…

Computation and Language · Computer Science 2025-03-03 Yingbing Huang , Deming Chen , Abhishek K. Umrawal

Controllable text generation is an appealing but challenging task, which allows users to specify particular attributes of the generated outputs. In this paper, we propose a controllable dialogue generation model to steer response generation…

Computation and Language · Computer Science 2022-10-24 Zhe Hu , Zhiwei Cao , Hou Pong Chan , Jiachen Liu , Xinyan Xiao , Jinsong Su , Hua Wu

Controllable text generation (CTG) seeks to craft texts adhering to specific attributes, traditionally employing learning-based techniques such as training, fine-tuning, or prefix-tuning with attribute-specific datasets. These approaches,…

Computation and Language · Computer Science 2024-06-17 Zijian Feng , Hanzhang Zhou , Zixiao Zhu , Kezhi Mao

Large Language Models (LLMs) employ three popular training approaches: Masked Language Models (MLM), Causal Language Models (CLM), and Sequence-to-Sequence Models (seq2seq). However, each approach has its strengths and limitations, and…

Machine Learning · Computer Science 2025-02-18 Xuefeng Liu , Songhao Jiang , Bo Li , Rick Stevens

Background: Many different approaches to controlled text generation (CTG) have been proposed over recent years, but it is difficult to get a clear picture of which approach performs best, because different datasets and evaluation methods…

Computation and Language · Computer Science 2026-05-13 Michela Lorandi , Anya Belz

Controlling the output of Large Language Models (LLMs) through context-sensitive constraints has emerged as a promising approach to overcome the limitations of Context-Free Grammars (CFGs) in guaranteeing generation validity. However, such…

Computation and Language · Computer Science 2026-04-14 Mohammad Albinhassan , Pranava Madhyastha , Mark Law , Alessandra Russo

Instruction-tuned large language models have shown remarkable performance in aligning generated text with user intentions across various tasks. However, maintaining human-like discourse structure in the generated text remains a challenging…

Computation and Language · Computer Science 2023-12-20 Yinhong Liu , Yixuan Su , Ehsan Shareghi , Nigel Collier

The controllability of 3D object generation methods is achieved through input text. Existing text-to-3D object generation methods primarily focus on generating a single object based on a single object description. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shaorong Sun , Shuchao Pang , Yazhou Yao , Xiaoshui Huang

Large language models (LLMs) have shown remarkable success across a wide range of natural language generation tasks, where proper prompt designs make great impacts. While existing prompting methods are normally restricted to providing…

Computation and Language · Computer Science 2023-06-01 Bei Li , Rui Wang , Junliang Guo , Kaitao Song , Xu Tan , Hany Hassan , Arul Menezes , Tong Xiao , Jiang Bian , JingBo Zhu

Recent advancements in large language models have revolutionized text generation with their remarkable capabilities. These models can produce controlled texts that closely adhere to specific requirements when prompted appropriately.…

Computation and Language · Computer Science 2025-03-17 Zhe Yang , Yi Huang , Yaqin Chen , Xiaoting Wu , Junlan Feng , Chao Deng

Neural controllable text generation is an important area gaining attention due to its plethora of applications. Although there is a large body of prior work in controllable text generation, there is no unifying theme. In this work, we…

Computation and Language · Computer Science 2020-11-03 Shrimai Prabhumoye , Alan W Black , Ruslan Salakhutdinov

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

Text generation in image-based platforms, particularly for music-related content, requires precise control over text styles and the incorporation of emotional expression. However, existing approaches often need help to control the…

Computation and Language · Computer Science 2023-10-16 Yuelyu Ji , Yuheng Song , Wei Wang , Ruoyi Xu , Zhongqian Xie , Huiyun Liu

Advancements in natural language generation (NLG) and large language models (LLMs) have led to proficient text generation in various tasks. However, integrating intricate constraints into neural text generation, due to LLMs' opacity,…

Computation and Language · Computer Science 2024-03-22 Xiang Chen , Xiaojun Wan

We introduce CGA, a conditional VAE architecture, to control, generate, and augment text. CGA is able to generate natural English sentences controlling multiple semantic and syntactic attributes by combining adversarial learning with a…

Computation and Language · Computer Science 2020-10-05 Giuseppe Russo , Nora Hollenstein , Claudiu Musat , Ce Zhang