English

C$^3$TG: Conflict-aware, Composite, and Collaborative Controlled Text Generation

Computation and Language 2025-11-18 v2 Artificial Intelligence

Abstract

Recent advancements in large language models (LLMs) have demonstrated remarkable text generation capabilities. However, controlling specific attributes of generated text remains challenging without architectural modifications or extensive fine-tuning. Current methods typically toggle a single, basic attribute but struggle with precise multi-attribute control. In scenarios where attribute requirements conflict, existing methods lack coordination mechanisms, causing interference between desired attributes. Furthermore, these methods fail to incorporate iterative optimization processes in the controlled generation pipeline. To address these limitations, we propose Conflict-aware, Composite, and Collaborative Controlled Text Generation (C3^3TG), a two-phase framework for fine-grained, multi-dimensional text attribute control. During generation, C3^3TG selectively pairs the LLM with the required attribute classifiers from the 17 available dimensions and employs weighted KL-divergence to adjust token probabilities. The optimization phase then leverages an energy function combining classifier scores and penalty terms to resolve attribute conflicts through iterative feedback, enabling precise control over multiple dimensions simultaneously while preserving natural text flow. Experiments show that C3^3TG significantly outperforms baselines across multiple metrics including attribute accuracy, linguistic fluency, and output diversity, while simultaneously reducing toxicity. These results establish C3^3TG as an effective and flexible solution for multi-dimensional text attribute control that requires no costly model modifications.

Keywords

Cite

@article{arxiv.2511.09292,
  title  = {C$^3$TG: Conflict-aware, Composite, and Collaborative Controlled Text Generation},
  author = {Yu Li and Zhe Yang and Yi Huang and Xin Liu and Guilin Qi},
  journal= {arXiv preprint arXiv:2511.09292},
  year   = {2025}
}

Comments

This paper has been accepted as a poster presentation at AAAI-2026

R2 v1 2026-07-01T07:33:53.586Z