English
Related papers

Related papers: LiFi: Lightweight Controlled Text Generation with …

200 papers

Text generation under constraints have seen increasing interests in natural language processing, especially with the rapidly improving capabilities of large language models. However, existing benchmarks for constrained generation usually…

Computation and Language · Computer Science 2023-07-18 Shunyu Yao , Howard Chen , Austin W. Hanjie , Runzhe Yang , Karthik Narasimhan

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Although significant progress has been made in many tasks within the field of Natural Language Processing (NLP), Controlled Text Generation (CTG) continues to face numerous challenges, particularly in achieving fine-grained conditional…

Computation and Language · Computer Science 2025-09-18 Xinxu Zhou , Jiaqi Bai , Zhenqi Sun , Fanxiang Zeng , Yue Liu

Generative diffusion models show promise for data augmentation. However, applying them to fine-grained tasks presents a significant challenge: ensuring synthetic images accurately capture the subtle, category-defining features critical for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhiguang Lu , Qianqian Xu , Peisong Wen , Siran Dai , Qingming Huang

With the advances of deep learning techniques, text generation is attracting increasing interest in the artificial intelligence (AI) community, because of its wide applications and because it is an essential component of AI. Traditional…

Computation and Language · Computer Science 2023-09-19 Lili Mou

Text-to-video generation has shown promising results. However, by taking only natural languages as input, users often face difficulties in providing detailed information to precisely control the model's output. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Hsin-Ping Huang , Yu-Chuan Su , Deqing Sun , Lu Jiang , Xuhui Jia , Yukun Zhu , Ming-Hsuan Yang

Recent work on controlled text generation has either required attribute-based fine-tuning of the base language model (LM), or has restricted the parameterization of the attribute discriminator to be compatible with the base autoregressive…

Computation and Language · Computer Science 2022-04-05 Fatemehsadat Mireshghallah , Kartik Goyal , Taylor Berg-Kirkpatrick

Controllable text-to-image (T2I) diffusion models generate images conditioned on both text prompts and semantic inputs of other modalities like edge maps. Nevertheless, current controllable T2I methods commonly face challenges related to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuehai He , Jian Zheng , Jacob Zhiyuan Fang , Robinson Piramuthu , Mohit Bansal , Vicente Ordonez , Gunnar A Sigurdsson , Nanyun Peng , Xin Eric Wang

As large-scale language model pretraining pushes the state-of-the-art in text generation, recent work has turned to controlling attributes of the text such models generate. While modifying the pretrained models via fine-tuning remains the…

Computation and Language · Computer Science 2021-08-05 Sachin Kumar , Eric Malmi , Aliaksei Severyn , Yulia Tsvetkov

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or…

Computation and Language · Computer Science 2024-08-23 Xun Liang , Hanyu Wang , Yezhaohui Wang , Shichao Song , Jiawei Yang , Simin Niu , Jie Hu , Dan Liu , Shunyu Yao , Feiyu Xiong , Zhiyu Li

Controllable Text Generation (CTG) is emerging area in the field of natural language generation (NLG). It is regarded as crucial for the development of advanced text generation technologies that better meet the specific constraints in…

Computation and Language · Computer Science 2023-08-25 Hanqing Zhang , Haolin Song , Shaoyu Li , Ming Zhou , Dawei Song

We propose a weakly-supervised approach for conditional image generation of complex scenes where a user has fine control over objects appearing in the scene. We exploit sparse semantic maps to control object shapes and classes, as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Dario Pavllo , Aurelien Lucchi , Thomas Hofmann

Controlling the output of Large Language Models (LLMs) through context-sensitive constraints has emerged as a promising approach to overcome the limitations of Context-Free Grammars (CFGs) in guaranteeing generation validity. However, such…

Computation and Language · Computer Science 2026-04-14 Mohammad Albinhassan , Pranava Madhyastha , Mark Law , Alessandra Russo

Large Language Models (LLMs), particularly Code LLMs, have demonstrated impressive performance in code generation. Current research primarily focuses on the correctness of generated code, while efficiency remains less explored. Recent works…

Software Engineering · Computer Science 2025-02-27 Tong Ye , Weigang Huang , Xuhong Zhang , Tengfei Ma , Peiyu Liu , Jianwei Yin , Wenhai Wang

Structure aware graph generation aims to generate graphs that satisfy given topological properties. It has applications in domains such as drug discovery, social network modeling, and knowledge graph construction. Unlike existing methods…

Artificial Intelligence · Computer Science 2026-05-05 Nidhi Vakil , Hadi Amiri

Despite significant advancements in natural language generation, controlling language models to produce texts with desired attributes remains a formidable challenge. In this work, we introduce RSA-Control, a training-free controllable text…

Artificial Intelligence · Computer Science 2024-10-28 Yifan Wang , Vera Demberg

Aligning language models (LMs) with user intent is becoming increasingly relevant to enhance user experience. This calls for designing methods that can allow users to control the properties of the language that LMs generate, for example,…

Computation and Language · Computer Science 2025-09-23 Vinay Samuel , Harshita Diddee , Yiming Zhang , Daphne Ippolito

Conditional image generation models have achieved remarkable results by leveraging text-based control to generate customized images. However, the high resource demands of these models and the scarcity of well-annotated data have hindered…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yicheng Jiang , Jin Yuan , Hua Yuan , Yao Zhang , Yong Rui

Precise attribute intensity control--generating Large Language Model (LLM) outputs with specific, user-defined attribute intensities--is crucial for AI systems adaptable to diverse user expectations. Current LLM alignment methods, however,…

Artificial Intelligence · Computer Science 2026-02-19 Rongzhi Zhang , Liqin Ye , Yuzhao Heng , Xiang Chen , Tong Yu , Lingkai Kong , Sudheer Chava , Chao Zhang

Generating music with deep neural networks has been an area of active research in recent years. While the quality of generated samples has been steadily increasing, most methods are only able to exert minimal control over the generated…

Sound · Computer Science 2024-02-23 Dimitri von Rütte , Luca Biggio , Yannic Kilcher , Thomas Hofmann