English
Related papers

Related papers: Controllable Text Generation via Probability Densi…

200 papers

Advances in generative models increase the need for sample quality assessment. To do so, previous methods rely on a pre-trained feature extractor to embed the generated samples and real samples into a common space for comparison. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jingyi Xu , Hieu Le , Dimitris Samaras

Controllable Text Generation (CTG) is emerging area in the field of natural language generation (NLG). It is regarded as crucial for the development of advanced text generation technologies that better meet the specific constraints in…

Computation and Language · Computer Science 2023-08-25 Hanqing Zhang , Haolin Song , Shaoyu Li , Ming Zhou , Dawei Song

Multi-aspect controllable text generation is a more challenging and practical task than single-aspect control. Existing methods achieve complex multi-aspect control by fusing multiple controllers learned from single-aspect, but suffer from…

Computation and Language · Computer Science 2022-10-20 Yuxuan Gu , Xiaocheng Feng , Sicheng Ma , Lingyuan Zhang , Heng Gong , Bing Qin

Recent advances in neural-based generative modeling have reignited the hopes of having computer systems capable of conversing with humans and able to understand natural language. The employment of deep neural architectures has been largely…

Computation and Language · Computer Science 2022-11-16 Haoqin Tu , Yitong Li

Controlling the attribute intensity of text generation is crucial across scenarios (e.g., writing conciseness, chatting emotion, and explanation clarity). The remarkable capabilities of large language models (LLMs) have revolutionized text…

Computation and Language · Computer Science 2024-06-10 Shang Zhou , Feng Yao , Chengyu Dong , Zihan Wang , Jingbo Shang

This paper proposes a simple method for controllable text generation based on weighting logits with a free-form classifier, namely CAIF sampling. Using an arbitrary text classifier, we adjust a small part of a language model's logits and…

Computation and Language · Computer Science 2022-11-14 Askhat Sitdikov , Nikita Balagansky , Daniil Gavrilov , Alexander Markov

We propose a Distributional Approach for addressing Controlled Text Generation from pre-trained Language Models (LMs). This approach permits to specify, in a single formal framework, both "pointwise" and "distributional" constraints over…

Computation and Language · Computer Science 2021-05-07 Muhammad Khalifa , Hady Elsahar , Marc Dymetman

Controllable generation is one of the key requirements for successful adoption of deep generative models in real-world applications, but it still remains as a great challenge. In particular, the compositional ability to generate novel…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Weili Nie , Arash Vahdat , Anima Anandkumar

Controllable text generation is a growing field within natural language generation (NLG) that focuses on producing text that meets specific constraints in real-world applications. Previous approaches, such as plug-and-play controllers…

Computation and Language · Computer Science 2024-02-07 Hao Wang , Lei Sha

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

Text generation often requires high-precision output that obeys task-specific rules. This fine-grained control is difficult to enforce with off-the-shelf deep learning models. In this work, we consider augmenting neural generation models…

Computation and Language · Computer Science 2020-05-12 Xiang Lisa Li , Alexander M. Rush

Recent developments in neural networks have led to the advance in data-to-text generation. However, the lack of ability of neural models to control the structure of generated output can be limiting in certain real-world applications. In…

Computation and Language · Computer Science 2021-09-01 Yixuan Su , David Vandyke , Sihui Wang , Yimai Fang , Nigel Collier

In the rapidly advancing realm of visual generation, diffusion models have revolutionized the landscape, marking a significant shift in capabilities with their impressive text-guided generative functions. However, relying solely on text for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Pu Cao , Feng Zhou , Qing Song , Lu Yang

The field of Text-to-Speech has experienced huge improvements last years benefiting from deep learning techniques. Producing realistic speech becomes possible now. As a consequence, the research on the control of the expressiveness,…

Computation and Language · Computer Science 2019-03-28 Noé Tits , Fengna Wang , Kevin El Haddad , Vincent Pagel , Thierry Dutoit

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Recent text-to-image generation favors various forms of spatial conditions, e.g., masks, bounding boxes, and key points. However, the majority of the prior art requires form-specific annotations to fine-tune the original model, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Z. Zhang , B. Liu , J. Bao , L. Chen , S. Zhu , J. Yu

It has always been an important yet challenging problem to control language models to avoid generating texts with undesirable attributes, such as toxic language and unnatural repetition. We introduce Click for controllable text generation,…

Computation and Language · Computer Science 2023-06-07 Chujie Zheng , Pei Ke , Zheng Zhang , Minlie Huang

We present a novel generative model that combines state-of-the-art neural text-to-speech (TTS) with semi-supervised probabilistic latent variable models. By providing partial supervision to some of the latent variables, we are able to force…

Computation and Language · Computer Science 2019-10-07 Raza Habib , Soroosh Mariooryad , Matt Shannon , Eric Battenberg , RJ Skerry-Ryan , Daisy Stanton , David Kao , Tom Bagby

Controllable Text Generation (CTG) has obtained great success due to its fine-grained generation ability obtained by focusing on multiple attributes. However, most existing CTG researches overlook how to utilize the attribute entanglement…

Computation and Language · Computer Science 2022-11-01 Shulin Huang , Shirong Ma , Yinghui Li , Yangning Li , Shiyang Lin , Hai-Tao Zheng , Ying Shen

We propose a new method for generating realistic datasets with distribution shifts using any decoder-based generative model. Our approach systematically creates datasets with varying intensities of distribution shifts, facilitating a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Roy Friedman , Rhea Chowers