English
Related papers

Related papers: Learning Controllable Content Generators

200 papers

This paper introduces the unsupervised learning problem of playable video generation (PVG). In PVG, we aim at allowing a user to control the generated video by selecting a discrete action at every time step as when playing a video game. The…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Willi Menapace , Stéphane Lathuilière , Sergey Tulyakov , Aliaksandr Siarohin , Elisa Ricci

Multiple-choice cloze questions are commonly used to assess linguistic proficiency and comprehension. However, generating high-quality distractors remains challenging, as existing methods often lack adaptability and control over difficulty…

Computation and Language · Computer Science 2026-05-20 Seokhoon Kang , Yejin Jeon , Seonjeong Hwang , Gary Geunbae Lee

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

Machine Learning · Computer Science 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

Reward design plays a pivotal role in the training of game AIs, requiring substantial domain-specific knowledge and human effort. In recent years, several studies have explored reward generation for training game agents and controlling…

Artificial Intelligence · Computer Science 2026-05-26 In-Chang Baek , Sung-Hyun Kim , Sam Earle , Zehua Jiang , Jin-Ha Noh , Julian Togelius , Kyung-Joong Kim

Current end-to-end neural conversation models inherently lack the flexibility to impose semantic control in the response generation process, often resulting in uninteresting responses. Attempts to boost informativeness alone come at the…

Achieving optimal balance in games is essential to their success, yet reliant on extensive manual work and playtesting. To facilitate this process, the Procedural Content Generation via Reinforcement Learning (PCGRL) framework has recently…

Human-Computer Interaction · Computer Science 2024-09-10 Florian Rupp , Alessandro Puddu , Christian Becker-Asano , Kai Eckert

Procedural content generation (PCG) is a growing field, with numerous applications in the video game industry and great potential to help create better games at a fraction of the cost of manual creation. However, much of the work in PCG is…

Artificial Intelligence · Computer Science 2023-07-20 Michael Beukman , Manuel Fokam , Marcel Kruger , Guy Axelrod , Muhammad Nasir , Branden Ingram , Benjamin Rosman , Steven James

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to…

Computation and Language · Computer Science 2018-05-11 Antoine Bosselut , Asli Celikyilmaz , Xiaodong He , Jianfeng Gao , Po-Sen Huang , Yejin Choi

To align conditional text generation model outputs with desired behaviors, there has been an increasing focus on training the model using reinforcement learning (RL) with reward functions learned from human annotations. Under this…

Computation and Language · Computer Science 2023-06-02 Richard Yuanzhe Pang , Vishakh Padmakumar , Thibault Sellam , Ankur P. Parikh , He He

Search-based procedural content generation (PCG) is a well-known method for level generation in games. Its key advantage is that it is generic and able to satisfy functional constraints. However, due to the heavy computational costs to run…

Artificial Intelligence · Computer Science 2022-08-26 Ahmed Khalifa , Michael Cerny Green , Julian Togelius

Controllable text generation concerns two fundamental tasks of wide applications, namely generating text of given attributes (i.e., attribute-conditional generation), and minimally editing existing text to possess desired attributes (i.e.,…

Computation and Language · Computer Science 2022-01-25 Zhiting Hu , Li Erran Li

Controllable text generation is an appealing but challenging task, which allows users to specify particular attributes of the generated outputs. In this paper, we propose a controllable dialogue generation model to steer response generation…

Computation and Language · Computer Science 2022-10-24 Zhe Hu , Zhiwei Cao , Hou Pong Chan , Jiachen Liu , Xinyan Xiao , Jinsong Su , Hua Wu

Recently, multi-aspect controllable text generation that controls the generated text in multiple aspects (e.g., sentiment, topic, and keywords) has attracted increasing attention. Although methods based on parameter efficient tuning like…

Computation and Language · Computer Science 2023-05-30 Xuancheng Huang , Zijun Liu , Peng Li , Tao Li , Maosong Sun , Yang Liu

Steering language generation towards objectives or away from undesired content has been a long-standing goal in utilizing language models (LM). Recent work has demonstrated reinforcement learning and weighted decoding as effective…

Computation and Language · Computer Science 2022-12-22 Minbeom Kim , Hwanhee Lee , Kang Min Yoo , Joonsuk Park , Hwaran Lee , Kyomin Jung

Neural controllable text generation is an important area gaining attention due to its plethora of applications. Although there is a large body of prior work in controllable text generation, there is no unifying theme. In this work, we…

Computation and Language · Computer Science 2020-11-03 Shrimai Prabhumoye , Alan W Black , Ruslan Salakhutdinov

In Natural Language Generation (NLG) tasks, for any input, multiple communicative goals are plausible, and any goal can be put into words, or produced, in multiple ways. We characterise the extent to which human production varies lexically,…

Computation and Language · Computer Science 2023-10-23 Mario Giulianelli , Joris Baan , Wilker Aziz , Raquel Fernández , Barbara Plank

Large-scale natural language generation requires the integration of vast amounts of knowledge: lexical, grammatical, and conceptual. A robust generator must be able to operate well even when pieces of knowledge are missing. It must also be…

cmp-lg · Computer Science 2008-02-03 Kevin Knight , Vasileios Hatzivassiloglou

Content is created for a well-defined purpose, often described by a metric or signal represented in the form of structured information. The relationship between the goal (metrics) of target content and the content itself is non-trivial.…

Computation and Language · Computer Science 2022-03-29 Navita Goyal , Roodram Paneri , Ayush Agarwal , Udit Kalani , Abhilasha Sancheti , Niyati Chhaya

With the rapid development of AI-generated content (AIGC), video generation has emerged as one of its most dynamic and impactful subfields. In particular, the advancement of video generation foundation models has led to growing demand for…

Generative adversarial networks (GANs) are deep neural networks that allow us to sample from an arbitrary probability distribution without explicitly estimating the distribution. There is a generator that takes a latent vector as input and…

Machine Learning · Computer Science 2021-06-22 Alper Ahmetoğlu , Ethem Alpaydın