English
Related papers

Related papers: Paraphrase Generation with Deep Reinforcement Lear…

200 papers

Recent advances in large-scale pre-training such as GPT-3 allow seemingly high quality text to be generated from a given prompt. However, such generation systems often suffer from problems of hallucinated facts, and are not inherently…

Computation and Language · Computer Science 2022-02-25 Yizhe Zhang , Siqi Sun , Xiang Gao , Yuwei Fang , Chris Brockett , Michel Galley , Jianfeng Gao , Bill Dolan

Paraphrasing is a useful natural language processing task that can contribute to more diverse generated or translated texts. Natural language inference (NLI) and paraphrasing share some similarities and can benefit from a joint approach. We…

Computation and Language · Computer Science 2021-11-16 Matej Klemen , Marko Robnik-Šikonja

Controlled text generation tasks such as unsupervised text style transfer have increasingly adopted the use of Reinforcement Learning (RL). A major challenge in applying RL to such tasks is the sparse reward, which is available only after…

Computation and Language · Computer Science 2022-04-19 Bhargav Upadhyay , Akhilesh Sudhakar , Arjun Maheswaran

Unsupervised paraphrase generation is a promising and important research topic in natural language processing. We propose UPSA, a novel approach that accomplishes Unsupervised Paraphrasing by Simulated Annealing. We model paraphrase…

Computation and Language · Computer Science 2019-09-11 Xianggen Liu , Lili Mou , Fandong Meng , Hao Zhou , Jie Zhou , Sen Song

Most prior work on exemplar-based syntactically controlled paraphrase generation relies on automatically-constructed large-scale paraphrase datasets, which are costly to create. We sidestep this prerequisite by adapting models from prior…

Computation and Language · Computer Science 2021-09-21 Mingda Chen , Sam Wiseman , Kevin Gimpel

Text generation is a fundamental building block in natural language processing tasks. Existing sequential models performs autoregression directly over the text sequence and have difficulty generating long sentences of complex structures.…

Computation and Language · Computer Science 2018-08-16 Qipeng Guo , Xipeng Qiu , Xiangyang Xue , Zheng Zhang

This article introduces semantically meaningful causal language modeling (SMCLM), a selfsupervised method of training autoregressive models to generate semantically equivalent text. Our approach involves using semantically meaningful text…

Computation and Language · Computer Science 2025-07-08 Michał Perełkiewicz , Sławomir Dadas , Rafał Poświata

Generate-then-rank is a widely used mechanism for text generation, where a generator produces multiple text candidates and a ranker chooses the best one among the text candidates. However, existing methods usually train the generator and…

Computation and Language · Computer Science 2023-05-30 Weizhou Shen , Yeyun Gong , Yelong Shen , Song Wang , Xiaojun Quan , Nan Duan , Weizhu Chen

Digital learning platforms enable students to learn on a flexible and individual schedule as well as providing instant feedback mechanisms. The field of STEM education requires students to solve numerous training exercises to grasp…

Computation and Language · Computer Science 2021-10-01 Stanley Uros Keller

Paraphrase generation is a difficult problem. This is not only because of the limitations in text generation capabilities but also due that to the lack of a proper definition of what qualifies as a paraphrase and corresponding metrics to…

Computation and Language · Computer Science 2022-05-27 Omkar Patil , Rahul Singh , Tarun Joshi

Training a spoken language understanding system, as the one in Alexa, typically requires a large human-annotated corpus of data. Manual annotations are expensive and time consuming. In Alexa Skill Kit (ASK) user experience with the skill…

Computation and Language · Computer Science 2020-06-30 Alex Sokolov , Denis Filimonov

Keyphrase generation (KPG) aims to automatically generate a collection of phrases representing the core concepts of a given document. The dominant paradigms in KPG include one2seq and one2set. Recently, there has been increasing interest in…

Computation and Language · Computer Science 2024-10-22 Liangying Shao , Liang Zhang , Minlong Peng , Guoqi Ma , Hao Yue , Mingming Sun , Jinsong Su

Lexical simplification (LS) methods based on pretrained language models have made remarkable progress, generating potential substitutes for a complex word through analysis of its contextual surroundings. However, these methods require…

Computation and Language · Computer Science 2023-07-31 Kang Liu , Jipeng Qiang , Yun Li , Yunhao Yuan , Yi Zhu , Kaixun Hua

Large reasoning models (LRMs) have recently shown promise in solving complex math problems when optimized with Reinforcement Learning (RL). But conventional approaches rely on outcome-only rewards that provide sparse feedback, resulting in…

Machine Learning · Computer Science 2025-08-01 Tao He , Rongchuan Mu , Lizi Liao , Yixin Cao , Ming Liu , Bing Qin

We propose syntactically controlled paraphrase networks (SCPNs) and use them to generate adversarial examples. Given a sentence and a target syntactic form (e.g., a constituency parse), SCPNs are trained to produce a paraphrase of the…

Computation and Language · Computer Science 2018-04-18 Mohit Iyyer , John Wieting , Kevin Gimpel , Luke Zettlemoyer

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor…

Computation and Language · Computer Science 2022-10-17 Anthony Sicilia , Malihe Alikhani

Sequence generation applications require satisfying semantic constraints, such as ensuring that programs are correct, using certain keywords, or avoiding undesirable content. Language models, whether fine-tuned or prompted with few-shot…

Computation and Language · Computer Science 2022-11-02 Sean Welleck , Ximing Lu , Peter West , Faeze Brahman , Tianxiao Shen , Daniel Khashabi , Yejin Choi

Modeling the structure of coherent texts is a key NLP problem. The task of coherently organizing a given set of sentences has been commonly used to build and evaluate models that understand such structure. We propose an end-to-end…

Computation and Language · Computer Science 2017-12-25 Lajanugen Logeswaran , Honglak Lee , Dragomir Radev

A repetition is a response that repeats words in the previous speaker's utterance in a dialogue. Repetitions are essential in communication to build trust with others, as investigated in linguistic studies. In this work, we focus on…

Computation and Language · Computer Science 2022-07-05 Toshiki Kawamoto , Hidetaka Kamigaito , Kotaro Funakoshi , Manabu Okumura

Neural language model-based approaches to automated story generation suffer from two important limitations. First, language model-based story generators generally do not work toward a given goal or ending. Second, they often lose coherence…

Computation and Language · Computer Science 2021-12-08 Louis Castricato , Spencer Frazier , Jonathan Balloch , Nitya Tarakad , Mark Riedl