English
Related papers

Related papers: On Decoding Strategies for Neural Text Generators

200 papers

In sequence-to-sequence learning, e.g., natural language generation, the decoder relies on the attention mechanism to efficiently extract information from the encoder. While it is common practice to draw information from only the last…

Computation and Language · Computer Science 2022-08-30 Fenglin Liu , Xuancheng Ren , Guangxiang Zhao , Chenyu You , Xuewei Ma , Xian Wu , Xu Sun

Autoregressive speech synthesis often adopts a left-to-right order, yet generation order is a modelling choice. We investigate decoding order through masked diffusion framework, which progressively unmasks positions and allows arbitrary…

Sound · Computer Science 2026-01-14 Minghui Zhao , Anton Ragni

Generating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation. Despite the success in modeling intra-sentence coherence, existing generation models…

Computation and Language · Computer Science 2021-05-20 Jian Guan , Xiaoxi Mao , Changjie Fan , Zitao Liu , Wenbiao Ding , Minlie Huang

Code generation aims to automatically generate a piece of code given an input natural language utterance. Currently, among dominant models, it is treated as a sequence-to-tree task, where a decoder outputs a sequence of actions…

Artificial Intelligence · Computer Science 2021-06-01 Binbin Xie , Jinsong Su , Yubin Ge , Xiang Li , Jianwei Cui , Junfeng Yao , Bin Wang

Automatic question generation is one of the most challenging tasks of Natural Language Processing. It requires "bidirectional" language processing: firstly, the system has to understand the input text (Natural Language Understanding) and it…

Computation and Language · Computer Science 2022-05-26 Miroslav Blšták , Viera Rozinajová

Natural language generation plays a critical role in spoken dialogue systems. We present a new approach to natural language generation for task-oriented dialogue using recurrent neural networks in an encoder-decoder framework. In contrast…

Computation and Language · Computer Science 2017-04-25 Shikhar Sharma , Jing He , Kaheer Suleman , Hannes Schulz , Philip Bachman

Estimating uncertainty in Large Language Models (LLMs) is important for properly evaluating LLMs, and ensuring safety for users. However, prior approaches to uncertainty estimation focus on the final answer in generated text, ignoring…

Computation and Language · Computer Science 2024-12-12 Eric Bigelow , Ari Holtzman , Hidenori Tanaka , Tomer Ullman

We investigate the impact of search strategies in neural dialogue modeling. We first compare two standard search algorithms, greedy and beam search, as well as our newly proposed iterative beam search which produces a more diverse set of…

Computation and Language · Computer Science 2019-11-05 Ilia Kulikov , Alexander H. Miller , Kyunghyun Cho , Jason Weston

Text generation has become more accessible than ever, and the increasing interest in these systems, especially those using large language models, has spurred an increasing number of related publications. We provide a systematic literature…

Computation and Language · Computer Science 2024-09-02 Jonas Becker , Jan Philip Wahle , Bela Gipp , Terry Ruas

Many text generation tasks naturally contain two steps: content selection and surface realization. Current neural encoder-decoder models conflate both steps into a black-box architecture. As a result, the content to be described in the text…

Computation and Language · Computer Science 2019-09-11 Xiaoyu Shen , Jun Suzuki , Kentaro Inui , Hui Su , Dietrich Klakow , Satoshi Sekine

In many natural language processing (NLP) tasks the same input (e.g. source sentence) can have multiple possible outputs (e.g. translations). To analyze how this ambiguity (also known as intrinsic uncertainty) shapes the distribution…

Computation and Language · Computer Science 2022-04-04 Felix Stahlberg , Ilia Kulikov , Shankar Kumar

Language models (LMs) have revolutionized the way we interact with information, but they often generate nonfactual text, raising concerns about their reliability. Previous methods use external knowledge as references for text generation to…

Computation and Language · Computer Science 2023-08-31 Hongjin Qian , Zhicheng Dou , Jiejun Tan , Haonan Chen , Haoqi Gu , Ruofei Lai , Xinyu Zhang , Zhao Cao , Ji-Rong Wen

The language that we produce reflects our personality, and various personal and demographic characteristics can be detected in natural language texts. We focus on one particular personal trait of the author, gender, and study how it is…

Computation and Language · Computer Science 2017-01-13 Ella Rabinovich , Shachar Mirkin , Raj Nath Patel , Lucia Specia , Shuly Wintner

The task of translating between programming languages differs from the challenge of translating natural languages in that programming languages are designed with a far more rigid set of structural and grammatical rules. Previous work has…

Machine Learning · Computer Science 2018-07-06 Mehdi Drissi , Olivia Watkins , Aditya Khant , Vivaswat Ojha , Pedro Sandoval , Rakia Segev , Eric Weiner , Robert Keller

Text generative models (TGMs) excel in producing text that matches the style of human language reasonably well. Such TGMs can be misused by adversaries, e.g., by automatically generating fake news and fake product reviews that can look…

Computation and Language · Computer Science 2020-11-04 Ganesh Jawahar , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it…

Computation and Language · Computer Science 2021-06-03 Paras Bhatt , Anthony Rios

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

The meteoric rise in text generation capability has been accompanied by parallel growth in interest in machine-generated text detection: the capability to identify whether a given text was generated using a model or written by a person.…

Computation and Language · Computer Science 2026-04-24 Kevin Stowe , Svetlana Afanaseva , Rodolfo Raimundo , Yitao Sun , Kailash Patil

In the last decade, machine translation has become a popular means to deal with multilingual digital content. By providing higher quality translations, obfuscating the source language of a text becomes more attractive. In this paper, we…

Computation and Language · Computer Science 2021-06-25 Benjamin Murauer , Michael Tschuggnall , Günther Specht