English
Related papers

Related papers: How do decoding algorithms distribute information …

200 papers

When generating text from probabilistic models, the chosen decoding strategy has a profound effect on the resulting text. Yet the properties elicited by various decoding strategies do not always transfer across natural language generation…

Computation and Language · Computer Science 2022-03-30 Gian Wiher , Clara Meister , Ryan Cotterell

Existing dialog datasets contain a sequence of utterances and responses without any explicit background knowledge associated with them. This has resulted in the development of models which treat conversation as a sequence-to-sequence…

Computation and Language · Computer Science 2018-09-24 Nikita Moghe , Siddhartha Arora , Suman Banerjee , Mitesh M. Khapra

Despite their growing capabilities, language models still frequently reproduce content from their training data, generate repetitive text, and favor common grammatical patterns and vocabulary. A possible cause is the decoding strategy: the…

Computation and Language · Computer Science 2026-01-15 Giorgio Franceschelli , Mirco Musolesi

Several prior works have shown that language models (LMs) can generate text containing harmful social biases and stereotypes. While decoding algorithms play a central role in determining properties of LM generated text, their impact on the…

Computation and Language · Computer Science 2022-10-11 Jwala Dhamala , Varun Kumar , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

Chatbots, taking advantage of the success of the messaging apps and recent advances in Artificial Intelligence, have become very popular, from helping business to improve customer services to chatting to users for the sake of conversation…

Computation and Language · Computer Science 2018-02-21 Ana Paula Appel , Paulo Rodrigo Cavalin , Marisa Affonso Vasconcelos , Claudio Santos Pinhanez

The consistency of a response to a given post at semantic-level and emotional-level is essential for a dialogue system to deliver human-like interactions. However, this challenge is not well addressed in the literature, since most of the…

Computation and Language · Computer Science 2021-04-12 Wei Wei , Jiayi Liu , Xianling Mao , Guibin Guo , Feida Zhu , Pan Zhou , Yuchong Hu , Shanshan Feng

We investigate the task of modeling open-domain, multi-turn, unstructured, multi-participant, conversational dialogue. We specifically study the effect of incorporating different elements of the conversation. Unlike previous efforts, which…

Computation and Language · Computer Science 2016-06-02 Rami Al-Rfou , Marc Pickett , Javier Snaider , Yun-hsuan Sung , Brian Strope , Ray Kurzweil

Despite the remarkable advances in language modeling, current mainstream decoding methods still struggle to generate texts that align with human texts across different aspects. In particular, sampling-based methods produce less-repetitive…

Computation and Language · Computer Science 2024-06-06 Haozhe Ji , Pei Ke , Hongning Wang , Minlie Huang

This work aims to build a dialogue agent that can weave new factual content into conversations as naturally as humans. We draw insights from linguistic principles of conversational analysis and annotate human-human conversations from the…

Computation and Language · Computer Science 2021-04-19 Ashwin Paranjape , Christopher D. Manning

A good conversation requires balance -- between simplicity and detail; staying on topic and changing it; asking questions and answering them. Although dialogue agents are commonly evaluated via human judgments of overall quality, the…

Computation and Language · Computer Science 2019-04-11 Abigail See , Stephen Roller , Douwe Kiela , Jason Weston

In the face of uncertainty, the ability to *seek information* is of fundamental importance. In many practical applications, such as medical diagnosis and troubleshooting, the information needed to solve the task is not initially given and…

Computation and Language · Computer Science 2024-11-14 Zhiyuan Hu , Chumin Liu , Xidong Feng , Yilun Zhao , See-Kiong Ng , Anh Tuan Luu , Junxian He , Pang Wei Koh , Bryan Hooi

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

Generating stylized responses is essential to build intelligent and engaging dialogue systems. However, this task is far from well-explored due to the difficulties of rendering a particular style in coherent responses, especially when the…

Computation and Language · Computer Science 2020-12-17 Yinhe Zheng , Zikai Chen , Rongsheng Zhang , Shilei Huang , Xiaoxi Mao , Minlie Huang

To quantify how well natural language understanding models can capture consistency in a general conversation, we introduce the DialoguE COntradiction DEtection task (DECODE) and a new conversational dataset containing both human-human and…

Computation and Language · Computer Science 2020-12-29 Yixin Nie , Mary Williamson , Mohit Bansal , Douwe Kiela , Jason Weston

Natural language sentence matching is the task of comparing two sentences and identifying the relationship between them.It has a wide range of applications in natural language processing tasks such as reading comprehension, question and…

Computation and Language · Computer Science 2022-03-22 Kexin Jiang , Yahui Zhao , Rongyi Cui , Zhenguo Zhang

In dialogue generation, the naturalness of responses is crucial for effective human-machine interaction. Personalized response generation poses even greater challenges, as the responses must remain coherent and consistent with the user's…

Computation and Language · Computer Science 2025-06-18 Chih-Hao Hsu , Ying-Jia Lin , Hung-Yu Kao

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

The study illustrates a first step towards an ongoing work aimed at developing a dataset of dialogues potentially useful for customer service conversation management between humans and AI chatbots. The approach exploits ChatGPT 3.5 to…

Human-Computer Interaction · Computer Science 2025-01-03 Alfredo Cuzzocrea , Giovanni Pilato , Pablo Garcia Bringas

The Uniform Information Density (UID) hypothesis posits that speakers optimize the communicative properties of their utterances by avoiding spikes in information, thereby maintaining a relatively uniform information profile over time. This…

Computation and Language · Computer Science 2024-06-03 Ella Rabinovich

In open-domain question answering, a model receives a text question as input and searches for the correct answer using a large evidence corpus. The retrieval step is especially difficult as typical evidence corpora have \textit{millions} of…

Computation and Language · Computer Science 2021-09-24 Christopher Sciavolino