English
Related papers

Related papers: Better Conversations by Modeling,Filtering,and Opt…

200 papers

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

Neural conversation models such as encoder-decoder models are easy to generate bland and generic responses. Some researchers propose to use the conditional variational autoencoder(CVAE) which maximizes the lower bound on the conditional…

Computation and Language · Computer Science 2019-11-25 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Guodong Zhou , Shuming Shi

Multi-encoder models are a broad family of context-aware neural machine translation systems that aim to improve translation quality by encoding document-level contextual information alongside the current sentence. The context encoding is…

Computation and Language · Computer Science 2022-10-25 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier

Recent studies have shown that the multi-encoder models are agnostic to the choice of context, and the context encoder generates noise which helps improve the models in terms of BLEU score. In this paper, we further explore this idea by…

Computation and Language · Computer Science 2023-08-14 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up…

Computation and Language · Computer Science 2016-04-08 Iulian V. Serban , Alessandro Sordoni , Yoshua Bengio , Aaron Courville , Joelle Pineau

We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically devised for capturing image--caption coherence relations, we…

Computation and Language · Computer Science 2022-11-30 Malihe Alikhani , Piyush Sharma , Shengjie Li , Radu Soricut , Matthew Stone

Conversational agents have begun to rise both in the academic (in terms of research) and commercial (in terms of applications) world. This paper investigates the task of building a non-goal driven conversational agent, using neural network…

Computation and Language · Computer Science 2019-02-01 Raffaele Piccini , Gerasimos Spanakis

Recent large language models (LLMs) have shown remarkable performance in aligning generated text with user intentions across various tasks. When it comes to long-form text generation, there has been a growing interest in generation from a…

Computation and Language · Computer Science 2024-04-04 Yinhong Liu , Yixuan Su , Ehsan Shareghi , Nigel Collier

Coherence across multiple turns is a major challenge for state-of-the-art dialogue models. Arguably the most successful approach to automatically learning text coherence is the entity grid, which relies on modelling patterns of distribution…

Computation and Language · Computer Science 2018-06-22 Alessandra Cervone , Evgeny Stepanov , Giuseppe Riccardi

Open-domain generative dialogue systems have attracted considerable attention over the past few years. Currently, how to automatically evaluate them, is still a big challenge problem. As far as we know, there are three kinds of automatic…

Computation and Language · Computer Science 2020-04-07 Tian Lan , Xian-Ling Mao , Wei Wei , Xiaoyan Gao , Heyan Huang

Retrieval-based conversational systems learn to rank response candidates for a given dialogue context by computing the similarity between their vector representations. However, training on a single textual form of the multi-turn context…

Computation and Language · Computer Science 2022-04-19 Lahari Poddar , Peiyao Wang , Julia Reinspach

While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the coherence in text, coherence in spoken discourse is also…

Computation and Language · Computer Science 2021-01-05 Rajaswa Patil , Yaman Kumar Singla , Rajiv Ratn Shah , Mika Hama , Roger Zimmermann

Neural network-based Open-ended conversational agents automatically generate responses based on predictive models learned from a large number of pairs of utterances. The generated responses are typically acceptable as a sentence but are…

Computation and Language · Computer Science 2019-05-16 Chenyang Huang , Osmar R. Zaïane

Training agents to communicate with one another given task-based supervision only has attracted considerable attention recently, due to the growing interest in developing models for human-agent interaction. Prior work on the topic focused…

Computation and Language · Computer Science 2019-03-26 Ben Bogin , Mor Geva , Jonathan Berant

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deep understanding of conversational context, and generate…

Computation and Language · Computer Science 2019-10-21 Sam Shleifer , Manish Chablani , Namit Katariya , Anitha Kannan , Xavier Amatriain

Generative encoder-decoder models offer great promise in developing domain-general dialog systems. However, they have mainly been applied to open-domain conversations. This paper presents a practical and novel framework for building…

Computation and Language · Computer Science 2017-06-27 Tiancheng Zhao , Allen Lu , Kyusong Lee , Maxine Eskenazi

Game-theoretic interactions between agents with Large Language Models (LLMs) have revealed many emergent capabilities, yet the linguistic diversity of these interactions has not been sufficiently quantified. In this paper, we present the…

Computation and Language · Computer Science 2026-02-24 Punya Syon Pandey , Yongjin Yang , Jiarui Liu , Zhijing Jin

Conditional variational models, using either continuous or discrete latent variables, are powerful for open-domain dialogue response generation. However, previous works show that continuous latent variables tend to reduce the coherence of…

Computation and Language · Computer Science 2022-12-05 Bin Sun , Yitong Li , Fei Mi , Weichao Wang , Yiwei Li , Kan Li

Self-modulating mechanisms introduce dynamic adaptation capabilities within language models through contextual realignment strategies that influence token embedding trajectories across extended sequences. Contextual Flux is explored as an…

Computation and Language · Computer Science 2025-08-11 Henry Evidail , Zachary Mountebank , Alistair Hathersage , Peter Stanhope , Basil Ravenscroft , Tobias Waddingham