English
Related papers

Related papers: Challenging Neural Dialogue Models with Natural Da…

200 papers

The sequential order of utterances is often meaningful in coherent dialogues, and the order changes of utterances could lead to low-quality and incoherent conversations. We consider the order information as a crucial supervised signal for…

Computation and Language · Computer Science 2019-07-02 Jiawei Wu , Xin Wang , William Yang Wang

End-to-end dialog systems have become very popular because they hold the promise of learning directly from human to human dialog interaction. Retrieval and Generative methods have been explored in this area with mixed results. A key element…

Computation and Language · Computer Science 2018-04-24 Jatin Ganhotra , Lazaros Polymenakos

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational assistants online,…

Computation and Language · Computer Science 2021-10-06 Ruijie Zhou , Soham Deshmukh , Jeremiah Greer , Charles Lee

In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity…

Computation and Language · Computer Science 2023-11-09 Julia Rozanova , Deborah Ferreira , Marco Valentino , Mokanrarangan Thayaparan , Andre Freitas

Recently, neural network based dialogue systems have become ubiquitous in our increasingly digitalized society. However, due to their inherent opaqueness, some recently raised concerns about using neural models are starting to be taken…

Computation and Language · Computer Science 2020-05-28 Haochen Liu , Zhiwei Wang , Tyler Derr , Jiliang Tang

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Question Answering (QA) is fundamental to natural language processing in that most nlp problems can be phrased as QA (Kumar et al., 2015). Current weakly supervised memory network models that have been proposed so far struggle at answering…

Neural and Evolutionary Computing · Computer Science 2015-12-24 Ethan Caballero

There is a growing interest in improving the conversational ability of models by filtering the raw dialogue corpora. Previous filtering strategies usually rely on a scoring method to assess and discard samples from one perspective, enabling…

Computation and Language · Computer Science 2022-05-24 Yiwei Li , Bin Sun , Shaoxiong Feng , Kan Li

We introduce a new large-scale NLI benchmark dataset, collected via an iterative, adversarial human-and-model-in-the-loop procedure. We show that training models on this new dataset leads to state-of-the-art performance on a variety of…

Computation and Language · Computer Science 2020-05-07 Yixin Nie , Adina Williams , Emily Dinan , Mohit Bansal , Jason Weston , Douwe Kiela

Ranking responses for a given dialogue context is a popular benchmark in which the setup is to re-rank the ground-truth response over a limited set of $n$ responses, where $n$ is typically 10. The predominance of this setup in conversation…

Information Retrieval · Computer Science 2022-04-25 Gustavo Penha , Claudia Hauff

Continual learning -- the ability to acquire knowledge incrementally without forgetting previous skills -- is fundamental to natural intelligence. While the human brain excels at this, artificial neural networks struggle with "catastrophic…

Machine Learning · Computer Science 2025-09-16 Aoi Otani

Many datasets have been shown to contain incidental correlations created by idiosyncrasies in the data collection process. For example, sentence entailment datasets can have spurious word-class correlations if nearly all contradiction…

Machine Learning · Computer Science 2020-11-10 Christopher Clark , Mark Yatskar , Luke Zettlemoyer

In this paper we study yes/no questions that are naturally occurring --- meaning that they are generated in unprompted and unconstrained settings. We build a reading comprehension dataset, BoolQ, of such questions, and show that they are…

Computation and Language · Computer Science 2019-05-27 Christopher Clark , Kenton Lee , Ming-Wei Chang , Tom Kwiatkowski , Michael Collins , Kristina Toutanova

Modern machine learning models are deployed in diverse, non-stationary environments where they must continually adapt to new tasks and evolving knowledge. Continual fine-tuning and in-context learning are costly and brittle, whereas neural…

Machine Learning · Computer Science 2026-03-04 Max S. Bennett , Thomas P. Zollo , Richard Zemel

In the constant updates of the product dialogue systems, we need to retrain the natural language understanding (NLU) model as new data from the real users would be merged into the existent data accumulated in the last updates. Within the…

Computation and Language · Computer Science 2023-05-25 Zefan Cai , Xin Zheng , Tianyu Liu , Xu Wang , Haoran Meng , Jiaqi Han , Gang Yuan , Binghuai Lin , Baobao Chang , Yunbo Cao

The use of neural language models to model human behavior has met with mixed success. While some work has found that the surprisal estimates from these models can be used to predict a wide range of human neural and behavioral responses,…

Computation and Language · Computer Science 2023-12-01 Aryaman Chobey , Oliver Smith , Anzi Wang , Grusha Prasad

In the rapidly evolving field of natural language processing, dialogue systems primarily employ a single-step dialogue paradigm. Although this paradigm is efficient, it lacks the depth and fluidity of human interactions and does not appear…

Computation and Language · Computer Science 2024-07-15 Hao Yang , Hongyuan Lu , Xinhua Zeng , Yang Liu , Xiang Zhang , Haoran Yang , Yumeng Zhang , Shan Huang , Yiran Wei , Wai Lam

In natural language understanding (NLU) production systems, users' evolving needs necessitate the addition of new features over time, indexed by new symbols added to the meaning representation space. This requires additional training data…

Computation and Language · Computer Science 2022-11-09 Elias Stengel-Eskin , Emmanouil Antonios Platanios , Adam Pauls , Sam Thomson , Hao Fang , Benjamin Van Durme , Jason Eisner , Yu Su

Despite end-to-end neural systems making significant progress in the last decade for task-oriented as well as chit-chat based dialogue systems, most dialogue systems rely on hybrid approaches which use a combination of rule-based, retrieval…

Computation and Language · Computer Science 2021-05-07 Ashish Shrivastava , Kaustubh Dhole , Abhinav Bhatt , Sharvani Raghunath

Neural network architectures with memory and attention mechanisms exhibit certain reasoning capabilities required for question answering. One such architecture, the dynamic memory network (DMN), obtained high accuracy on a variety of…

Neural and Evolutionary Computing · Computer Science 2016-03-07 Caiming Xiong , Stephen Merity , Richard Socher