English
Related papers

Related papers: Improving Multi-Turn Response Selection Models wit…

200 papers

We present a multi-task learning framework to enable the training of one universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging, and utterance segmentation in a…

Computation and Language · Computer Science 2020-11-16 Morteza Rohanian , Julian Hough

Learning high quality sentence embeddings from dialogues has drawn increasing attentions as it is essential to solve a variety of dialogue-oriented tasks with low annotation cost. Annotating and gathering utterance relationships in…

Computation and Language · Computer Science 2026-04-14 Minsik Oh , Jiwei Li , Guoyin Wang

Many recent approaches to natural language tasks are built on the remarkable abilities of large language models. Large language models can perform in-context learning, where they learn a new task from a few task demonstrations, without any…

Computation and Language · Computer Science 2022-09-07 Hongjin Su , Jungo Kasai , Chen Henry Wu , Weijia Shi , Tianlu Wang , Jiayi Xin , Rui Zhang , Mari Ostendorf , Luke Zettlemoyer , Noah A. Smith , Tao Yu

Multi-turn conversation understanding is a major challenge for building intelligent dialogue systems. This work focuses on retrieval-based response matching for multi-turn conversation whose related work simply concatenates the conversation…

Computation and Language · Computer Science 2018-11-07 Zhuosheng Zhang , Jiangtong Li , Pengfei Zhu , Hai Zhao , Gongshen Liu

Constructing a robust dialogue system on spoken conversations bring more challenge than written conversation. In this respect, DSTC10-Track2-Task2 is proposed, which aims to build a task-oriented dialogue (TOD) system incorporating…

Computation and Language · Computer Science 2022-09-07 Janghoon Han , Joongbo Shin , Hosung Song , Hyunjik Jo , Gyeonghun Kim , Yireun Kim , Stanley Jungkyu Choi

Attention-based pre-trained language models such as GPT-2 brought considerable progress to end-to-end dialogue modelling. However, they also present considerable risks for task-oriented dialogue, such as lack of knowledge grounding or…

Computation and Language · Computer Science 2022-01-17 Jonáš Kulhánek , Vojtěch Hudeček , Tomáš Nekvinda , Ondřej Dušek

Conversational retrieval refers to an information retrieval system that operates in an iterative and interactive manner, requiring the retrieval of various external resources, such as persona, knowledge, and even response, to effectively…

Computation and Language · Computer Science 2024-02-29 Hongru Wang , Boyang Xue , Baohang Zhou , Rui Wang , Fei Mi , Weichao Wang , Yasheng Wang , Kam-Fai Wong

Response selection plays a vital role in building retrieval-based conversation systems. Despite that response selection is naturally a learning-to-rank problem, most prior works take a point-wise view and train binary classifiers for this…

Computation and Language · Computer Science 2020-10-14 Zibo Lin , Deng Cai , Yan Wang , Xiaojiang Liu , Hai-Tao Zheng , Shuming Shi

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption to noise. The…

Computation and Language · Computer Science 2019-11-12 Zhenhao Li , Lucia Specia

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

Computation and Language · Computer Science 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Linguistic entrainment, or alignment, represents a phenomenon where linguistic patterns employed by conversational participants converge to one another. While entrainment has been shown to produce a more natural user experience, most…

Computation and Language · Computer Science 2024-04-05 Nalin Kumar , Ondřej Dušek

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user's explicit preferences expressed in dialogue. While…

Computation and Language · Computer Science 2023-05-11 Naveen Ram , Dima Kuzmin , Ellie Ka In Chio , Moustafa Farid Alzantot , Santiago Ontanon , Ambarish Jash , Judith Yue Li

When pre-trained on large unsupervised textual corpora, language models are able to store and retrieve factual knowledge to some extent, making it possible to use them directly for zero-shot cloze-style question answering. However, storing…

Computation and Language · Computer Science 2020-05-12 Fabio Petroni , Patrick Lewis , Aleksandra Piktus , Tim Rocktäschel , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

We study multi-turn response generation for open-domain dialogues. The existing state-of-the-art addresses the problem with deep neural architectures. While these models improved response quality, their complexity also hinders the…

Computation and Language · Computer Science 2020-11-10 Yufan Zhao , Can Xu , Wei Wu , Lei Yu

Fine-tuning pretrained contextual word embedding models to supervised downstream tasks has become commonplace in natural language processing. This process, however, is often brittle: even with the same hyperparameter values, distinct random…

Computation and Language · Computer Science 2020-02-19 Jesse Dodge , Gabriel Ilharco , Roy Schwartz , Ali Farhadi , Hannaneh Hajishirzi , Noah Smith

We propose a model to tackle classification tasks in the presence of very little training data. To this aim, we approximate the notion of exact match with a theoretically sound mechanism that computes a probability of matching in the input…

For each goal-oriented dialog task of interest, large amounts of data need to be collected for end-to-end learning of a neural dialog system. Collecting that data is a costly and time-consuming process. Instead, we show that we can use only…

Computation and Language · Computer Science 2021-11-01 Janarthanan Rajendran , Jonathan K. Kummerfeld , Satinder Singh

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope