English
Related papers

Related papers: Learning Multi-Party Turn-Taking Models from Dialo…

200 papers

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and…

Computation and Language · Computer Science 2025-08-18 Zihao Yi , Jiarui Ouyang , Zhe Xu , Yuwen Liu , Tianhao Liao , Haohao Luo , Ying Shen

The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn…

Computation and Language · Computer Science 2024-11-06 Ge Bai , Jie Liu , Xingyuan Bu , Yancheng He , Jiaheng Liu , Zhanhui Zhou , Zhuoran Lin , Wenbo Su , Tiezheng Ge , Bo Zheng , Wanli Ouyang

To interpret natural language at the discourse level, it is very useful to accurately recognize dialogue acts, such as SUGGEST, in identifying speaker intentions. Our research explores the utility of a machine learning method called…

cmp-lg · Computer Science 2007-05-23 Ken Samuel , Sandra Carberry , K. Vijay-Shanker

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current…

Computation and Language · Computer Science 2023-09-21 Xinyu Zhou , Delong Chen , Yudong Chen

In neural dialogue modeling, a neural network is trained to predict the next utterance, and at inference time, an approximate decoding algorithm is used to generate next utterances given previous ones. While this autoregressive framework…

Computation and Language · Computer Science 2019-11-13 Ilia Kulikov , Jason Lee , Kyunghyun Cho

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

In this paper, we study the task of selecting the optimal response given a user and system utterance history in retrieval-based multi-turn dialog systems. Recently, pre-trained language models (e.g., BERT, RoBERTa, and ELECTRA) showed…

Computation and Language · Computer Science 2020-12-17 Taesun Whang , Dongyub Lee , Dongsuk Oh , Chanhee Lee , Kijong Han , Dong-hun Lee , Saebyeok Lee

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

Pretrained language models (PLMs) have produced substantial improvements in discourse-aware neural machine translation (NMT), for example, improved coherence in spoken language translation. However, the underlying reasons for their strong…

Computation and Language · Computer Science 2023-06-01 Zhihong Huang , Longyue Wang , Siyou Liu , Derek F. Wong

Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language…

Machine Learning · Computer Science 2023-10-31 Dhawal Gupta , Yinlam Chow , Aza Tulepbergenov , Mohammad Ghavamzadeh , Craig Boutilier

We investigate the task of modeling open-domain, multi-turn, unstructured, multi-participant, conversational dialogue. We specifically study the effect of incorporating different elements of the conversation. Unlike previous efforts, which…

Computation and Language · Computer Science 2016-06-02 Rami Al-Rfou , Marc Pickett , Javier Snaider , Yun-hsuan Sung , Brian Strope , Ray Kurzweil

Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potential mismatch between required capabilities and training…

Computation and Language · Computer Science 2025-07-09 Jing Yang Lee , Hamed Bonab , Nasser Zalmout , Ming Zeng , Sanket Lokegaonkar , Colin Lockard , Binxuan Huang , Ritesh Sarkhel , Haodong Wang

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Machine Learning (ML) models are increasingly used to make critical decisions in real-world applications, yet they have become more complex, making them harder to understand. To this end, researchers have proposed several techniques to…

Machine Learning · Computer Science 2023-03-07 Dylan Slack , Satyapriya Krishna , Himabindu Lakkaraju , Sameer Singh

In spoken dialogue, even if two current turns are the same sentence, their responses might still differ when they are spoken in different styles. The spoken styles, containing paralinguistic and prosodic information, mark the most…

Computation and Language · Computer Science 2024-05-31 Guan-Ting Lin , Cheng-Han Chiang , Hung-yi Lee

Deep learning is providing very positive results in areas related to conversational interfaces, such as speech recognition, but its potential benefit for dialog management has still not been fully studied. In this paper, we perform an…

Computation and Language · Computer Science 2021-09-01 Lukáš Matějů , David Griol , Zoraida Callejas , José Manuel Molina , Araceli Sanchis

This paper proposes a deep neural network model for joint modeling Natural Language Understanding (NLU) and Dialogue Management (DM) in goal-driven dialogue systems. There are three parts in this model. A Long Short-Term Memory (LSTM) at…

Computation and Language · Computer Science 2019-11-01 Yue Ma , Xiaojie Wang , Zhenjiang Dong , Hong Chen

Handling multi-party dialogues represents a significant step for advancing spoken dialogue systems, necessitating the development of tasks specific to multi-party interactions. To address this challenge, we are constructing a multi-modal…

Computation and Language · Computer Science 2025-03-19 Koji Inoue , Divesh Lala , Mikey Elmers , Keiko Ochi , Tatsuya Kawahara

Large Language Models (LLMs) are conversational interfaces. As such, LLMs have the potential to assist their users not only when they can fully specify the task at hand, but also to help them define, explore, and refine what they need…

Computation and Language · Computer Science 2025-05-12 Philippe Laban , Hiroaki Hayashi , Yingbo Zhou , Jennifer Neville