English
Related papers

Related papers: End-to-end Conversation Modeling Track in DSTC6

200 papers

End-to-end (E2E) systems are fast replacing the conventional systems in the domain of automatic speech recognition. As the target labels are learned directly from speech data, the E2E systems need a bigger corpus for effective training. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-22 Kunal Dhawan , Ganji Sreeram , Kumar Priyadarshi , Rohit Sinha

Dialogue systems (DS), including the task-oriented dialogue system (TOD) and the open-domain dialogue system (ODD), have always been a fundamental task in natural language processing (NLP), allowing various applications in practice. Owing…

Computation and Language · Computer Science 2025-07-22 Hongru Wang , Lingzhi Wang , Yiming Du , Liang Chen , Jingyan Zhou , Yufei Wang , Kam-Fai Wong

Co-speech gestures enhance interaction experiences between humans as well as between humans and robots. Existing robots use rule-based speech-gesture association, but this requires human labor and prior knowledge of experts to be…

Robotics · Computer Science 2018-10-31 Youngwoo Yoon , Woo-Ri Ko , Minsu Jang , Jaeyeon Lee , Jaehong Kim , Geehyuk Lee

We explore end-to-end trained differentiable models that integrate natural logic with neural networks, aiming to keep the backbone of natural language reasoning based on the natural logic formalism while introducing subsymbolic vector…

Computation and Language · Computer Science 2020-11-11 Yufei Feng , Zi'ou Zheng , Quan Liu , Michael Greenspan , Xiaodan Zhu

Dialogue system (DS) attracts great attention from industry and academia because of its wide application prospects. Researchers usually divide the DS according to the function. However, many conversations require the DS to switch between…

Computation and Language · Computer Science 2020-04-30 Longxuan Ma , Wei-Nan Zhang , Mingda Li , Ting Liu

Ubuntu dialogue corpus is the largest public available dialogue corpus to make it feasible to build end-to-end deep neural network models directly from the conversation data. One challenge of Ubuntu dialogue corpus is the large number of…

Computation and Language · Computer Science 2018-05-08 Jianxiong Dong , Jim Huang

We study a symmetric collaborative dialogue setting in which two agents, each with private knowledge, must strategically communicate to achieve a common goal. The open-ended dialogue state in this setting poses new challenges for existing…

Computation and Language · Computer Science 2017-04-25 He He , Anusha Balakrishnan , Mihail Eric , Percy Liang

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI. Unlike traditional…

Computation and Language · Computer Science 2020-03-02 Minlie Huang , Xiaoyan Zhu , Jianfeng Gao

End-to-end (E2E) spoken dialogue systems are increasingly replacing cascaded pipelines for voice-based human-AI interaction, processing raw audio directly without intermediate transcription. Existing benchmarks primarily evaluate these…

Non-task oriented dialogue systems have achieved great success in recent years due to largely accessible conversation data and the development of deep learning techniques. Given a context, current systems are able to yield a relevant and…

Computation and Language · Computer Science 2020-04-10 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang , Ming Zhou

Automated negotiation support systems aim to help human negotiators reach more favorable outcomes in multi-issue negotiations (e.g., an employer and a candidate negotiating over issues such as salary, hours, and promotions before a job…

Computation and Language · Computer Science 2023-07-14 Amogh Mannekote , Bonnie J. Dorr , Kristy Elizabeth Boyer

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Dialogue-based human-AI collaboration can revolutionize collaborative problem-solving, creative exploration, and social support. To realize this goal, the development of automated agents proficient in skills such as negotiating, following…

Computation and Language · Computer Science 2023-07-19 Amogh Mannekote

Task-oriented dialog (TOD) systems typically manage structured knowledge (e.g. ontologies and databases) to guide the goal-oriented conversations. However, they fall short of handling dialog turns grounded on unstructured knowledge (e.g.…

Computation and Language · Computer Science 2021-06-03 Silin Gao , Ryuichi Takanobu , Wei Peng , Qun Liu , Minlie Huang

Intent recognition is critical for task-oriented dialogue systems. However, for emerging domains and new services, it is difficult to accurately identify the key intent of a conversation due to time-consuming data annotation and…

Computation and Language · Computer Science 2023-03-10 Caiyuan Chu , Ya Li , Yifan Liu , Jia-Chen Gu , Quan Liu , Yongxin Ge , Guoping Hu

End-to-end task-oriented dialogue (TOD) systems have achieved promising performance by leveraging sophisticated natural language understanding and natural language generation capabilities of pre-trained models. This work enables the TOD…

Computation and Language · Computer Science 2023-08-17 Jianguo Zhang , Stephen Roller , Kun Qian , Zhiwei Liu , Rui Meng , Shelby Heinecke , Huan Wang , Silvio Savarese , Caiming Xiong

End-to-end Task-oriented Dialogue Systems (TDSs) have attracted a lot of attention for their superiority (e.g., in terms of global optimization) over pipeline modularized TDSs. Previous studies on end-to-end TDSs use a single-module model…

Computation and Language · Computer Science 2019-07-12 Jiahuan Pei , Pengjie Ren , Maarten de Rijke

Conversational recommender systems aim to provide personalized recommendations by analyzing and utilizing contextual information related to dialogue. However, existing methods typically model the dialogue context as a whole, neglecting the…

Information Retrieval · Computer Science 2025-04-25 Guojia An , Jie Zou , Jiwei Wei , Chaoning Zhang , Fuming Sun , Yang Yang

Building speech recognizers in multiple languages typically involves replicating a monolingual training recipe for each language, or utilizing a multi-task learning approach where models for different languages have separate output labels…

Computation and Language · Computer Science 2017-11-08 Suyoun Kim , Michael L. Seltzer

Full-duplex interaction, where speakers and listeners converse simultaneously, is a key element of human communication often missing from traditional spoken dialogue systems. These systems, based on rigid turn-taking paradigms, struggle to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Chengyou Wang , Hongfei Xue , Guojian Li , Zhixian Zhao , Shuiyuan Wang , Shuai Wang , Xin Xu , Hui Bu , Lei Xie