English
Related papers

Related papers: A Three-Stage Learning Framework for Low-Resource …

200 papers

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

Knowledge graph-based dialogue systems are capable of generating more informative responses and can implement sophisticated reasoning mechanisms. However, these models do not take into account the sparseness and incompleteness of knowledge…

Computation and Language · Computer Science 2020-04-21 Hongcai Xu , Junpeng Bao , Gaojie Zhang

Task-oriented dialogue generation is challenging since the underlying knowledge is often dynamic and effectively incorporating knowledge into the learning process is hard. It is particularly challenging to generate both human-like and…

Computation and Language · Computer Science 2022-04-21 Md Rashad Al Hasan Rony , Ricardo Usbeck , Jens Lehmann

Knowledge-aided dialogue response generation aims at augmenting chatbots with relevant external knowledge in the hope of generating more informative responses. The majority of previous work assumes that the relevant knowledge is given as…

Computation and Language · Computer Science 2023-02-21 Ante Wang , Linfeng Song , Qi Liu , Haitao Mi , Longyue Wang , Zhaopeng Tu , Jinsong Su , Dong Yu

Modeling human conversations is the essence for building satisfying chat-bots with multi-turn dialog ability. Conversation modeling will notably benefit from domain knowledge since the relationships between sentences can be clarified due to…

Computation and Language · Computer Science 2017-02-07 Zhen Xu , Bingquan Liu , Baoxun Wang , Chengjie Sun , Xiaolong Wang

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Knowledge-enhanced text generation aims to enhance the quality of generated text by utilizing internal or external knowledge sources. While language models have demonstrated impressive capabilities in generating coherent and fluent text,…

Computation and Language · Computer Science 2026-01-15 Shuqi Liu , Han Wu , Guanzhi Deng , Jianshu Chen , Xiaoyang Wang , Linqi Song

End-to-end dialogue generation has achieved promising results without using handcrafted features and attributes specific for each task and corpus. However, one of the fatal drawbacks in such approaches is that they are unable to generate…

Computation and Language · Computer Science 2019-03-26 Hao-Tong Ye , Kai-Ling Lo , Shang-Yu Su , Yun-Nung Chen

Speech encodes a wealth of information related to human behavior and has been used in a variety of automated behavior recognition tasks. However, extracting behavioral information from speech remains challenging including due to inadequate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-09 Haoqi Li , Brian Baucom , Shrikanth Narayanan , Panayiotis Georgiou

Incorporating conversational context and knowledge into dialogue generation models has been essential for improving the quality of the generated responses. The context, comprising utterances from previous dialogue exchanges, is used as a…

Computation and Language · Computer Science 2023-05-30 Wen Zheng , Natasa Milic-Frayling , Ke Zhou

Knowledge-grounded dialogue generation aims to mitigate the issue of text degeneration by incorporating external knowledge to supplement the context. However, the model often fails to internalize this information into responses in a…

Computation and Language · Computer Science 2023-10-18 Chenxu Yang , Zheng Lin , Lanrui Wang , Chong Tian , Liang Pang , Jiangnan Li , Qirong Ho , Yanan Cao , Weiping Wang

This paper summarizes our submission to Task 2 of the second track of the 10th Dialog System Technology Challenge (DSTC10) "Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations". Similar to the previous year's…

Computation and Language · Computer Science 2021-12-17 David Thulke , Nico Daheim , Christian Dugast , Hermann Ney

Although neural conversation models are effective in learning how to produce fluent responses, their primary challenge lies in knowing what to say to make the conversation contentful and non-vacuous. We present a new end-to-end approach to…

Computation and Language · Computer Science 2019-06-10 Lianhui Qin , Michel Galley , Chris Brockett , Xiaodong Liu , Xiang Gao , Bill Dolan , Yejin Choi , Jianfeng Gao

Training a personalized dialogue system requires a lot of data, and the data collected for a single user is usually insufficient. One common practice for this problem is to share training dialogues between different users and train multiple…

Computation and Language · Computer Science 2017-11-15 Kaixiang Mo , Yu Zhang , Qiang Yang , Pascale Fung

Transformer encoder-decoder models have achieved great performance in dialogue generation tasks, however, their inability to process long dialogue history often leads to truncation of the context To address this problem, we propose a novel…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Zhou Yu

A common practice in knowledge-grounded dialogue generation is to explicitly utilize intermediate steps (e.g., web-search, memory retrieval) with modular approaches. However, data for such steps are often inaccessible compared to those of…

Computation and Language · Computer Science 2024-10-28 Daejin Jo , Daniel Wontae Nam , Gunsoo Han , Kyoung-Woon On , Taehwan Kwon , Seungeun Rho , Sungwoong Kim

Grounding dialogue system with external knowledge is a promising way to improve the quality of responses. Most existing works adopt knowledge graphs (KGs) as the external resources, paying attention to the contribution of entities in the…

Computation and Language · Computer Science 2022-07-19 Kexin Wang , Zhixu Li , Jiaan Wang , Jianfeng Qu , Ying He , An Liu , Lei Zhao

Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be adapted to meet this…

Computation and Language · Computer Science 2019-10-04 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Currently end-to-end deep learning based open-domain dialogue systems remain black box models, making it easy to generate irrelevant contents with data-driven models. Specifically, latent variables are highly entangled with different…

Computation and Language · Computer Science 2022-07-27 Ye Wang , Jingbo Liao , Hong Yu , Guoyin Wang , Xiaoxia Zhang , Li Liu