English
Related papers

Related papers: Domain Adaptation in Dialogue Systems using Transf…

200 papers

Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model…

Computation and Language · Computer Science 2025-02-24 Christopher Richardson , Roshan Sharma , Neeraj Gaur , Parisa Haghani , Anirudh Sundar , Bhuvana Ramabhadran

There has been a rapid development in data-driven task-oriented dialogue systems with the benefit of large-scale datasets. However, the progress of dialogue systems in low-resource languages lags far behind due to the lack of high-quality…

Computation and Language · Computer Science 2021-01-28 Yen-Ting Lin , Yun-Nung Chen

As a study on the efficient usage of data, Multi-source Unsupervised Domain Adaptation transfers knowledge from multiple source domains with labeled data to an unlabeled target domain. However, the distribution discrepancy between different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Tong Xu , Lin Wang , Wu Ning , Chunyan Lyu , Kejun Wang , Chenhui Wang

With the rapid increase in the volume of dialogue data from daily life, there is a growing demand for dialogue summarization. Unfortunately, training a large summarization model is generally infeasible due to the inadequacy of dialogue data…

Computation and Language · Computer Science 2021-09-14 Yicheng Zou , Bolin Zhu , Xingwu Hu , Tao Gui , Qi Zhang

This work connects language model adaptation with concepts of machine learning theory. We consider a training setup with a large out-of-domain set and a small in-domain set. We derive how the benefit of training a model on either set…

Computation and Language · Computer Science 2022-03-23 David Grangier , Dan Iter

In this paper, we provide a new neural-network based perspective on multi-task learning (MTL) and multi-domain learning (MDL). By introducing the concept of a semantic descriptor, this framework unifies MDL and MTL as well as encompassing…

Machine Learning · Statistics 2015-03-27 Yongxin Yang , Timothy M. Hospedales

Utilizing Large Language Models (LLMs) facilitates the creation of flexible and natural dialogues, a task that has been challenging with traditional rule-based dialogue systems. However, LLMs also have the potential to produce unexpected…

Domain Adaptation arises when we aim at learning from source domain a model that can per- form acceptably well on a different target domain. It is especially crucial for Natural Language Generation (NLG) in Spoken Dialogue Systems when…

Computation and Language · Computer Science 2018-08-09 Van-Khanh Tran , Le-Minh Nguyen

We study a new highly-practical problem setting that enables resource-constrained edge devices to adapt a pre-trained model to their local data distributions. Recognizing that device's data are likely to come from multiple latent domains…

Machine Learning · Computer Science 2024-02-02 Ondrej Bohdal , Da Li , Shell Xu Hu , Timothy Hospedales

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung

Dialogue structure discovery is essential in dialogue generation. Well-structured topic flow can leverage background information and predict future topics to help generate controllable and explainable responses. However, most previous work…

Computation and Language · Computer Science 2023-03-03 Congchi Yin , Piji Li , Zhaochun Ren

State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods are needed. In this…

Computation and Language · Computer Science 2020-06-09 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Adapting general multimodal large language models (MLLMs) to specific domains, such as scientific and industrial fields, is highly significant in promoting their practical applications. This paper systematically investigates domain…

Computation and Language · Computer Science 2025-08-28 Daixuan Cheng , Shaohan Huang , Ziyu Zhu , Xintong Zhang , Wayne Xin Zhao , Zhongzhi Luan , Bo Dai , Zhenliang Zhang

Building an end-to-end conversational agent for multi-domain task-oriented dialogues has been an open challenge for two main reasons. First, tracking dialogue states of multiple domains is non-trivial as the dialogue agent must obtain…

Computation and Language · Computer Science 2020-11-17 Hung Le , Doyen Sahoo , Chenghao Liu , Nancy F. Chen , Steven C. H. Hoi

Task-oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns.…

Computation and Language · Computer Science 2021-03-12 Hyunmin Jeon , Gary Geunbae Lee

Robust dialogue belief tracking is a key component in maintaining good quality dialogue systems. The tasks that dialogue systems are trying to solve are becoming increasingly complex, requiring scalability to multi domain, semantically rich…

Computation and Language · Computer Science 2018-07-18 Osman Ramadan , Paweł Budzianowski , Milica Gašić

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to…

Machine Learning · Computer Science 2021-07-26 Pinzhuo Tian , Yao Gao