English
Related papers

Related papers: Domain Adaptation in Dialogue Systems using Transf…

200 papers

We propose a method for zero-resource domain adaptation of DNN acoustic models, for use in low-resource situations where the only in-language training data available may be poorly matched to the intended target domain. Our method uses a…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Alberto Abad , Peter Bell , Andrea Carmantini , Steve Renals

Building systems that can communicate with humans is a core problem in Artificial Intelligence. This work proposes a novel neural network architecture for response selection in an end-to-end multi-turn conversational dialogue setting. The…

Artificial Intelligence · Computer Science 2018-11-06 Debanjan Chaudhuri , Agustinus Kristiadi , Jens Lehmann , Asja Fischer

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

Reusing pre-collected data from different domains is an appealing solution for decision-making tasks, especially when data in the target domain are limited. Existing cross-domain policy transfer methods mostly aim at learning domain…

Robotics · Computer Science 2026-03-10 Haoyi Niu , Qimao Chen , Tenglong Liu , Jianxiong Li , Guyue Zhou , Yi Zhang , Jianming Hu , Xianyuan Zhan

We introduce a new approach to generative data-driven dialogue systems (e.g. chatbots) called TransferTransfo which is a combination of a Transfer learning based training scheme and a high-capacity Transformer model. Fine-tuning is…

Computation and Language · Computer Science 2019-02-05 Thomas Wolf , Victor Sanh , Julien Chaumond , Clement Delangue

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Recently, pre-trained contextual models, such as BERT, have shown to perform well in language related tasks. We revisit the design decisions that govern the applicability of these models for the passage re-ranking task in open-domain…

Information Retrieval · Computer Science 2021-08-31 Jurek Leonhardt , Fabian Beringer , Avishek Anand

Goal-Oriented (GO) Dialogue Systems, colloquially known as goal oriented chatbots, help users achieve a predefined goal (e.g. book a movie ticket) within a closed domain. A first step is to understand the user's goal by using natural…

Computation and Language · Computer Science 2018-07-26 Vladimir Ilievski , Claudiu Musat , Andreea Hossmann , Michael Baeriswyl

Negative transfer in training of acoustic models for automatic speech recognition has been reported in several contexts such as domain change or speaker characteristics. This paper proposes a novel technique to overcome negative transfer by…

Machine Learning · Computer Science 2015-09-18 Mortaza Doulaty , Oscar Saz , Thomas Hain

Fine-tuning a language model on a new domain is standard practice for domain adaptation. However, it can be infeasible when it comes to modern large-scale language models such as GPT-3, which can only be accessed through APIs, making it…

Computation and Language · Computer Science 2023-02-22 Yangsibo Huang , Daogao Liu , Zexuan Zhong , Weijia Shi , Yin Tat Lee

It is difficult to train a personalized task-oriented dialogue system because the data collected from each individual is often insufficient. Personalized dialogue systems trained on a small dataset can overfit and make it difficult to adapt…

Artificial Intelligence · Computer Science 2017-05-29 Kaixiang Mo , Shuangyin Li , Yu Zhang , Jiajun Li , Qiang Yang

Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users. This phenomenon might mainly result from the…

Computation and Language · Computer Science 2022-08-31 Hua Lu , Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Domain adaptation is critical for learning in new and unseen environments. With domain adversarial training, deep networks can learn disentangled and transferable features that effectively diminish the dataset shift between the source and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhangjie Cao , Kaichao You , Mingsheng Long , Jianmin Wang , Qiang Yang

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

This study addresses the interaction challenges encountered by spoken dialogue systems (SDSs) when engaging with users who exhibit distinct conversational behaviors, particularly minors, in scenarios where data are scarce. We propose a…

Computation and Language · Computer Science 2024-08-21 Zhiyang Qi , Michimasa Inaba

Spoken language understanding has been addressed as a supervised learning problem, where a set of training data is available for each domain. However, annotating data for each domain is both financially costly and non-scalable so we should…

Computation and Language · Computer Science 2021-11-30 Libo Qin , Minheng Ni , Yue Zhang , Wanxiang Che , Yangming Li , Ting Liu

Conversational User Interface (CUI) has become ubiquitous in everyday life, in consumer-focused products like Siri and Alexa or business-oriented solutions. Deep learning underlies many recent breakthroughs in dialogue systems but requires…

Computation and Language · Computer Science 2020-12-08 Igor Shalyminov

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2024-01-29 Yasmin Moslem

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang