English
Related papers

Related papers: A Student-Teacher Architecture for Dialog Domain A…

200 papers

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

Machine Learning · Computer Science 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong

When there is a mismatch between the training and test domains, current speech recognition systems show significant performance degradation. Self-training methods, such as noisy student teacher training, can help address this and enable the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Robert Flynn , Anton Ragni

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Autoregressive models used to generate responses in open-domain dialogue systems often struggle to take long-term context into account and to maintain consistency over a dialogue. Previous research in open-domain dialogue generation has…

Computation and Language · Computer Science 2023-04-18 Mehrdad Farahani , Richard Johansson

We address the task of domain adaptation in object detection, where there is a domain gap between a domain with annotations (source) and a domain of interest without annotations (target). As an effective semi-supervised learning method, the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Yu-Jhe Li , Xiaoliang Dai , Chih-Yao Ma , Yen-Cheng Liu , Kan Chen , Bichen Wu , Zijian He , Kris Kitani , Peter Vajda

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

Domain adaptation has recently become a key problem in dialogue systems research. Deep learning, while being the preferred technique for modeling such systems, works best given massive training data. However, in the real-world scenario,…

Computation and Language · Computer Science 2020-03-09 Igor Shalyminov , Alessandro Sordoni , Adam Atkinson , Hannes Schulz

Despite the tremendous success of neural dialogue models in recent years, it suffers a lack of relevance, diversity, and some times coherence in generated responses. Lately, transformer-based models, such as GPT-2, have revolutionized the…

Computation and Language · Computer Science 2020-10-13 Debanjana Kar , Suranjana Samanta , Amar Prakash Azad

Learning task-oriented dialog policies via reinforcement learning typically requires large amounts of interaction with users, which in practice renders such methods unusable for real-world applications. In order to reduce the data…

Computation and Language · Computer Science 2022-07-04 Jorge A. Mendez , Alborz Geramifard , Mohammad Ghavamzadeh , Bing Liu

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Language models like BERT and SpanBERT pretrained on open-domain data have obtained impressive gains on various NLP tasks. In this paper, we probe the effectiveness of domain-adaptive pretraining objectives on downstream tasks. In…

Computation and Language · Computer Science 2021-05-31 Han Wu , Kun Xu , Linfeng Song , Lifeng Jin , Haisong Zhang , Linqi Song

In-context system identification aims at constructing meta-models to describe classes of systems, differently from traditional approaches that model single systems. This paradigm facilitates the leveraging of knowledge acquired from…

Machine Learning · Computer Science 2023-12-08 Dario Piga , Filippo Pura , Marco Forgione

In recent years, deep learning-based methods have shown promising results in computer vision area. However, a common deep learning model requires a large amount of labeled data, which is labor-intensive to collect and label. What's more,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shuhao Qiu , Chuang Zhu , Wenli Zhou

As educational settings increasingly integrate artificial intelligence (AI), understanding how AI tools identify -- and adapt their responses to -- varied educational contexts becomes paramount. This study examines conversational AI's…

Human-Computer Interaction · Computer Science 2025-03-06 Alex Liu , Lief Esbenshade , Min Sun , Shawon Sarkar , Jian He , Victor Tian , Zachary Zhang

Domain adaptation allows generative language models to address specific flaws caused by the domain shift of their application. However, the traditional adaptation by further training on in-domain data rapidly weakens the model's ability to…

Computation and Language · Computer Science 2023-05-29 Michal Štefánik , Marek Kadlčík , Petr Sojka

Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation of task-oriented…

Computation and Language · Computer Science 2019-11-12 Zihan Liu , Jamin Shin , Yan Xu , Genta Indra Winata , Peng Xu , Andrea Madotto , Pascale Fung

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

Mental models play an important role in whether user interaction with intelligent systems, such as dialog systems is successful or not. Adaptive dialog systems present the opportunity to align a dialog agent's behavior with heterogeneous…

Computation and Language · Computer Science 2024-08-27 Lindsey Vanderlyn , Dirk Väth , Ngoc Thang Vu