English
Related papers

Related papers: Self-Training with Purpose Preserving Augmentation…

200 papers

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots. Many approaches have been proposed, often using task-specific architectures…

Computation and Language · Computer Science 2021-09-17 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Computation and Language · Computer Science 2025-09-30 Hyundong Cho , Andrea Madotto , Zhaojiang Lin , Khyathi Raghavi Chandu , Satwik Kottur , Jing Xu , Jonathan May , Chinnadhurai Sankar

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domains, draws attention…

Computation and Language · Computer Science 2023-02-28 Ruolin Su , Jingfeng Yang , Ting-Wei Wu , Biing-Hwang Juang

Person re-identification (Re-ID) has achieved great improvement with deep learning and a large amount of labelled training data. However, it remains a challenging task for adapting a model trained in a source domain of labelled data to a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Xinyu Zhang , Jiewei Cao , Chunhua Shen , Mingyu You

Zero-shot transfer learning for multi-domain dialogue state tracking can allow us to handle new domains without incurring the high cost of data acquisition. This paper proposes new zero-short transfer learning technique for dialogue state…

Computation and Language · Computer Science 2020-05-05 Giovanni Campagna , Agata Foryciarz , Mehrad Moradshahi , Monica S. Lam

Language model pre-training has proven to be useful in many language understanding tasks. In this paper, we investigate whether it is still helpful to add the self-training method in the pre-training step and the fine-tuning step. Towards…

Computation and Language · Computer Science 2023-02-17 Tong Guo

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

Computation and Language · Computer Science 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

Dialogue systems need to produce responses that realize multiple types of dialogue acts (DAs) with high semantic fidelity. In the past, natural language generators (NLGs) for dialogue were trained on large parallel corpora that map from a…

Computation and Language · Computer Science 2023-07-28 Angela Ramirez , Karik Agarwal , Juraj Juraska , Utkarsh Garg , Marilyn A. Walker

As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or…

Computation and Language · Computer Science 2020-02-28 Baolin Peng , Chenguang Zhu , Chunyuan Li , Xiujun Li , Jinchao Li , Michael Zeng , Jianfeng Gao

Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on sufficient labeled…

Computation and Language · Computer Science 2023-03-24 Canyu Chen , Kai Shu

Zero-shot transfer learning for Dialogue State Tracking (DST) helps to handle a variety of task-oriented dialogue domains without the cost of collecting in-domain data. Existing works mainly study common data- or model-level augmentation…

Computation and Language · Computer Science 2023-06-02 Qingyue Wang , Liang Ding , Yanan Cao , Yibing Zhan , Zheng Lin , Shi Wang , Dacheng Tao , Li Guo

We present a new method LiST is short for Lite Prompted Self-Training for parameter-efficient fine-tuning of large pre-trained language models (PLMs) for few-shot learning. LiST improves over recent methods that adopt prompt-based…

Computation and Language · Computer Science 2022-05-20 Yaqing Wang , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Semi-supervised learning provides a solution to reduce the dependency of machine learning on labeled data. As one of the efficient semi-supervised techniques, self-training (ST) has received increasing attention. Several advancements have…

Machine Learning · Computer Science 2024-04-22 Jifeng Guo , Zhulin Liu , Tong Zhang , C. L. Philip Chen

The field of few-shot learning has been laboriously explored in the supervised setting, where per-class labels are available. On the other hand, the unsupervised few-shot learning setting, where no labels of any kind are required, has seen…

Machine Learning · Statistics 2019-03-07 Antreas Antoniou , Amos Storkey

Few-shot dialogue state tracking (DST) with Large Language Models (LLM) relies on an effective and efficient conversation retriever to find similar in-context examples for prompt learning. Previous works use raw dialogue context as search…

Computation and Language · Computer Science 2024-04-04 Seanie Lee , Jianpeng Cheng , Joris Driesen , Alexandru Coca , Anders Johannsen

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Zero-shot dialogue state tracking (DST) transfers knowledge to unseen domains, reducing the cost of annotating new datasets. Previous zero-shot DST models mainly suffer from domain transferring and partial prediction problems. To address…

Computation and Language · Computer Science 2024-04-15 Tianwen Tang , Tong Zhu , Haodong Liu , Yin Bai , Jia Cheng , Wenliang Chen

Few-shot learning is challenging due to its very limited data and labels. Recent studies in big transfer (BiT) show that few-shot learning can greatly benefit from pretraining on large scale labeled dataset in a different domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Nenghai Yu

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer