English
Related papers

Related papers: Intent-calibrated Self-training for Answer Selecti…

200 papers

Deep neural networks achieve remarkable performances on a wide range of tasks with the aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor-exhaustive to obtain on realistic tasks. To mitigate the requirement…

Machine Learning · Computer Science 2022-11-10 Baixu Chen , Junguang Jiang , Ximei Wang , Pengfei Wan , Jianmin Wang , Mingsheng Long

Voice-controlled dialog systems have become immensely popular due to their ability to perform a wide range of actions in response to diverse user queries. These agents possess a predefined set of skills or intents to fulfill specific user…

Computation and Language · Computer Science 2026-03-17 Ankan Mullick , Sukannya Purkayastha , Saransh Sharma , Pawan Goyal , Niloy Ganguly

Detecting and identifying user intent from text, both written and spoken, plays an important role in modelling and understand dialogs. Existing research for intent discovery model it as a classification task with a predefined set of known…

Information Retrieval · Computer Science 2019-04-19 Nikhita Vedula , Nedim Lipka , Pranav Maneriker , Srinivasan Parthasarathy

This paper investigates the effectiveness of pre-training for few-shot intent classification. While existing paradigms commonly further pre-train language models such as BERT on a vast amount of unlabeled corpus, we find it highly effective…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Yuwei Zhang , Li-Ming Zhan , Jiaxin Chen , Guangyuan Shi , Albert Y. S. Lam , Xiao-Ming Wu

Self-training methods have been explored in recent years and have exhibited great performance in improving semi-supervised learning. This work presents a Simple instance-Adaptive self-Training method (SAT) for semi-supervised text…

Computation and Language · Computer Science 2022-10-25 Hui Chen , Wei Han , Soujanya Poria

Self-training emerges as an important research line on domain adaptation. By taking the model's prediction as the pseudo labels of the unlabeled data, self-training bootstraps the model with pseudo instances in the target domain. However,…

Machine Learning · Computer Science 2023-08-08 Menglong Lu , Zhen Huang , Yunxiang Zhao , Zhiliang Tian , Yang Liu , Dongsheng Li

Out-of-Domain (OOD) intent detection is important for practical dialog systems. To alleviate the issue of lacking OOD training samples, some works propose synthesizing pseudo OOD samples and directly assigning one-hot OOD labels to these…

Computation and Language · Computer Science 2022-11-11 Hao Lang , Yinhe Zheng , Jian Sun , Fei Huang , Luo Si , Yongbin Li

Novel intent discovery automates the process of grouping similar messages (questions) to identify previously unknown intents. However, current research focuses on publicly available datasets which have only the question field and…

Computation and Language · Computer Science 2023-05-10 Aleksandra Chrabrowa , Tsimur Hadeliya , Dariusz Kajtoch , Robert Mroczkowski , Piotr Rybak

Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often one of the key steps.…

Computation and Language · Computer Science 2024-10-22 Mrinal Rawat , Hithesh Sankararaman , Victor Barres

Unsupervised pre-training has led to much recent progress in natural language understanding. In this paper, we study self-training as another way to leverage unlabeled data through semi-supervised learning. To obtain additional data for a…

Computation and Language · Computer Science 2020-10-06 Jingfei Du , Edouard Grave , Beliz Gunel , Vishrav Chaudhary , Onur Celebi , Michael Auli , Ves Stoyanov , Alexis Conneau

Identifying breakdowns in ongoing dialogues helps to improve communication effectiveness. Most prior work on this topic relies on human annotated data and data augmentation to learn a classification model. While quality labeled dialogue…

Computation and Language · Computer Science 2022-04-20 Qian Lin , Hwee Tou Ng

Large language models (LLMs) are able to solve various tasks with only a few demonstrations utilizing their in-context learning (ICL) abilities. However, LLMs often rely on their pre-trained semantic priors of demonstrations rather than on…

Computation and Language · Computer Science 2024-04-16 Joonwon Jang , Sanghwan Jang , Wonbin Kweon , Minjin Jeon , Hwanjo Yu

Semi-supervised learning provides a solution to reduce the dependency of machine learning on labeled data. As one of the efficient semi-supervised techniques, self-training (ST) has received increasing attention. Several advancements have…

Machine Learning · Computer Science 2024-04-22 Jifeng Guo , Zhulin Liu , Tong Zhang , C. L. Philip Chen

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stages. They either…

Computation and Language · Computer Science 2024-10-29 Yimin Deng , Yuxia Wu , Guoshuai Zhao , Li Zhu , Xueming Qian

We present SelfPrompt, a novel prompt-tuning approach for vision-language models (VLMs) in a semi-supervised learning setup. Existing methods for tuning VLMs in semi-supervised setups struggle with the negative impact of the miscalibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Shuvendu Roy , Ali Etemad

Task-oriented dialog(TOD) aims to assist users in achieving specific goals through multi-turn conversation. Recently, good results have been obtained based on large pre-trained models. However, the labeled-data scarcity hinders the…

Computation and Language · Computer Science 2022-12-26 Zhitong Yang , Xing Ma , Anqi Liu , Zheyu Zhang

Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant data, annotating the data with intents and entities, and…

Computation and Language · Computer Science 2021-05-13 Saurav Sahay , Eda Okur , Nagib Hakim , Lama Nachman

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

Computation and Language · Computer Science 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

Conversational systems are of primary interest in the AI community. Chatbots are increasingly being deployed to provide round-the-clock support and to increase customer engagement. Many of the commercial bot building frameworks follow a…

Computation and Language · Computer Science 2021-01-19 Ajay Chatterjee , Shubhashis Sengupta

Intent classification (IC) plays an important role in task-oriented dialogue systems. However, IC models often generalize poorly when training without sufficient annotated examples for each user intent. We propose a novel pre-training…

Computation and Language · Computer Science 2023-11-15 Mujeen Sung , James Gung , Elman Mansimov , Nikolaos Pappas , Raphael Shu , Salvatore Romeo , Yi Zhang , Vittorio Castelli