English
Related papers

Related papers: New Intent Discovery with Pre-training and Contras…

200 papers

Utterance-level intent detection and token-level slot filling are two key tasks for natural language understanding (NLU) in task-oriented systems. Most existing approaches assume that only a single intent exists in an utterance. However,…

Artificial Intelligence · Computer Science 2021-08-27 Fengyu Cai , Wanhao Zhou , Fei Mi , Boi Faltings

Representation learning is an essential problem in a wide range of applications and it is important for performing downstream tasks successfully. In this paper, we propose a new model that learns coupled representations of domains, intents,…

Computation and Language · Computer Science 2018-12-18 JIhwan Lee , Dongchan Kim , Ruhi Sarikaya , Young-Bum Kim

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

In this paper, we study the few-shot multi-label classification for user intent detection. For multi-label intent detection, state-of-the-art work estimates label-instance relevance scores and uses a threshold to select multiple associated…

Computation and Language · Computer Science 2020-10-13 Yutai Hou , Yongkui Lai , Yushan Wu , Wanxiang Che , Ting Liu

In this paper, we introduce the use of Semantic Hashing as embedding for the task of Intent Classification and achieve state-of-the-art performance on three frequently used benchmarks. Intent Classification on a small dataset is a…

Partial multi-label learning aims to extract knowledge from incompletely annotated data, which includes known correct labels, known incorrect labels, and unknown labels. The core challenge lies in accurately identifying the ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xin Wu , Fei Teng , Yue Feng , Kaibo Shi , Zhuosheng Lin , Ji Zhang , James Wang

Recent advances in deep learning have significantly improved the performance of various computer vision applications. However, discovering novel categories in an incremental learning scenario remains a challenging problem due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hyungmin Kim , Sungho Suh , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

Understanding the intent behind chat between customers and customer service agents has become a crucial problem nowadays due to an exponential increase in the use of the Internet by people from different cultures and educational…

Artificial Intelligence · Computer Science 2021-09-07 Bencheng Wei

In this paper, we propose an intuitive, training-free and label-free method for intent clustering in conversational search. Current approaches to short text clustering use LLM-generated pseudo-labels to enrich text representations or to…

Computation and Language · Computer Science 2026-02-26 I-Fan Lin , Faegheh Hasibi , Suzan Verberne

Contrastive graph node clustering via learnable data augmentation is a hot research spot in the field of unsupervised graph learning. The existing methods learn the sampling distribution of a pre-defined augmentation to generate data-driven…

Machine Learning · Computer Science 2023-10-23 Xihong Yang , Cheng Tan , Yue Liu , Ke Liang , Siwei Wang , Sihang Zhou , Jun Xia , Stan Z. Li , Xinwang Liu , En Zhu

We tackle the novel class discovery problem, aiming to discover novel classes in unlabeled data based on labeled data from seen classes. The main challenge is to transfer knowledge contained in the seen classes to unseen ones. Previous…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Chuyu Zhang , Chuanyang Hu , Ruijie Xu , Zhitong Gao , Qian He , Xuming He

Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked…

Computation and Language · Computer Science 2023-09-19 Xiang Chen , Ningyu Zhang , Xin Xie , Shumin Deng , Yunzhi Yao , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Intent modelling has become an important part of modern dialogue systems. With the rapid expansion of practical dialogue systems and virtual assistants, such as Amazon Alexa, Apple Siri, and Google Assistant, the interest has only…

Computation and Language · Computer Science 2021-05-11 Sindre André Jacobsen , Anton Ragni

A key challenge for machine intelligence is to learn new visual concepts without forgetting the previously acquired knowledge. Continual learning is aimed towards addressing this challenge. However, there is a gap between existing…

Machine Learning · Computer Science 2024-02-01 Yan Luo , Yongkang Wong , Mohan Kankanhalli , Qi Zhao

Though offering amazing contextualized token-level representations, current pre-trained language models take less attention on accurately acquiring sentence-level representation during their self-supervised pre-training. However,…

Computation and Language · Computer Science 2022-10-24 Bohong Wu , Hai Zhao

Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, including intent detection…

Computation and Language · Computer Science 2024-06-03 Xuxin Cheng , Wanshi Xu , Zhihong Zhu , Hongxiang Li , Yuexian Zou

Task-oriented Dialogue Systems (TODS) often face the challenge of encountering new intents. New Intent Discovery (NID) is a crucial task that aims to identify these novel intents while maintaining the capability to recognize existing ones.…

Computation and Language · Computer Science 2025-04-01 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei