English
Related papers

Related papers: New Intent Discovery with Pre-training and Contras…

200 papers

Being able to recognize words as slots and detect the intent of an utterance has been a keen issue in natural language understanding. The existing works either treat slot filling and intent detection separately in a pipeline manner, or…

Computation and Language · Computer Science 2019-07-09 Chenwei Zhang , Yaliang Li , Nan Du , Wei Fan , Philip S. Yu

We present our work on Track 2 in the Dialog System Technology Challenges 11 (DSTC11). DSTC11-Track2 aims to provide a benchmark for zero-shot, cross-domain, intent-set induction. In the absence of in-domain training dataset, robust…

Computation and Language · Computer Science 2023-03-20 Jihyun Lee , Seungyeon Seo , Yunsu Kim , Gary Geunbae Lee

Google users have different intents from their queries such as acquiring information, buying products, comparing or simulating services, looking for products, and so on. Understanding the right intention of users helps to provide i) better…

Information Retrieval · Computer Science 2020-06-17 Samin Mohammadi , Mathieu Chapon , Arthur Fremond

The effectiveness of contrastive learning technology in natural language processing tasks is yet to be explored and analyzed. How to construct positive and negative samples correctly and reasonably is the core challenge of contrastive…

Computation and Language · Computer Science 2023-07-17 Nankai Lin , Guanqiu Qin , Jigang Wang , Aimin Yang , Dong Zhou

Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL approach to the supervised setting is not fully explored,…

Computation and Language · Computer Science 2022-05-23 Zhenyu Zhang , Yuming Zhao , Meng Chen , Xiaodong He

Intent classification is an important task in natural language understanding systems. Existing approaches have achieved perfect scores on the benchmark datasets. However they are not suitable for deployment on low-resource devices like…

Computation and Language · Computer Science 2021-01-13 Sudeep Deepak Shivnikar , Himanshu Arora , Harichandana B S S

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Ultra-fine entity typing (UFET) is the task of inferring the semantic types, from a large set of fine-grained candidates, that apply to a given entity mention. This task is especially challenging because we only have a small number of…

Computation and Language · Computer Science 2023-05-23 Na Li , Zied Bouraoui , Steven Schockaert

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

Machine Learning · Computer Science 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

A promising direction in deep learning research consists in learning representations and simultaneously discovering cluster structure in unlabeled data by optimizing a discriminative loss function. As opposed to supervised deep learning,…

Multi-task Learning (MTL) for classification with disjoint datasets aims to explore MTL when one task only has one labeled dataset. In existing methods, for each task, the unlabeled datasets are not fully exploited to facilitate this task.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yan Hong , Li Niu , Jianfu Zhang , Liqing Zhang

In self-supervised learning, a system is tasked with achieving a surrogate objective by defining alternative targets on a set of unlabeled data. The aim is to build useful representations that can be used in downstream tasks, without costly…

Machine Learning · Computer Science 2020-11-11 Massimiliano Patacchiola , Amos Storkey

Intent recognition aims to identify users' underlying intentions, traditionally focusing on text in natural language processing. With growing demands for natural human-computer interaction, the field has evolved through deep learning and…

Computation and Language · Computer Science 2025-08-01 Jingwei Zhao , Yuhua Wen , Qifei Li , Minchi Hu , Yingying Zhou , Jingyao Xue , Junyang Wu , Yingming Gao , Zhengqi Wen , Jianhua Tao , Ya Li

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

Detecting latent structure within a dataset is a crucial step in performing analysis of a dataset. However, existing state-of-the-art techniques for subclass discovery are limited: either they are limited to detecting very small numbers of…

Machine Learning · Computer Science 2021-11-09 Patrick Kage , Pavlos Andreadis

Previous approaches to the task of implicit discourse relation recognition (IDRR) generally view it as a classification task. Even with pre-trained language models, like BERT and RoBERTa, IDRR still relies on complicated neural networks…

Computation and Language · Computer Science 2024-09-24 Yiheng Wu , Junhui Li , Muhua Zhu

Existing deep learning models have achieved promising performance in recognizing skin diseases from dermoscopic images. However, these models can only recognize samples from predefined categories, when they are deployed in the clinic, data…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Wei Feng , Lie Ju , Lin Wang , Kaimin Song , Zongyuan Ge

In task-oriented dialogue systems, intent detection is crucial for interpreting user queries and providing appropriate responses. Existing research primarily addresses simple queries with a single intent, lacking effective systems for…

Computation and Language · Computer Science 2024-10-31 Ankan Mullick , Sombit Bose , Abhilash Nandy , Gajula Sai Chaitanya , Pawan Goyal

Conversational systems often rely on embedding models for intent classification and intent clustering tasks. The advent of Large Language Models (LLMs), which enable instructional embeddings allowing one to adjust semantics over the…

Computation and Language · Computer Science 2024-03-08 Yuwei Zhang , Siffi Singh , Sailik Sengupta , Igor Shalyminov , Hang Su , Hwanjun Song , Saab Mansour