English
Related papers

Related papers: An Explicit-Joint and Supervised-Contrastive Learn…

200 papers

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current…

Computation and Language · Computer Science 2022-10-10 Feifan Song , Lianzhe Huang , Houfeng Wang

Intent detection is a crucial component of modern conversational systems, since accurately identifying user intent at the beginning of a conversation is essential for generating effective responses. Recent efforts have focused on studying…

Computation and Language · Computer Science 2025-09-09 Liang Zhang , Yuan Li , Shijie Zhang , Zheng Zhang , Xitong Li

Intent detection (ID) and Slot filling (SF) are two major tasks in spoken language understanding (SLU). Recently, attention mechanism has been shown to be effective in jointly optimizing these two tasks in an interactive manner. However,…

Computation and Language · Computer Science 2021-09-23 Dongsheng Chen , Zhiqi Huang , Xian Wu , Shen Ge , Yuexian Zou

Spoken intent detection has become a popular approach to interface with various smart devices with ease. However, such systems are limited to the preset list of intents-terms or commands, which restricts the quick customization of personal…

Computation and Language · Computer Science 2021-06-30 Ashish Mittal , Samarth Bharadwaj , Shreya Khare , Saneem Chemmengath , Karthik Sankaranarayanan , Brian Kingsbury

Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples in support images. Most of advanced solutions exploit a metric learning framework that performs segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

We address the problem of few-shot semantic segmentation (FSS), which aims to segment novel class objects in a target image with a few annotated samples. Though recent advances have been made by incorporating prototype-based metric…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Hyeongjun Kwon , Somi Jeong , Sunok Kim , Kwanghoon Sohn

Few-Shot Class Incremental Learning (FSCIL) is crucial for adapting to the complex open-world environments. Contemporary prospective learning-based space construction methods struggle to balance old and new knowledge, as prototype bias and…

Machine Learning · Computer Science 2026-03-03 Qinzhe Wang , Zixuan Chen , Keke Huang , Xiu Su , Chunhua Yang , Chang Xu

Intent detection and slot filling are important tasks in spoken and natural language understanding. However, Vietnamese is a low-resource language in these research topics. In this paper, we present the first public intent detection and…

Computation and Language · Computer Science 2021-06-10 Mai Hoang Dao , Thinh Hung Truong , Dat Quoc Nguyen

Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and importantly, have no…

Machine Learning · Computer Science 2022-10-20 Kalpa Gunaratna , Vijay Srinivasan , Akhila Yerukola , Hongxia Jin

Intent classification (IC) plays an important role in task-oriented dialogue systems. However, IC models often generalize poorly when training without sufficient annotated examples for each user intent. We propose a novel pre-training…

Computation and Language · Computer Science 2023-11-15 Mujeen Sung , James Gung , Elman Mansimov , Nikolaos Pappas , Raphael Shu , Salvatore Romeo , Yi Zhang , Vittorio Castelli

Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approaches encounter a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Wenbo Xu , Yanan Wu , Haoran Jiang , Yang Wang , Qiang Wu , Jian Zhang

Profile-based intent detection and slot filling are important tasks aimed at reducing the ambiguity in user utterances by leveraging user-specific supporting profile information. However, research in these two tasks has not been extensively…

Computation and Language · Computer Science 2023-12-19 Thinh Pham , Dat Quoc Nguyen

Intent Detection and Slot Filling are two pillar tasks in Spoken Natural Language Understanding. Common approaches adopt joint Deep Learning architectures in attention-based recurrent frameworks. In this work, we aim at exploiting the…

Computation and Language · Computer Science 2019-07-08 Giuseppe Castellucci , Valentina Bellomaria , Andrea Favalli , Raniero Romagnoli

A two-stage training paradigm consisting of sequential pre-training and meta-training stages has been widely used in current few-shot learning (FSL) research. Many of these methods use self-supervised learning and contrastive learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zhanyuan Yang , Jinghua Wang , Yingying Zhu

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Few-Shot Class-Incremental Learning (FSCIL) models aim to incrementally learn new classes with scarce samples while preserving knowledge of old ones. Existing FSCIL methods usually fine-tune the entire backbone, leading to overfitting and…

Machine Learning · Computer Science 2024-07-18 Chenxi Liu , Zhenyi Wang , Tianyi Xiong , Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang