English
Related papers

Related papers: An Explicit-Joint and Supervised-Contrastive Learn…

200 papers

Continual Few-shot Relation Extraction (CFRE) is a practical problem that requires the model to continuously learn novel relations while avoiding forgetting old ones with few labeled training data. The primary challenges are catastrophic…

Computation and Language · Computer Science 2024-02-27 Shengkun Ma , Jiale Han , Yi Liang , Bo Cheng

Detecting the user's intent and finding the corresponding slots among the utterance's words are important tasks in natural language understanding. Their interconnected nature makes their joint modeling a standard part of training such…

Computation and Language · Computer Science 2021-10-06 Momchil Hardalov , Ivan Koychev , Preslav Nakov

Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition. In this work, we propose an attention-based neural network model for joint intent detection and slot…

Computation and Language · Computer Science 2016-09-07 Bing Liu , Ian Lane

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Few-shot object detection (FSOD) aims to classify and detect few images of novel categories. Existing meta-learning methods insufficiently exploit features between support and query images owing to structural limitations. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Dongwoo Park , Jong-Min Lee

Incremental few-shot learning is highly expected for practical robotics applications. On one hand, robot is desired to learn new tasks quickly and flexibly using only few annotated training samples; on the other hand, such new additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Yiting Li , Haiyue Zhu , Sichao Tian , Fan Feng , Jun Ma , Chek Sing Teo , Cheng Xiang , Prahlad Vadakkepat , Tong Heng Lee

Large language models (LLMs) excel at few-shot in-context learning (ICL) -- learning from a few examples provided in context at inference, without any weight updates. Newly expanded context windows allow us to investigate ICL with hundreds…

The research study of detecting multiple intents and filling slots is becoming more popular because of its relevance to complicated real-world situations. Recent advanced approaches, which are joint models based on graphs, might still face…

Computation and Language · Computer Science 2023-12-12 Thinh Pham , Chi Tran , Dat Quoc Nguyen

Spoken language understanding (SLU) acts as a critical component in goal-oriented dialog systems. It typically involves identifying the speakers intent and extracting semantic slots from user utterances, which are known as intent detection…

Computation and Language · Computer Science 2019-05-29 Mengyang Chen , Jin Zeng , Jie Lou

Natural language understanding includes the tasks of intent detection (identifying a user's objectives) and slot filling (extracting the entities relevant to those objectives). Prior slot filling methods assume that each intent type cannot…

Computation and Language · Computer Science 2023-05-19 Harshil Shah , Arthur Wilcke , Marius Cobzarenco , Cristi Cobzarenco , Edward Challis , David Barber

Few-shot segmentation (FSS) aims to segment objects of unseen classes given only a few annotated support images. Most existing methods simply stitch query features with independent support prototypes and segment the query image by feeding…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Kai Huang , Mingfei Cheng , Yang Wang , Bochen Wang , Ye Xi , Feigege Wang , Peng Chen

Few-shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real-world applications. However, it is particularly challenging to learn a class-invariant…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Songyang Zhang , Jiale Zhou , Xuming He

A key challenge of dialog systems research is to effectively and efficiently adapt to new domains. A scalable paradigm for adaptation necessitates the development of generalizable models that perform well in few-shot settings. In this…

Computation and Language · Computer Science 2021-05-26 Shikib Mehri , Mihail Eric

Text classification tends to struggle when data is deficient or when it needs to adapt to unseen classes. In such challenging scenarios, recent studies have used meta-learning to simulate the few-shot task, in which new queries are compared…

Computation and Language · Computer Science 2019-10-01 Ruiying Geng , Binhua Li , Yongbin Li , Xiaodan Zhu , Ping Jian , Jian Sun

We are interested in developing a unified machine learning model over many mobile devices for practical learning tasks, where each device only has very few training data. This is a commonly encountered situation in mobile computing…

Machine Learning · Computer Science 2021-04-02 Chenyou Fan , Jianwei Huang

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Commit Classification (CC) is an important task in software maintenance, which helps software developers classify code changes into different types according to their nature and purpose. It allows developers to understand better how their…

Software Engineering · Computer Science 2023-08-17 Jiajun Tong , Zhixiao Wang , Xiaobin Rui

Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Guowei Yin , Sheng Huang , Luwen Huangfu , Yi Zhang , Xiaohong Zhang

Most recent few-shot learning approaches are based on meta-learning with episodic training. However, prior studies encounter two crucial problems: (1) \textit{the presence of inductive bias}, and (2) \textit{the occurrence of catastrophic…

Multimedia · Computer Science 2024-09-18 Bingzhi Chen , Haoming Zhou , Yishu Liu , Biqing Zeng , Jiahui Pan , Guangming Lu

In this paper, we explore how to utilize pre-trained language model to perform few-shot text classification where only a few annotated examples are given for each class. Since using traditional cross-entropy loss to fine-tune language model…

Computation and Language · Computer Science 2022-10-03 Liwen Sun , Jiawei Han