English
Related papers

Related papers: Prompt-Based Metric Learning for Few-Shot NER

200 papers

Contrastive learning has become a popular solution for few-shot Name Entity Recognization (NER). The conventional configuration strives to reduce the distance between tokens with the same labels and increase the distance between tokens with…

Computation and Language · Computer Science 2023-08-02 Mingchen Li , Yang Ye , Jeremy Yeung , Huixue Zhou , Huaiyuan Chu , Rui Zhang

Large language models (LLMs) have become the preferred solution for many natural language processing tasks. In low-resource environments such as specialized domains, their few-shot capabilities are expected to deliver high performance.…

Computation and Language · Computer Science 2024-10-10 Marco Naguib , Xavier Tannier , Aurélie Névéol

Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large…

Computation and Language · Computer Science 2023-02-16 Chengcheng Han , Renyu Zhu , Jun Kuang , FengJiao Chen , Xiang Li , Ming Gao , Xuezhi Cao , Wei Wu

Few-shot learning has been successfully applied to medical image classification as only very few medical examples are available for training. Due to the challenging problem of limited number of annotated medical images, image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhenwei Wang , Qiule Sun , Bingbing Zhang , Pengfei Wang , Jianxin Zhang , Qiang Zhang

Pre-trained masked language models have demonstrated remarkable ability as few-shot learners. In this paper, as an alternative, we propose a novel approach to few-shot learning with pre-trained token-replaced detection models like ELECTRA.…

Computation and Language · Computer Science 2023-03-22 Zicheng Li , Shoushan Li , Guodong Zhou

Despite the huge and continuous advances in computational linguistics, the lack of annotated data for Named Entity Recognition (NER) is still a challenging issue, especially in low-resource languages and when domain knowledge is required…

Computation and Language · Computer Science 2021-11-25 Valerio La Gatta , Vincenzo Moscato , Marco Postiglione , Giancarlo Sperlì

State-of-the-art semantic segmentation methods require sufficient labeled data to achieve good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation is thus proposed to tackle this problem by learning a model…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Zhuotao Tian , Hengshuang Zhao , Michelle Shu , Zhicheng Yang , Ruiyu Li , Jiaya Jia

Few-shot named entity recognition (NER) exploits limited annotated instances to identify named mentions. Effectively transferring the internal or external resources thus becomes the key to few-shot NER. While the existing prompt tuning…

Computation and Language · Computer Science 2023-06-13 Jiang Liu , Hao Fei , Fei Li , Jingye Li , Bobo Li , Liang Zhao , Chong Teng , Donghong Ji

Supervised named entity recognition (NER) in the biomedical domain depends on large sets of annotated texts with the given named entities. The creation of such datasets can be time-consuming and expensive, while extraction of new entities…

Computation and Language · Computer Science 2024-08-27 Miloš Košprdić , Nikola Prodanović , Adela Ljajić , Bojana Bašaragin , Nikola Milošević

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean without noise or…

Computation and Language · Computer Science 2023-12-14 Xiaojun Xue , Chunxia Zhang , Tianxiang Xu , Zhendong Niu

The vision-language model has brought great improvement to few-shot industrial anomaly detection, which usually needs to design of hundreds of prompts through prompt engineering. For automated scenarios, we first use conventional prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaofan Li , Zhizhong Zhang , Xin Tan , Chengwei Chen , Yanyun Qu , Yuan Xie , Lizhuang Ma

Metric-based learning is a well-known family of methods for few-shot learning, especially in computer vision. Recently, they have been used in many natural language processing applications but not for slot tagging. In this paper, we explore…

Computation and Language · Computer Science 2021-03-04 Cennet Oguz , Ngoc Thang Vu

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Knowledge distillation has been successfully applied to Continual Learning Named Entity Recognition (CLNER) tasks, by using a teacher model trained on old-class data to distill old-class entities present in new-class data as a form of…

Computation and Language · Computer Science 2025-08-12 Zhe Ren

Although deep learning techniques have shown significant achievements, they frequently depend on extensive amounts of hand-labeled data and tend to perform inadequately in few-shot scenarios. The objective of this study is to devise a…

Computation and Language · Computer Science 2024-10-28 Leilei Su , Jian Chen , Yifan Peng , Cong Sun

Few-shot learning has been used to tackle the problem of label scarcity in text classification, of which meta-learning based methods have shown to be effective, such as the prototypical networks (PROTO). Despite the success of PROTO, there…

Computation and Language · Computer Science 2023-03-17 Chengcheng Han , Yuhe Wang , Yingnan Fu , Xiang Li , Minghui Qiu , Ming Gao , Aoying Zhou

Using prompts to utilize language models to perform various downstream tasks, also known as prompt-based learning or prompt-learning, has lately gained significant success in comparison to the pre-train and fine-tune paradigm. Nonetheless,…

Computation and Language · Computer Science 2022-10-19 Yi Sun , Yu Zheng , Chao Hao , Hangping Qiu

Named Entity Recognition (NER) in the rare disease domain poses unique challenges due to limited labeled data, semantic ambiguity between entity types, and long-tail distributions. In this study, we evaluate the capabilities of GPT-4o for…

Computation and Language · Computer Science 2025-12-30 Nan Miles Xi , Yu Deng , Lin Wang