English
Related papers

Related papers: A Multi-Task Semantic Decomposition Framework with…

200 papers

Self-supervised pre-training of transformer models has revolutionized NLP applications. Such pre-training with language modeling objectives provides a useful initial point for parameters that generalize well to new tasks with fine-tuning.…

Computation and Language · Computer Science 2020-11-17 Trapit Bansal , Rishikesh Jha , Tsendsuren Munkhdalai , Andrew McCallum

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

In a surprising turn, Large Language Models (LLMs) together with a growing arsenal of prompt-based heuristics now offer powerful off-the-shelf approaches providing few-shot solutions to myriad classic NLP problems. However, despite…

Computation and Language · Computer Science 2023-06-21 Dhananjay Ashok , Zachary C. Lipton

Collecting annotated data for semantic segmentation is time-consuming and hard to scale up. In this paper, we for the first time propose a unified framework, termed as Multi-Dataset Pretraining, to take full advantage of the fragmented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Bowen Shi , Xiaopeng Zhang , Haohang Xu , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

Few-shot Semantic Segmentation addresses the challenge of segmenting objects in query images with only a handful of annotated examples. However, many previous state-of-the-art methods either have to discard intricate local semantic features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Amirreza Fateh , Mohammad Reza Mohammadi , Mohammad Reza Jahed Motlagh

The goal of few-shot classification is to learn a model that can classify novel classes using only a few training examples. Despite the promising results shown by existing meta-learning algorithms in solving the few-shot classification…

Machine Learning · Computer Science 2020-11-03 Shuman Peng , Weilian Song , Martin Ester

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Current few-shot NER methods focus on leveraging existing datasets in the rich-resource domains which might fail in a…

Computation and Language · Computer Science 2022-10-14 Zeng Yang , Linhai Zhang , Deyu Zhou

In nested Named entity recognition (NER), entities are nested with each other, and thus requiring more data annotations to address. This leads to the development of few-shot nested NER, where the prevalence of pretrained language models…

Computation and Language · Computer Science 2024-02-05 Meishan Zhang , Bin Wang , Hao Fei , Min Zhang

Named entity recognition (NER) models generally perform poorly when large training datasets are unavailable for low-resource domains. Recently, pre-training a large-scale language model has become a promising direction for coping with the…

Computation and Language · Computer Science 2021-12-02 Zihan Liu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Despite the huge and continuous advances in computational linguistics, the lack of annotated data for Named Entity Recognition (NER) is still a challenging issue, especially in low-resource languages and when domain knowledge is required…

Computation and Language · Computer Science 2021-11-25 Valerio La Gatta , Vincenzo Moscato , Marco Postiglione , Giancarlo Sperlì

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

Computation and Language · Computer Science 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Named entity recognition (NER) is a fundamental task in numerous downstream applications. Recently, researchers have employed pre-trained language models (PLMs) and large language models (LLMs) to address this task. However, fully…

Computation and Language · Computer Science 2025-10-30 Yufei Zhao , Xiaoshi Zhong , Erik Cambria , Jagath C. Rajapakse

Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel…

Computation and Language · Computer Science 2022-06-17 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

The task of named entity recognition (NER) is normally divided into nested NER and flat NER depending on whether named entities are nested or not. Models are usually separately developed for the two tasks, since sequence labeling models,…

Computation and Language · Computer Science 2022-11-23 Xiaoya Li , Jingrong Feng , Yuxian Meng , Qinghong Han , Fei Wu , Jiwei Li

Named Entity Recognition (NER) is a fundamental Natural Language Processing (NLP) task to extract entities from unstructured data. The previous methods for NER were based on machine learning or deep learning. Recently, pre-training models…

Computation and Language · Computer Science 2020-02-21 Yu Wang , Yining Sun , Zuchang Ma , Lisheng Gao , Yang Xu , Ting Sun

In this work, we study the problem of named entity recognition (NER) in a low resource scenario, focusing on few-shot and zero-shot settings. Built upon large-scale pre-trained language models, we propose a novel NER framework, namely…

Computation and Language · Computer Science 2021-09-14 Yaqing Wang , Haoda Chu , Chao Zhang , Jing Gao

Few-shot classification aims to adapt to new tasks with limited labeled examples. To fully use the accessible data, recent methods explore suitable measures for the similarity between the query and support images and better high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kaihui Cheng , Chule Yang , Xiao Liu , Naiyang Guan , Zhiyuan Wang

Meta-learning has become a practical approach towards few-shot image classification, where "a strategy to learn a classifier" is meta-learned on labeled base classes and can be applied to tasks with novel classes. We remove the requirement…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Han-Jia Ye , Lu Han , De-Chuan Zhan

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao