English
Related papers

Related papers: FsPONER: Few-shot Prompt Optimization for Named En…

200 papers

Using prompts to utilize language models to perform various downstream tasks, also known as prompt-based learning or prompt-learning, has lately gained significant success in comparison to the pre-train and fine-tune paradigm. Nonetheless,…

Computation and Language · Computer Science 2022-10-19 Yi Sun , Yu Zheng , Chao Hao , Hangping Qiu

StackOverflow, with its vast question repository and limited labeled examples, raise an annotation challenge for us. We address this gap by proposing RoBERTa+MAML, a few-shot named entity recognition (NER) method leveraging meta-learning.…

Computation and Language · Computer Science 2024-04-30 Xinwei Chen , Kun Li , Tianyou Song , Jiangjian Guo

Few-shot learning (FSL) is the task of learning to recognize previously unseen categories of images from a small number of training examples. This is a challenging task, as the available examples may not be enough to unambiguously determine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Kun Yan , Zied Bouraoui , Ping Wang , Shoaib Jameel , Steven Schockaert

This paper presents an iterative approach to performing Scientific Named Entity Recognition (SciNER) using BERT-based models. We leverage transfer learning to fine-tune pretrained models with a small but high-quality set of manually…

Computation and Language · Computer Science 2025-02-25 Kartik Gupta

Few-shot semantic segmentation (FSS) aims to enable models to segment novel/unseen object classes using only a limited number of labeled examples. However, current FSS methods frequently struggle with generalization due to incomplete and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Amin Karimi , Charalambos Poullis

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Mass-shooting events pose a significant challenge to public safety, generating large volumes of unstructured textual data that hinder effective investigations and the formulation of public policy. Despite the urgency, few prior studies have…

Computers and Society · Computer Science 2025-04-18 Benign John Ihugba , Afsana Nasrin , Ling Wu , Lin Li , Lijun Qian , Xishuang Dong

As large language models (LLMs) are widely adopted, new safety issues and policies emerge, to which existing safety classifiers do not generalize well. If we have only observed a few examples of violations of a new safety rule, how can we…

Machine Learning · Computer Science 2023-10-27 Ananth Balashankar , Xiao Ma , Aradhana Sinha , Ahmad Beirami , Yao Qin , Jilin Chen , Alex Beutel

Named Entity Recognition (NER) serves as a fundamental task in natural language understanding, bearing direct implications for web content analysis, search engines, and information retrieval systems. Fine-tuned NER models exhibit…

Computation and Language · Computer Science 2024-12-24 Zhen Zhang , Yuhua Zhao , Hang Gao , Mengting Hu

Prompt learning is a new paradigm for utilizing pre-trained language models and has achieved great success in many tasks. To adopt prompt learning in the NER task, two kinds of methods have been explored from a pair of symmetric…

Computation and Language · Computer Science 2023-05-29 Yongliang Shen , Zeqi Tan , Shuhui Wu , Wenqi Zhang , Rongsheng Zhang , Yadong Xi , Weiming Lu , Yueting Zhuang

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

Computation and Language · Computer Science 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Large language models (LLMs) have demonstrated remarkable generalizability, such as understanding arbitrary entities and relations. Instruction tuning has proven effective for distilling LLMs into more cost-efficient models such as Alpaca…

Computation and Language · Computer Science 2024-01-22 Wenxuan Zhou , Sheng Zhang , Yu Gu , Muhao Chen , Hoifung Poon

Leveraging Large Language Models (LLMs) for recommendation has recently garnered considerable attention, where fine-tuning plays a key role in LLMs' adaptation. However, the cost of fine-tuning LLMs on rapidly expanding recommendation data…

Information Retrieval · Computer Science 2024-06-05 Xinyu Lin , Wenjie Wang , Yongqi Li , Shuo Yang , Fuli Feng , Yinwei Wei , Tat-Seng Chua

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the problem of few-shot NER by…

Computation and Language · Computer Science 2022-04-14 Tingting Ma , Huiqiang Jiang , Qianhui Wu , Tiejun Zhao , Chin-Yew Lin

Objective: Function is increasingly recognized as an important indicator of whole-person health. This study evaluates the ability of publicly available large language models (LLMs) to accurately identify the presence of functioning…

Computation and Language · Computer Science 2023-12-19 Tuan Dung Le , Thanh Duong , Thanh Thieu

Large language models demonstrate impressive proficiency in language understanding and generation. Nonetheless, training these models from scratch, even the least complex billion-parameter variant demands significant computational resources…

Artificial Intelligence · Computer Science 2025-01-10 Danyal Aftab , Steven Davy

This study explores the capability of Large Language Models (LLMs) to evaluate causality in causal graphs generated by conventional statistical causal discovery methods-a task traditionally reliant on manual assessment by human subject…

Computation and Language · Computer Science 2025-04-16 Yuni Susanti , Nina Holsmoelle

Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like…

Computation and Language · Computer Science 2022-06-08 Xiaodi Sun , Sunny Rajagopalan , Priyanka Nigam , Weiyi Lu , Yi Xu , Belinda Zeng , Trishul Chilimbi

Training or finetuning large-scale language models (LLMs) such as GPT-3 requires substantial computation resources, motivating recent efforts to explore parameter-efficient adaptation to downstream tasks. One practical area of research is…

Computation and Language · Computer Science 2023-10-23 Danqing Luo , Chen Zhang , Jiahui Xu , Bin Wang , Yiming Chen , Yan Zhang , Haizhou Li

Generalized Entity Matching (GEM), which aims at judging whether two records represented in different formats refer to the same real-world entity, is an essential task in data management. The prompt tuning paradigm for pre-trained language…

Computation and Language · Computer Science 2024-05-09 Yikuan Xia , Jiazun Chen , Xinchi Li , Jun Gao