English
Related papers

Related papers: FsPONER: Few-shot Prompt Optimization for Named En…

200 papers

Prompt learning is a new paradigm in the Natural Language Processing (NLP) field which has shown impressive performance on a number of natural language tasks with common benchmarking text datasets in full, few-shot, and zero-shot…

Computation and Language · Computer Science 2022-05-12 Niall Taylor , Yi Zhang , Dan Joyce , Alejo Nevado-Holgado , Andrey Kormilitzin

Deploying language models (LMs) in customer-facing speech applications requires conversational fluency and adherence to specific stylistic guidelines. This can be challenging to achieve reliably using complex system prompts due to issues…

Machine Learning · Computer Science 2025-07-08 Ingo Marquardt , Philippe Brule

Most NER methods rely on extensive labeled data for model training, which struggles in the low-resource scenarios with limited training data. Existing dominant approaches usually suffer from the challenge that the target domain has…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Lei Li , Shumin Deng , Chuanqi Tan , Changliang Xu , Fei Huang , Luo Si , Huajun Chen , Ningyu Zhang

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

Large Language Models (LLMs) excel in zero-shot and few-shot tasks, but achieving similar performance with encoder-only models like BERT and RoBERTa has been challenging due to their architecture. However, encoders offer advantages such as…

We evaluate four state-of-the-art instruction-tuned large language models (LLMs) -- ChatGPT, Flan-T5 UL2, Tk-Instruct, and Alpaca -- on a set of 13 real-world clinical and biomedical natural language processing (NLP) tasks in English, such…

Computation and Language · Computer Science 2024-06-11 Yanis Labrak , Mickael Rouvier , Richard Dufour

Few-shot classification (FSC) is a fundamental yet challenging task in computer vision that involves recognizing novel classes from limited data. While previous methods have focused on enhancing visual features or incorporating additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Fan Liu , Wenwen Cai , Jian Huo , Chuanyi Zhang , Delong Chen , Jun Zhou

Fine-grained ship classification in remote sensing (RS-FGSC) poses a significant challenge due to the high similarity between classes and the limited availability of labeled data, limiting the effectiveness of traditional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Long Lan , Fengxiang Wang , Xiangtao Zheng , Zengmao Wang , Xinwang Liu

The cold-start user issue further compromises the effectiveness of recommender systems in limiting access to the historical behavioral information. It is an effective pipeline to optimize instructional prompts on a few-shot large language…

Artificial Intelligence · Computer Science 2025-09-12 Haowei Yang , Yushang Zhao , Sitao Min , Bo Su , Chao Yao , Wei Xu

Objective: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on…

Computation and Language · Computer Science 2024-01-26 Yan Hu , Qingyu Chen , Jingcheng Du , Xueqing Peng , Vipina Kuttichi Keloth , Xu Zuo , Yujia Zhou , Zehan Li , Xiaoqian Jiang , Zhiyong Lu , Kirk Roberts , Hua Xu

The rapid advancements in Large Language Models (LLMs) have revolutionized natural language processing (NLP) and related fields. However, fine-tuning these models for specific tasks remains computationally expensive and risks degrading…

Computation and Language · Computer Science 2024-12-17 Md Kowsher , Nusrat Jahan Prottasha , Prakash Bhat

Natural language processing (NLP) sees rich mobile applications. To support various language understanding tasks, a foundation NLP model is often fine-tuned in a federated, privacy-preserving setting (FL). This process currently relies on…

Machine Learning · Computer Science 2023-08-22 Dongqi Cai , Shangguang Wang , Yaozong Wu , Felix Xiaozhu Lin , Mengwei Xu

Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that…

Computation and Language · Computer Science 2019-04-23 Nargiza Nosirova , Mingbin Xu , Hui Jiang

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

We study the named entity recognition (NER) problem under the extremely weak supervision (XWS) setting, where only one example entity per type is given in a context-free way. While one can see that XWS is lighter than one-shot in terms of…

Computation and Language · Computer Science 2023-11-07 Letian Peng , Zihan Wang , Jingbo Shang

Multiple instance learning (MIL) has become a standard paradigm for the weakly supervised classification of whole slide images (WSIs). However, this paradigm relies on using a large number of labeled WSIs for training. The lack of training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Minghao Han , Linhao Qu , Dingkang Yang , Xukun Zhang , Xiaoying Wang , Lihua Zhang

Recent advances in prompt-based learning have shown strong results on few-shot text classification by using cloze-style templates. Similar attempts have been made on named entity recognition (NER) which manually design templates to predict…

Computation and Language · Computer Science 2022-04-01 Dong-Ho Lee , Akshen Kadakia , Kangmin Tan , Mahak Agarwal , Xinyu Feng , Takashi Shibuya , Ryosuke Mitani , Toshiyuki Sekiya , Jay Pujara , Xiang Ren

In NLP, Zero-Shot Classification (ZSC) has become essential for enabling models to classify text into categories unseen during training, particularly in low-resource languages and domains where labeled data is scarce. While pretrained…

Computation and Language · Computer Science 2025-03-31 Fred Philippy , Siwen Guo , Cedric Lothritz , Jacques Klein , Tegawendé F. Bissyandé

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

Machine Learning · Computer Science 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Few-shot named entity recognition (NER) detects named entities within text using only a few annotated examples. One promising line of research is to leverage natural language descriptions of each entity type: the common label PER might, for…

Computation and Language · Computer Science 2024-03-22 Jonas Golde , Felix Hamborg , Alan Akbik