English
Related papers

Related papers: Leveraging Large Language Models for Rare Disease …

200 papers

Few-shot learning-the ability to train models with access to limited data-has become increasingly popular in the natural language processing (NLP) domain, as large language models such as GPT and T0 have been empirically shown to achieve…

Software Engineering · Computer Science 2023-06-16 Robert Kraig Helmeczi , Mucahit Cevik , Savas Yıldırım

Few-shot NER needs to effectively capture information from limited instances and transfer useful knowledge from external resources. In this paper, we propose a self-describing mechanism for few-shot NER, which can effectively leverage…

Computation and Language · Computer Science 2022-03-24 Jiawei Chen , Qing Liu , Hongyu Lin , Xianpei Han , Le Sun

We present a novel approach to named entity recognition (NER) in the presence of scarce data that we call example-based NER. Our train-free few-shot learning approach takes inspiration from question-answering to identify entity spans in a…

Computation and Language · Computer Science 2020-08-25 Morteza Ziyadi , Yuting Sun , Abhishek Goswami , Jade Huang , Weizhu Chen

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

Computation and Language · Computer Science 2025-09-16 Can Wang , Yiqun Chen

Few-shot Named Entity Recognition (NER) aims to extract named entities using only a limited number of labeled examples. Existing contrastive learning methods often suffer from insufficient distinguishability in context vector representation…

Computation and Language · Computer Science 2024-05-09 Haojie Zhang , Yimeng Zhuang

Text-attributed graphs have recently garnered significant attention due to their wide range of applications in web domains. Existing methodologies employ word embedding models for acquiring text representations as node features, which are…

Machine Learning · Computer Science 2024-12-11 Jianxiang Yu , Yuxiang Ren , Chenghua Gong , Jiaqi Tan , Xiang Li , Xuecang Zhang

Rare events, due to their infrequent occurrences, do not have much data, and hence deep learning techniques fail in estimating the distribution for such data. Open-vocabulary models represent an innovative approach to image classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Payal Kamboj , Ayan Banerjee , Bin Xu , Sandeep Gupta

Large language models (LLMs) have shown remarkable performance on many tasks in different domains. However, their performance in closed-book biomedical machine reading comprehension (MRC) has not been evaluated in depth. In this work, we…

Computation and Language · Computer Science 2024-10-28 Shubham Vatsal , Ayush Singh

The recent GPT-3 model (Brown et al., 2020) achieves remarkable few-shot performance solely by leveraging a natural-language prompt and a few task demonstrations as input context. Inspired by their findings, we study few-shot learning in a…

Computation and Language · Computer Science 2021-06-03 Tianyu Gao , Adam Fisch , Danqi Chen

We study the problem of few shot learning for named entity recognition. Specifically, we leverage the semantic information in the names of the labels as a way of giving the model additional signal and enriched priors. We propose a neural…

Computation and Language · Computer Science 2022-03-18 Jie Ma , Miguel Ballesteros , Srikanth Doss , Rishita Anubhai , Sunil Mallya , Yaser Al-Onaizan , Dan Roth

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

This paper addresses the challenge of Named Entity Recognition (NER) for person names within the specialized domain of Russian news texts concerning cultural events. The study utilizes the unique SPbLitGuide dataset, a collection of event…

Computation and Language · Computer Science 2025-06-04 Maria Levchenko

Despite the recent success of two-stage prototypical networks in few-shot named entity recognition (NER), challenges such as over/under-detected false spans in the span detection stage and unaligned entity prototypes in the type…

Computation and Language · Computer Science 2024-12-04 Quanjiang Guo , Yihong Dong , Ling Tian , Zhao Kang , Yu Zhang , Sijie Wang

In this study, we address one of the challenges of developing NER models for scholarly domains, namely the scarcity of suitable labeled data. We experiment with an approach using predictions from a fine-tuned LLM model to aid non-domain…

Computation and Language · Computer Science 2024-05-07 Julia Evans , Sameer Sadruddin , Jennifer D'Souza

Domain-specific Named Entity Recognition (NER), whose goal is to recognize domain-specific entities and their categories, provides an important support for constructing domain knowledge graphs. Currently, deep learning-based methods are…

Computation and Language · Computer Science 2024-09-17 Le Xiao , Yunfei Xu , Jing Zhao

Computer vision-based methods have valuable use cases in precision medicine, and recognizing facial phenotypes of genetic disorders is one of them. Many genetic disorders are known to affect faces' visual appearance and geometry. Automated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Ömer Sümer , Fabio Hellmann , Alexander Hustinx , Tzung-Chien Hsieh , Elisabeth André , Peter Krawitz

We propose a generative framework for joint sequence labeling and sentence-level classification. Our model performs multiple sequence labeling tasks at once using a single, shared natural language output space. Unlike prior discriminative…

Computation and Language · Computer Science 2020-09-29 Ben Athiwaratkun , Cicero Nogueira dos Santos , Jason Krone , Bing Xiang

With the rapid expansion of unstructured clinical texts in electronic health records (EHRs), clinical named entity recognition (NER) has become a crucial technique for extracting medical information. However, traditional supervised models…

Computation and Language · Computer Science 2026-03-31 Xinli Tao , Xin Dong , Xuezhong Zhou

Named Entity Recognition (NER) plays an important role in a wide range of natural language processing tasks, such as relation extraction, question answering, etc. However, previous studies on NER are limited to particular genres, using…

Computation and Language · Computer Science 2020-11-03 Mengdi Zhu , Zheye Deng , Wenhan Xiong , Mo Yu , Ming Zhang , William Yang Wang

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao