English
Related papers

Related papers: An evaluation of GPT models for phenotype concept …

200 papers

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

Participant recruitment based on unstructured medical texts such as clinical notes and radiology reports has been a challenging yet important task for the cohort establishment in clinical research. Recently, Large Language Models (LLMs)…

Computation and Language · Computer Science 2023-07-24 Zihan Guan , Zihao Wu , Zhengliang Liu , Dufan Wu , Hui Ren , Quanzheng Li , Xiang Li , Ninghao Liu

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Named Entity Recognition (NER) in the rare disease domain poses unique challenges due to limited labeled data, semantic ambiguity between entity types, and long-tail distributions. In this study, we evaluate the capabilities of GPT-4o for…

Computation and Language · Computer Science 2025-12-30 Nan Miles Xi , Yu Deng , Lin Wang

We evaluated the capability of a state-of-the-art generative pre-trained transformer (GPT) model to perform semantic annotation of short text snippets (one to few sentences) coming from legal documents of various types. Discussions of…

Computation and Language · Computer Science 2023-05-09 Jaromir Savelka

Prompt learning is a new paradigm in the Natural Language Processing (NLP) field which has shown impressive performance on a number of natural language tasks with common benchmarking text datasets in full, few-shot, and zero-shot…

Computation and Language · Computer Science 2022-05-12 Niall Taylor , Yi Zhang , Dan Joyce , Alejo Nevado-Holgado , Andrey Kormilitzin

Background. Large Language Models (LLMs) hold promise for improving genetic variant literature review in clinical testing. We assessed Generative Pretrained Transformer 4's (GPT-4) performance, nondeterminism, and drift to inform its…

Background: Many efforts have been put into the use of automated approaches, such as natural language processing (NLP), to mine or extract data from free-text medical records to construct comprehensive patient profiles for delivering better…

Prompt-based methods have achieved promising results in most few-shot text classification tasks. However, for readability assessment tasks, traditional prompt methods lackcrucial linguistic knowledge, which has already been proven to be…

Computation and Language · Computer Science 2024-04-11 Ziyang Wang , Sanwoo Lee , Hsiu-Yuan Huang , Yunfang Wu

Fine-tuning pre-trained language models (PLMs), e.g., SciBERT, generally requires large numbers of annotated data to achieve state-of-the-art performance on a range of NLP tasks in the scientific domain. However, obtaining the fine-tune…

Computation and Language · Computer Science 2025-12-30 Jiawei Liu , Zi Xiong , Yi Jiang , Yongqiang Ma , Wei Lu , Yong Huang , Qikai Cheng

Motivation: Phenotype concept recognition (CR) is a fundamental task in biomedical text mining. However, existing methods either require ontology-specific training, making them struggle to generalize across diverse text styles and evolving…

Computation and Language · Computer Science 2026-04-06 Yicheng Tao , Yuanhao Huang , Yiqun Wang , Xin Luo , Jie Liu

The increasing availability of unstructured clinical narratives in electronic health records (EHRs) has created new opportunities for automated disease characterization, cohort identification, and clinical decision support. However,…

Computation and Language · Computer Science 2026-03-03 Fariba Afrin Irany , Sampson Akwafuo

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

Computation and Language · Computer Science 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

Generative artificial intelligence tools, like ChatGPT, are an increasingly utilized resource among computational social scientists. Nevertheless, there remains space for improved understanding of the performance of ChatGPT in complex tasks…

Computation and Language · Computer Science 2025-12-02 Breanna E. Green , Ashley L. Shea , Pengfei Zhao , Drew B. Margolin

The progress in natural language processing (NLP) using large language models (LLMs) has greatly improved patient information extraction from clinical narratives. However, most methods based on the fine-tuning strategy have limited transfer…

Computation and Language · Computer Science 2024-03-20 Cheng Peng , Zehao Yu , Kaleb E Smith , Wei-Hsuan Lo-Ciganic , Jiang Bian , Yonghui Wu

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health systems.…

Computation and Language · Computer Science 2020-09-18 Andriy Mulyar , Elliot Schumacher , Masoud Rouhizadeh , Mark Dredze

Patient experience and care quality are crucial for a hospital's sustainability and reputation. The analysis of patient feedback offers valuable insight into patient satisfaction and outcomes. However, the unstructured nature of these…

Computation and Language · Computer Science 2025-02-21 Hajar Sakai , Sarah S. Lam , Mohammadsadegh Mikaeili , Joshua Bosire , Franziska Jovin

The rapid evolution of LLMs represents an impactful paradigm shift in digital interaction and content engagement. While they encode vast amounts of human-generated knowledge and excel in processing diverse data types, they often face the…

Human-Computer Interaction · Computer Science 2024-11-20 Anna Bodonhelyi , Efe Bozkir , Shuo Yang , Enkelejda Kasneci , Gjergji Kasneci

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text,…

Computation and Language · Computer Science 2024-04-30 Qi Zhu , Da Zheng , Xiang Song , Shichang Zhang , Bowen Jin , Yizhou Sun , George Karypis