English
Related papers

Related papers: Enhancing Phenotype Recognition in Clinical Notes …

200 papers

Automatic phenotyping is a task of identifying cohorts of patients that match a predefined set of criteria. Phenotyping typically involves classifying long clinical documents that contain thousands of tokens. At the same time, recent…

Computation and Language · Computer Science 2021-05-17 Xin Su , Timothy Miller , Xiyu Ding , Majid Afshar , Dmitriy Dligach

Traditional topic models often struggle with contextual nuances and fail to adequately handle polysemy and rare words. This limitation typically results in topics that lack coherence and quality. Large Language Models (LLMs) can mitigate…

Computation and Language · Computer Science 2025-05-13 Hajar Sakai , Sarah S. Lam

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using…

A common practice in the medical industry is the use of clinical notes, which consist of detailed patient observations. However, electronic health record systems frequently do not contain these observations in a structured format, rendering…

Computation and Language · Computer Science 2023-10-09 Neil Daniel

Objective: The generalizability of clinical large language models is usually ignored during the model development process. This study evaluated the generalizability of BERT-based clinical NLP models across different clinical settings…

Computation and Language · Computer Science 2023-03-16 Sicheng Zhou , Nan Wang , Liwei Wang , Ju Sun , Anne Blaes , Hongfang Liu , Rui Zhang

Biomedical queries have become increasingly prevalent in web searches, reflecting the growing interest in accessing biomedical literature. Despite recent research on large-language models (LLMs) motivated by endeavours to attain generalized…

Computation and Language · Computer Science 2024-08-06 Ankan Mullick , Mukur Gupta , Pawan Goyal

Motivation: Phenotype concept recognition (CR) is a fundamental task in biomedical text mining. However, existing methods either require ontology-specific training, making them struggle to generalize across diverse text styles and evolving…

Computation and Language · Computer Science 2026-04-06 Yicheng Tao , Yuanhao Huang , Yiqun Wang , Xin Luo , Jie Liu

This paper conducts a comprehensive investigation into applying large language models, particularly on BioBERT, in healthcare. It begins with thoroughly examining previous natural language processing (NLP) approaches in healthcare, shedding…

Artificial Intelligence · Computer Science 2023-10-13 Shyni Sharaf , V. S. Anoop

Accurate extraction of breast cancer patients' phenotypes is important for clinical decision support and clinical research. Current models do not take full advantage of cancer domain-specific corpus, whether pre-training Bidirectional…

Information Retrieval · Computer Science 2022-03-10 Sicheng Zhou , Liwei Wang , Nan Wang , Hongfang Liu , Rui Zhang

This study evaluated the effect of BioBERT in medical text processing for the task of medical named entity recognition. Through comparative experiments with models such as BERT, ClinicalBERT, SciBERT, and BlueBERT, the results showed that…

Computation and Language · Computer Science 2024-12-12 Jiacheng Hu , Runyuan Bao , Yang Lin , Hanchao Zhang , Yanlin Xiang

Detecting protein-protein interactions (PPIs) is crucial for understanding genetic mechanisms, disease pathogenesis, and drug design. However, with the fast-paced growth of biomedical literature, there is a growing need for automated and…

Computation and Language · Computer Science 2023-12-14 Hasin Rehana , Nur Bengisu Çam , Mert Basmaci , Jie Zheng , Christianah Jemiyo , Yongqun He , Arzucan Özgür , Junguk Hur

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis

Rare diseases (RDs) are collectively common and affect 300 million people worldwide. Accurate phenotyping is critical for informing diagnosis and treatment, but RD phenotypes are often embedded in unstructured text and time-consuming to…

Computation and Language · Computer Science 2024-06-28 Cathy Shyr , Yan Hu , Paul A. Harris , Hua Xu

Objective: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on…

Computation and Language · Computer Science 2024-01-26 Yan Hu , Qingyu Chen , Jingcheng Du , Xueqing Peng , Vipina Kuttichi Keloth , Xu Zuo , Yujia Zhou , Zehan Li , Xiaoqian Jiang , Zhiyong Lu , Kirk Roberts , Hua Xu

The extraction and analysis of insights from medical data, primarily stored in free-text formats by healthcare workers, presents significant challenges due to its unstructured nature. Medical coding, a crucial process in healthcare, remains…

Computation and Language · Computer Science 2024-05-28 Mikhail Kulyabin , Gleb Sokolov , Aleksandr Galaida , Andreas Maier , Tomas Arias-Vergara

The exponential growth of online textual content across diverse domains has necessitated advanced methods for automated text classification. Large Language Models (LLMs) based on transformer architectures have shown significant success in…

Computation and Language · Computer Science 2025-09-09 Zhyar Rzgar K Rostam , Gábor Kertész

Encoder-based transformer models are central to biomedical and clinical Natural Language Processing (NLP), as their bidirectional self-attention makes them well-suited for efficiently extracting structured information from unstructured text…

Transformers-based models, such as BERT, have dramatically improved the performance for various natural language processing tasks. The clinical knowledge enriched model, namely ClinicalBERT, also achieved state-of-the-art results when…

Computation and Language · Computer Science 2022-04-18 Yikuan Li , Ramsey M. Wehbe , Faraz S. Ahmad , Hanyin Wang , Yuan Luo

We investigated the feasibility of predicting Medical Subject Headings (MeSH) Publication Types (PTs) from MEDLINE citation metadata using pre-trained Transformer-based models BERT and DistilBERT. This study addresses limitations in the…

Digital Libraries · Computer Science 2025-06-05 Victor H. Cid , James Mork

Clinical notes contain valuable unstructured information. Named entity recognition (NER) enables the automatic extraction of medical concepts; however, benchmarks for Portuguese remain scarce. In this study, we aimed to evaluate BERT-based…