English
Related papers

Related papers: Exploring deep learning methods for recognizing ra…

200 papers

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Rare diseases present unique challenges in healthcare, often suffering from delayed diagnosis and fragmented information landscapes. The scarcity of reliable knowledge in these conditions poses a distinct challenge for Large Language Models…

Computation and Language · Computer Science 2024-11-06 Karthik Soman , Andrew Langdon , Catalina Villouta , Chinmay Agrawal , Lashaw Salta , Braian Peetoom , Gianmarco Bellucci , Orion J Buske

Objective: The majority of detailed patient information in real-world data (RWD) is only consistently available in free-text clinical documents. Manual curation is expensive and time-consuming. Developing natural language processing (NLP)…

The performance of deep learning-based natural language processing systems is based on large amounts of labeled training data which, in the clinical domain, are not easily available or affordable. Weak supervision and in-context learning…

Computation and Language · Computer Science 2025-04-02 Enshuo Hsu , Kirk Roberts

The rapidly increasing volume of electronic health record (EHR) data underscores a pressing need to unlock biomedical knowledge from unstructured clinical texts to support advancements in data-driven clinical systems, including patient…

Computation and Language · Computer Science 2025-10-21 Manuela Daniela Danu , George Marica , Constantin Suciu , Lucian Mihai Itu , Oladimeji Farri

Deep learning (DL) based predictive models from electronic health records (EHR) deliver impressive performance in many clinical tasks. Large training cohorts, however, are often required to achieve high accuracy, hindering the adoption of…

Computation and Language · Computer Science 2020-05-27 Laila Rasmy , Yang Xiang , Ziqian Xie , Cui Tao , Degui Zhi

Recognition of biomedical entities from literature is a challenging research focus, which is the foundation for extracting a large amount of biomedical knowledge existing in unstructured texts into structured formats. Using the sequence…

Computation and Language · Computer Science 2021-05-18 Cong Sun , Zhihao Yang , Lei Wang , Yin Zhang , Hongfei Lin , Jian Wang

The field of clinical natural language processing has been advanced significantly since the introduction of deep learning models. The self-supervised representation learning and the transfer learning paradigm became the methods of choice in…

Computation and Language · Computer Science 2020-04-27 Andrey Kormilitzin , Nemanja Vaci , Qiang Liu , Alejo Nevado-Holgado

Biomedical literature is a rapidly expanding field of science and technology. Classification of biomedical texts is an essential part of biomedicine research, especially in the field of biology. This work proposes the fine-tuned DistilBERT,…

Computation and Language · Computer Science 2024-04-23 Ziqing Guo

The rising prevalence of mental health disorders necessitates the development of robust, automated tools for early detection and monitoring. Recent advances in Natural Language Processing (NLP), particularly transformer-based architectures,…

Computation and Language · Computer Science 2025-07-29 Khalid Hasan , Jamil Saquer , Mukulika Ghosh

This paper proposes a medical literature summary generation method based on the BERT model to address the challenges brought by the current explosion of medical information. By fine-tuning and optimizing the BERT model, we develop an…

Computation and Language · Computer Science 2024-10-29 Jiacheng Hu , Yiru Cang , Guiran Liu , Meiqi Wang , Weijie He , Runyuan Bao

In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER…

Computation and Language · Computer Science 2020-09-22 Usman Naseem , Matloob Khushi , Vinay Reddy , Sakthivel Rajendran , Imran Razzak , Jinman Kim

Processing information locked within clinical health records is a challenging task that remains an active area of research in biomedical NLP. In this work, we evaluate a broad set of machine learning techniques ranging from simple RNNs to…

In the natural language processing literature, neural networks are becoming increasingly deeper and complex. The recent poster child of this trend is the deep language representation model, which includes BERT, ELMo, and GPT. These…

Computation and Language · Computer Science 2019-03-29 Raphael Tang , Yao Lu , Linqing Liu , Lili Mou , Olga Vechtomova , Jimmy Lin

Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference highly unstable. We propose Dynamic Decision Learning (DDL), a framework that enables…

Computation and Language · Computer Science 2026-04-29 Jun Li , Mingxuan Liu , Jiazhen Pan , Che Liu , Wenjia Bai , Cosmin I. Bercea , Julia A. Schnabel

In this work, we present our various contributions to the objective of building a decision support tool for the diagnosis of rare diseases. Our goal is to achieve a state of knowledge where the uncertainty about the patient's disease is…

Specialised pre-trained language models are becoming more frequent in NLP since they can potentially outperform models trained on generic texts. BioBERT and BioClinicalBERT are two examples of such models that have shown promise in medical…

Rare diseases affect an estimated 300-400 million people worldwide, yet individual conditions remain underdiagnosed and poorly characterized due to their low prevalence and limited clinician familiarity. Computational phenotyping offers a…

Large Language Models (LLMs) have revolutionized various sectors, including healthcare where they are employed in diverse applications. Their utility is particularly significant in the context of rare diseases, where data scarcity,…

Computation and Language · Computer Science 2024-08-20 Qiuhao Lu , Rui Li , Andrew Wen , Jinlian Wang , Liwei Wang , Hongfang Liu

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language processing (NLP) has emerged as a promising direction for…

Computation and Language · Computer Science 2021-12-16 Robert Tinn , Hao Cheng , Yu Gu , Naoto Usuyama , Xiaodong Liu , Tristan Naumann , Jianfeng Gao , Hoifung Poon