English
Related papers

Related papers: Enhancing Clinical Text Classification via Fine-Tu…

200 papers

Accurate diagnostic coding of medical notes is crucial for enhancing patient care, medical research, and error-free billing in healthcare organizations. Manual coding is a time-consuming task for providers, and diagnostic codes often…

Machine Learning · Computer Science 2024-12-17 Prajwal Kailas , Max Homilius , Rahul C. Deo , Calum A. MacRae

The advancement of natural language processing (NLP) systems in healthcare hinges on language model ability to interpret the intricate information contained within clinical notes. This process often requires integrating information from…

Computation and Language · Computer Science 2024-03-12 Zhichao Yang , Avijit Mitra , Sunjae Kwon , Hong Yu

We present an approach to automatically classify clinical text at a sentence level. We are using deep convolutional neural networks to represent complex features. We train the network on a dataset providing a broad categorization of health…

Computation and Language · Computer Science 2017-04-25 Mark Hughes , Irene Li , Spyros Kotoulas , Toyotaro Suzumura

Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions. However, most studies only compare a single clinical group to healthy controls, whereas clinical practice often requires differentiating…

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Text classification algorithms investigate the intricate relationships between words or phrases and attempt to deduce the document's interpretation. In the last few years, these algorithms have progressed tremendously. Transformer…

Computation and Language · Computer Science 2022-06-28 Snehal Khandve , Vedangi Wagh , Apurva Wani , Isha Joshi , Raviraj Joshi

This paper narrows the performance gap between small, specialized models and significantly larger general-purpose models through domain adaptation via continual pre-training and merging. We address the scarcity of specialized non-English…

Computation and Language · Computer Science 2026-04-22 Niclas Doll , Jasper Schulze Buschhoff , Shalaka Satheesh , Hammam Abdelwahab , Héctor Allende-Cid , Katrin Klug

Large Language Models (LLMs) have fundamentally transformed approaches to Natural Language Processing (NLP) tasks across diverse domains. In healthcare, accurate and cost-efficient text classification is crucial, whether for clinical notes…

Computation and Language · Computer Science 2026-02-16 Hajar Sakai , Sarah S. Lam

The emergence of multi-modal deep learning models has made significant impacts on clinical applications in the last decade. However, the majority of models are limited to single-tasking, without considering disease diagnosis is indeed a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Lijian Xu , Ziyu Ni , Xinglong Liu , Xiaosong Wang , Hongsheng Li , Shaoting Zhang

Clinical coding is the task of assigning a set of alphanumeric codes, referred to as ICD (International Classification of Diseases), to a medical event based on the context captured in a clinical narrative. The latest version of ICD,…

Computation and Language · Computer Science 2022-03-11 Cansu Sen , Bingyang Ye , Javed Aslam , Amir Tahmasebi

Medical dictation systems are essential tools in modern healthcare, enabling accurate and efficient conversion of speech into written medical documentation. The main objective of this paper is to create a domain-specific system for Greek…

Computation and Language · Computer Science 2025-09-30 Vardis Georgilas , Themos Stafylakis

The increasing volume and complexity of clinical documentation in Electronic Medical Records systems pose significant challenges for clinical coders, who must mentally process and summarise vast amounts of clinical text to extract essential…

Computation and Language · Computer Science 2024-09-25 Bokang Bi , Leibo Liu , Sanja Lujic , Louisa Jorm , Oscar Perez-Concha

Large scale veterinary clinical records can become a powerful resource for patient care and research. However, clinicians lack the time and resource to annotate patient records with standard medical diagnostic codes and most veterinary…

Computation and Language · Computer Science 2018-09-05 Allen Nie , Ashley Zehnder , Rodney L. Page , Arturo L. Pineda , Manuel A. Rivas , Carlos D. Bustamante , James Zou

Automatic phenotyping is a task of identifying cohorts of patients that match a predefined set of criteria. Phenotyping typically involves classifying long clinical documents that contain thousands of tokens. At the same time, recent…

Computation and Language · Computer Science 2021-05-17 Xin Su , Timothy Miller , Xiyu Ding , Majid Afshar , Dmitriy Dligach

While large pretrained Transformer models have proven highly capable at tackling natural language tasks, handling long sequence inputs continues to be a significant challenge. One such task is long input summarization, where inputs are…

Computation and Language · Computer Science 2022-08-10 Jason Phang , Yao Zhao , Peter J. Liu

Assisted text input techniques can save time and effort and improve text quality. In this paper, we investigate how grounded and conditional extensions to standard neural language models can bring improvements in the tasks of word…

Computation and Language · Computer Science 2016-10-21 Georgios P. Spithourakis , Steffen E. Petersen , Sebastian Riedel

Biomedical literature is a rapidly expanding field of science and technology. Classification of biomedical texts is an essential part of biomedicine research, especially in the field of biology. This work proposes the fine-tuned DistilBERT,…

Computation and Language · Computer Science 2024-04-23 Ziqing Guo

Several biomedical language models have already been developed for clinical language inference. However, these models typically utilize general vocabularies and are trained on relatively small clinical corpora. We sought to evaluate the…

Computation and Language · Computer Science 2022-10-14 Madhumita Sushil , Dana Ludwig , Atul J. Butte , Vivek A. Rudrapatna

Large Language Models have undoubtedly revolutionized the Natural Language Processing field, the current trend being to promote one-model-for-all tasks (sentiment analysis, translation, etc.). However, the statistical mechanisms at work in…

Computation and Language · Computer Science 2024-08-26 Célia D'Cruz , Jean-Marc Bereder , Frédéric Precioso , Michel Riveill

Scientific research indicates that for every hour spent in direct patient care, physicians spend nearly two additional hours on administrative tasks, particularly on electronic health records (EHRs) and desk work. This excessive…

Computation and Language · Computer Science 2025-09-25 Hui Yi Leong , Yi Fan Gao , Ji Shuai , Yang Zhang , Uktu Pamuksuz