English
Related papers

Related papers: Towards BERT-based Automatic ICD Coding: Limitatio…

200 papers

This paper achieves state of the art results for the ICD code prediction task using the MIMIC-III dataset. This was achieved through the use of Clinical BERT (Alsentzer et al., 2019). embeddings and text augmentation and label balancing to…

Computation and Language · Computer Science 2020-08-25 Brent Biseda , Gaurav Desai , Haifeng Lin , Anish Philip

Automatic International Classification of Diseases (ICD) coding aims to assign multiple ICD codes to a medical note with average length of 3,000+ tokens. This task is challenging due to a high-dimensional space of multi-label assignment…

Computation and Language · Computer Science 2022-10-14 Zhichao Yang , Shufan Wang , Bhanu Pratap Singh Rawat , Avijit Mitra , Hong Yu

ICD(International Classification of Diseases) coding involves assigning ICD codes to patients visit based on their medical notes. ICD coding is a challenging multilabel text classification problem due to noisy medical document inputs.…

Computation and Language · Computer Science 2024-09-04 Bin Zhang , Junli Wang

Automated International Classification of Diseases (ICD) coding assigns standardized diagnosis and procedure codes to clinical records, playing a critical role in healthcare systems. However, existing methods face challenges such as…

Computation and Language · Computer Science 2025-11-12 Mucheng Ren , He Chen , Yuchen Yan , Danqing Hu , Jun Xu , Xian Zeng

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

The multivariate, asynchronous nature of real-world clinical data, such as that generated in Intensive Care Units (ICUs), challenges traditional AI-based decision-support systems. These often assume data regularity and feature independence…

Machine Learning · Computer Science 2025-02-28 Ricardo Santos , André V. Carreiro , Xi Peng , Hugo Gamboa , Holger Fröhlich

Automatic International Classification of Diseases (ICD) coding plays a crucial role in the extraction of relevant information from clinical notes for proper recording and billing. One of the most important directions for boosting the…

Machine Learning · Computer Science 2024-02-27 Junyu Luo , Xiaochen Wang , Jiaqi Wang , Aofei Chang , Yaqing Wang , Fenglong Ma

The International Classification of Diseases (ICD) system is the international standard for classifying diseases and procedures during a healthcare encounter and is widely used for healthcare reporting and management purposes. Assigning…

Computation and Language · Computer Science 2022-04-25 George Michalopoulos , Michal Malyska , Nicola Sahar , Alexander Wong , Helen Chen

This study investigates the feasibility of automating clinical coding in Russian, a language with limited biomedical resources. We present a new dataset for ICD coding, which includes diagnosis fields from electronic health records (EHRs)…

Transformers-based models, such as BERT, have dramatically improved the performance for various natural language processing tasks. The clinical knowledge enriched model, namely ClinicalBERT, also achieved state-of-the-art results when…

Computation and Language · Computer Science 2022-04-18 Yikuan Li , Ramsey M. Wehbe , Faraz S. Ahmad , Hanyin Wang , Yuan Luo

Characterization of a patient clinical phenotype is central to biomedical informatics. ICD codes, assigned to inpatient encounters by coders, is important for population health and cohort discovery when clinical information is limited.…

We introduce Clinical ModernBERT, a transformer based encoder pretrained on large scale biomedical literature, clinical notes, and medical ontologies, incorporating PubMed abstracts, MIMIC IV clinical data, and medical codes with their…

Computation and Language · Computer Science 2025-04-08 Simon A. Lee , Anthony Wu , Jeffrey N. Chiang

Manual coding of text data from open-ended questions into different categories is time consuming and expensive. Automated coding uses statistical/machine learning to train on a small subset of manually coded text answers. Recently,…

Applications · Statistics 2023-10-25 Hyukjun Gweon , Matthias Schonlau

Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical…

Information Retrieval · Computer Science 2019-08-12 Zongcheng Ji , Qiang Wei , Hua Xu

Clinical coding is a critical task in healthcare, although traditional methods for automating clinical coding may not provide sufficient explicit evidence for coders in production environments. This evidence is crucial, as medical coders…

Computation and Language · Computer Science 2025-04-08 Leonor Barreiros , Isabel Coutinho , Gonçalo M. Correia , Bruno Martins

In the United States, 25% or greater than 200 billion dollars of hospital spending accounts for administrative costs that involve services for medical coding and billing. With the increasing number of patient records, manual assignment of…

Computation and Language · Computer Science 2020-03-18 A. K. Bhavani Singh , Mounika Guntu , Ananth Reddy Bhimireddy , Judy W. Gichoya , Saptarshi Purkayastha

Clinical coding maps clinical documentation to standardized medical codes, an essential yet time-consuming administrative task that could benefit from automation. Current models on ICD coding are typically optimized for codes from a…

Computation and Language · Computer Science 2026-05-19 Jinghui Liu , Anthony Nguyen

International Classification of Diseases (ICD) is a set of classification codes for medical records. Automated ICD coding, which assigns unique International Classification of Diseases codes with each medical record, is widely used recently…

Artificial Intelligence · Computer Science 2022-12-12 Shi Wang , Daniel Tang , Luchen Zhang , Huilin Li , Ding Han

Healthcare providers usually record detailed notes of the clinical care delivered to each patient for clinical, research, and billing purposes. Due to the unstructured nature of these narratives, providers employ dedicated staff to assign…

Computation and Language · Computer Science 2022-08-03 Chufan Gao , Mononito Goswami , Jieshi Chen , Artur Dubrawski

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

Computation and Language · Computer Science 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak