English
Related papers

Related papers: BERT-XML: Large Scale Automated ICD Coding Using B…

200 papers

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

Various deep learning algorithms have been developed to analyze different types of clinical data including clinical text classification and extracting information from 'free text' and so on. However, automate the keyword extraction from the…

Computation and Language · Computer Science 2019-10-25 Matthew Tang , Priyanka Gandhi , Md Ahsanul Kabir , Christopher Zou , Jordyn Blakey , Xiao Luo

Electronic Health Records (EHR) serve as a valuable source of patient information, offering insights into medical histories, treatments, and outcomes. Previous research has developed systems for detecting applicable ICD codes that should be…

Computation and Language · Computer Science 2024-07-09 Mireia Hernandez Caralt , Clarence Boon Liang Ng , Marek Rei

The extraction of critical patient information from Electronic Health Records (EHRs) poses significant challenges due to the complexity and unstructured nature of the data. Traditional machine learning approaches often fail to capture…

Computation and Language · Computer Science 2025-09-03 Zhimeng Luo , Abhibha Gupta , Adam Frisch , Daqing He

Large scale contextual representation models, such as BERT, have significantly advanced natural language processing (NLP) in recently years. However, in certain area like healthcare, accessing diverse large scale text data from multiple…

Computation and Language · Computer Science 2020-02-21 Dianbo Liu , Tim Miller

Clinical patient notes are critical for documenting patient interactions, diagnoses, and treatment plans in medical practice. Ensuring accurate evaluation of these notes is essential for medical education and certification. However, manual…

Computation and Language · Computer Science 2024-01-25 Jingyu Xu , Yifeng Jiang , Bin Yuan , Shulin Li , Tianbo Song

The extraction of labels from radiology text reports enables large-scale training of medical imaging models. Existing approaches to report labeling typically rely either on sophisticated feature engineering based on medical domain knowledge…

Computation and Language · Computer Science 2020-10-20 Akshay Smit , Saahil Jain , Pranav Rajpurkar , Anuj Pareek , Andrew Y. Ng , Matthew P. Lungren

The clinical notes are usually typed into the system by physicians. They are typically required to be marked by standard medical codes, and each code represents a diagnosis or medical treatment procedure. Annotating these notes is time…

Machine Learning · Computer Science 2023-05-10 Guodong Liu

Clinical coding is an administrative process that involves the translation of diagnostic data from episodes of care into a standard code format such as ICD10. It has many critical applications such as billing and aetiology research. The…

Electronic health records (EHR) are widely believed to hold a profusion of actionable insights, encrypted in an irregular, semi-structured format, amidst a loud noise background. To simplify learning patterns of health and disease, medical…

Computation and Language · Computer Science 2022-12-13 David A. Bloore , Romane Gauriau , Anna L. Decker , Jacob Oppenheim

Background and Objective: Code assignment is of paramount importance in many levels in modern hospitals, from ensuring accurate billing process to creating a valid record of patient care history. However, the coding process is tedious and…

Computation and Language · Computer Science 2019-10-03 Jinmiao Huang , Cesar Osorio , Luke Wicent Sy

This paper achieves state of the art results for the ICD code prediction task using the MIMIC-III dataset. This was achieved through the use of Clinical BERT (Alsentzer et al., 2019). embeddings and text augmentation and label balancing to…

Computation and Language · Computer Science 2020-08-25 Brent Biseda , Gaurav Desai , Haifeng Lin , Anish Philip

Major depressive disorder (MDD) is a prevalent psychiatric disorder that is associated with significant healthcare burden worldwide. Phenotyping of MDD can help early diagnosis and consequently may have significant advantages in patient…

Objective. Natural language processing methods for medical auto-coding, or automatic generation of medical billing codes from electronic health records, generally assign each code independently of the others. They may thus assign codes for…

Computation and Language · Computer Science 2015-10-19 Michael Subotin , Anthony R. Davis

Attention-based models have become the leading approach in modeling medical language for Natural Language Processing (NLP) in clinical notes. These models outperform traditional techniques by effectively capturing contextual representations…

Computation and Language · Computer Science 2025-09-26 Tariq Abdul-Quddoos , Xishuang Dong , Lijun Qian

Automatically associating ICD codes with electronic health data is a well-known NLP task in medical research. NLP has evolved significantly in recent years with the emergence of pre-trained language models based on Transformers…

Computation and Language · Computer Science 2023-04-07 Yakini Tchouka , Jean-François Couchot , David Laiymani , Philippe Selles , Azzedine Rahmani

Automatic ICD coding, the task of assigning disease and procedure codes to electronic medical records, is crucial for clinical documentation and billing. While existing methods primarily enhance model understanding of code hierarchies and…

Computation and Language · Computer Science 2025-11-11 Tuan-Dung Le , Shohreh Haddadan , Thanh Q. Thieu

ICD coding is designed to assign the disease codes to electronic health records (EHRs) upon discharge, which is crucial for billing and clinical statistics. In an attempt to improve the effectiveness and efficiency of manual coding, many…

Computation and Language · Computer Science 2023-05-31 Zichen Liu , Xuyuan Liu , Yanlong Wen , Guoqing Zhao , Fen Xia , Xiaojie Yuan

Background: Encouraged by the success of pretrained Transformer models in many natural language processing tasks, their use for International Classification of Diseases (ICD) coding tasks is now actively being explored. In this study, we…

Computation and Language · Computer Science 2023-09-13 Leibo Liu , Oscar Perez-Concha , Anthony Nguyen , Vicki Bennett , Louisa Jorm

International Classification of Diseases (ICD) coding plays an important role in systematically classifying morbidity and mortality data. In this study, we propose a hierarchical label-wise attention Transformer model (HiLAT) for the…

Machine Learning · Computer Science 2022-10-04 Leibo Liu , Oscar Perez-Concha , Anthony Nguyen , Vicki Bennett , Louisa Jorm