English
Related papers

Related papers: ICDBigBird: A Contextual Embedding Model for ICD C…

200 papers

Automatic ICD coding is defined as assigning disease codes to electronic medical records (EMRs). Existing methods usually apply label attention with code representations to match related text snippets. Unlike these works that model the…

Computation and Language · Computer Science 2022-04-01 Zheng Yuan , Chuanqi Tan , Songfang Huang

Objective. Natural language processing methods for medical auto-coding, or automatic generation of medical billing codes from electronic health records, generally assign each code independently of the others. They may thus assign codes for…

Computation and Language · Computer Science 2015-10-19 Michael Subotin , Anthony R. Davis

In-Context Learning (ICL) is an important paradigm for adapting Large Language Models (LLMs) to downstream tasks through a few demonstrations. Despite the great success of ICL, the limitation of the demonstration number may lead to…

Computation and Language · Computer Science 2024-01-10 Caoyun Fan , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Automated medical coding is a process of codifying clinical notes to appropriate diagnosis and procedure codes automatically from the standard taxonomies such as ICD (International Classification of Diseases) and CPT (Current Procedure…

Machine Learning · Computer Science 2022-07-15 Jeshuren Chelladurai , Sudarsun Santhiappan , Balaraman Ravindran

In-context learning (ICL) is emerging as a promising technique for achieving universal medical image segmentation, where a variety of objects of interest across imaging modalities can be segmented using a single model. Nevertheless, its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shishuai Hu , Zehui Liao , Liangli Zhen , Huazhu Fu , Yong Xia

Given the clinical notes written in electronic health records (EHRs), it is challenging to predict the diagnostic codes which is formulated as a multi-label classification task. The large set of labels, the hierarchical dependency, and the…

Computation and Language · Computer Science 2021-06-25 Shang-Chi Tsai , Chao-Wei Huang , Yun-Nung Chen

Medical document understanding has gained much attention recently. One representative task is the International Classification of Disease (ICD) diagnosis code assignment. Existing work adopts either RNN or CNN as the backbone network…

Computation and Language · Computer Science 2022-04-21 Ning Zhang , Maciej Jankowski

Foundation models have revolutionized tasks in computer vision and natural language processing. However, in the realm of tabular data, tree-based models like XGBoost continue to dominate. TabPFN, a transformer model tailored for tabular…

Machine Learning · Computer Science 2024-02-13 Junwei Ma , Valentin Thomas , Guangwei Yu , Anthony Caterini

Coding morbidity data using international standard diagnostic classifications is increasingly important and still challenging. Clinical coders and physicians assign codes to patient episodes based on their interpretation of case notes or…

Other Computer Science · Computer Science 2025-03-10 Elena Cardillo , Lucilla Frattura

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

This paper achieves state of the art results for the ICD code prediction task using the MIMIC-III dataset. This was achieved through the use of Clinical BERT (Alsentzer et al., 2019). embeddings and text augmentation and label balancing to…

Computation and Language · Computer Science 2020-08-25 Brent Biseda , Gaurav Desai , Haifeng Lin , Anish Philip

This paper explores in-context learning for image copy detection (ICD), i.e., prompting an ICD model to identify replicated images with new tampering patterns without the need for additional training. The prompts (or the contexts) are from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Wenhao Wang , Yifan Sun , Zhentao Tan , Yi Yang

In order to submit a claim to insurance companies, a doctor needs to code a patient encounter with both the diagnosis (ICDs) and procedures performed (CPTs) in an Electronic Health Record (EHR). Identifying and applying relevant procedures…

Machine Learning · Statistics 2021-12-30 Hasham Ul Haq , Rameel Ahmad , Sibt Ul Hussain

Cognitive diagnosis (CD) plays a crucial role in intelligent education, evaluating students' comprehension of knowledge concepts based on their test histories. However, current CD methods often model students, exercises, and knowledge…

Computation and Language · Computer Science 2025-05-21 Weiming Zhang , Lingyue Fu , Qingyao Li , Kounianhua Du , Jianghao Lin , Jingwei Yu , Wei Xia , Weinan Zhang , Ruiming Tang , Yong Yu

Deep learning approaches exhibit promising performances on various text tasks. However, they are still struggling on medical text classification since samples are often extremely imbalanced and scarce. Different from existing mainstream…

Computation and Language · Computer Science 2023-11-29 Jiahuan Yan , Haojun Gao , Zhang Kai , Weize Liu , Danny Chen , Jian Wu , Jintai Chen

External knowledge is often useful for natural language understanding tasks. We introduce a contextual text representation model called Conceptual-Contextual (CC) embeddings, which incorporates structured knowledge into text…

Computation and Language · Computer Science 2020-03-13 Xiao Zhang , Dejing Dou , Ji Wu

Recently, self-supervised instance discrimination methods have achieved significant success in learning visual representations from unlabeled photographic images. However, given the marked differences between photographic and medical…

Image and Video Processing · Electrical Eng. & Systems 2022-04-18 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Michael B. Gotway , Jianming Liang

We explore the problem of Incremental Generalized Category Discovery (IGCD). This is a challenging category incremental learning setting where the goal is to develop models that can correctly categorize images from previously seen…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bingchen Zhao , Oisin Mac Aodha

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

Computation and Language · Computer Science 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

Automated bioacoustic analysis aids understanding and protection of both marine and terrestrial animals and their habitats across extensive spatiotemporal scales, and typically involves analyzing vast collections of acoustic data. With the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-22 Burooj Ghani , Tom Denton , Stefan Kahl , Holger Klinck