English
Related papers

Related papers: ICDBigBird: A Contextual Embedding Model for ICD C…

200 papers

With the increasing ability of large language models (LLMs), in-context learning (ICL) has evolved as a new paradigm for natural language processing (NLP), where instead of fine-tuning the parameters of an LLM specific to a downstream task…

Information Retrieval · Computer Science 2024-05-03 Andrew Parry , Debasis Ganguly , Manish Chandra

Developing artificial intelligence (AI) and machine learning (ML) models for medical imaging typically involves extensive training and testing on large datasets, consuming significant computational time, energy, and resources. There is a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Raj Hansini Khoiwal , Alan B. McMillan

Introduction: Clinical text classification using natural language processing (NLP) models requires adequate training data to achieve optimal performance. For that, 200-500 documents are typically annotated. The number is constrained by time…

Computation and Language · Computer Science 2026-01-23 Jaya Chaturvedi , Saniya Deshpande , Chenkai Ma , Robert Cobb , Angus Roberts , Robert Stewart , Daniel Stahl , Diana Shamsutdinova

Background: As of 2026, Large Language Models (LLMs) demonstrate expert-level medical knowledge. However, deploying them as autonomous "Clinical Agents" remains limited. Current Electronic Medical Records (EMRs) and standards like FHIR are…

Artificial Intelligence · Computer Science 2026-05-26 Takahito Nakajima

Automatic International Classification of Diseases (ICD) coding aims to assign multiple ICD codes to a medical note with an average of 3,000+ tokens. This task is challenging due to the high-dimensional space of multi-label assignment…

Computation and Language · Computer Science 2022-11-30 Zhichao Yang , Sunjae Kwon , Zonghai Yao , Hong Yu

Contextual word embedding models, such as BioBERT and Bio_ClinicalBERT, have achieved state-of-the-art results in biomedical natural language processing tasks by focusing their pre-training process on domain-specific corpora. However, such…

Computation and Language · Computer Science 2021-06-04 George Michalopoulos , Yuanxin Wang , Hussam Kaka , Helen Chen , Alexander Wong

Measuring biodiversity is crucial for understanding ecosystem health. While prior works have developed machine learning models for taxonomic classification of photographic images and DNA separately, in this work, we introduce a multimodal…

Artificial Intelligence · Computer Science 2025-12-10 ZeMing Gong , Austin T. Wang , Xiaoliang Huo , Joakim Bruslund Haurum , Scott C. Lowe , Graham W. Taylor , Angel X. Chang

We introduce LLMD, a large language model designed to analyze a patient's medical history based on their medical records. Along with domain knowledge, LLMD is trained on a large corpus of records collected over time and across facilities,…

Deep learning models have proven to be effective on medical datasets for accurate diagnostic predictions from images. However, medical datasets often contain noisy, mislabeled, or poorly generalizable images, particularly for edge cases and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ruhaan Singh , Sreelekha Guggilam

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

The clinical named entity recognition (CNER) task seeks to locate and classify clinical terminologies into predefined categories, such as diagnostic procedure, disease disorder, severity, medication, medication dosage, and sign symptom.…

Computation and Language · Computer Science 2021-06-25 Yichao Zhou , Chelsea Ju , J. Harry Caufield , Kevin Shih , Calvin Chen , Yizhou Sun , Kai-Wei Chang , Peipei Ping , Wei Wang

With the tremendous growth in the number of scientific papers being published, searching for references while writing a scientific paper is a time-consuming process. A technique that could add a reference citation at the appropriate place…

Computation and Language · Computer Science 2019-03-18 Chanwoo Jeong , Sion Jang , Hyuna Shin , Eunjeong Park , Sungchul Choi

Today, machine learning is applied in almost any field. In machine learning, where there are numerous methods, classification is one of the most basic and crucial ones. Various problems can be solved by classification. The feature selection…

Machine Learning · Computer Science 2022-07-01 Ahmet Tuğrul Bayrak

Scene Classification has been addressed with numerous techniques in computer vision literature. However, with the increasing number of scene classes in datasets in the field, it has become difficult to achieve high accuracy in the context…

Robotics · Computer Science 2019-08-29 Bao Xin Chen , Raghavender Sahdev , Dekun Wu , Xing Zhao , Manos Papagelis , John K. Tsotsos

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly…

Computation and Language · Computer Science 2023-10-31 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Rui Yan

In-Context Learning (ICL) has emerged as an important new paradigm in natural language processing and large language model (LLM) applications. However, the theoretical understanding of the ICL mechanism remains limited. This paper aims to…

Information Theory · Computer Science 2025-10-17 Huaze Tang , Tianren Peng , Shao-lun Huang

Deep learning models have gained remarkable performance on a variety of image classification tasks. However, many models suffer from limited performance in clinical or medical settings when data are imbalanced. To address this challenge, we…

Image and Video Processing · Electrical Eng. & Systems 2022-04-15 Long Gao , Chang Liu , Dooman Arefan , Ashok Panigrahy , Margarita L. Zuley , Shandong Wu

Human coders assign standardized medical codes to clinical documents generated during patients' hospitalization, which is error-prone and labor-intensive. Automated medical coding approaches have been developed using machine learning…

Computation and Language · Computer Science 2022-09-13 Wei Sun , Shaoxiong Ji , Erik Cambria , Pekka Marttinen

Linking clinical narratives to standardized vocabularies and coding systems is a key component of unlocking the information in medical text for analysis. However, many domains of medical concepts lack well-developed terminologies that can…

Computation and Language · Computer Science 2021-03-11 Denis Newman-Griffis , Eric Fosler-Lussier

After pre-training by generating the next word conditional on previous words, the Language Model (LM) acquires the ability of In-Context Learning (ICL) that can learn a new task conditional on the context of the given in-context examples…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Haokun Chen , Xu Yang , Yuhang Huang , Zihan Wu , Jing Wang , Xin Geng