English
Related papers

Related papers: Automated ICD Coding using Extreme Multi-label Lon…

200 papers

In this paper, we propose a novel strategy for text-independent speaker identification system: Multi-Label Training (MLT). Instead of the commonly used one-to-one correspondence between the speech and the speaker label, we divide all the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-19 Yuqi Xue

Medical coding is the task of assigning medical codes to clinical free-text documentation. Healthcare professionals manually assign such codes to track patient diagnoses and treatments. Automated medical coding can considerably alleviate…

Machine Learning · Computer Science 2023-04-24 Joakim Edin , Alexander Junge , Jakob D. Havtorn , Lasse Borgholt , Maria Maistro , Tuukka Ruotsalo , Lars Maaløe

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. The effectiveness of…

Computation and Language · Computer Science 2024-09-19 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

Pre-trained language models in the past years have shown exponential growth in model parameters and compute time. ELECTRA is a novel approach for improving the compute efficiency of pre-trained language models (e.g. BERT) based on masked…

Computation and Language · Computer Science 2021-10-14 Junmo Kang , Suwon Shin , Jeonghwan Kim , Jaeyoung Jo , Sung-Hyon Myaeng

In order to reduce domain discrepancy to improve the performance of cross-domain spoken language identification (SLID) system, as an unsupervised domain adaptation (UDA) method, we have proposed a joint distribution alignment (JDA) model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

Medical tabular data, abundant in Electronic Health Records (EHRs), is a valuable resource for diverse medical tasks such as risk prediction. While deep learning approaches, particularly transformer-based models, have shown remarkable…

Computation and Language · Computer Science 2025-04-11 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

The task of assigning diagnostic ICD codes to patient hospital admissions is typically performed by expert human coders. Efforts towards automated ICD coding are dominated by supervised deep learning models. However, difficulties in…

Artificial Intelligence · Computer Science 2023-11-14 Joseph S. Boyle , Antanas Kascenas , Pat Lok , Maria Liakata , Alison Q. O'Neil

This paper introduces an approach that combines the language reasoning capabilities of large language models (LLMs) with the benefits of local training to tackle complex, domain-specific tasks. Specifically, the authors demonstrate their…

Computation and Language · Computer Science 2023-08-04 V. K. Cody Bumgardner , Aaron Mullen , Sam Armstrong , Caylin Hickey , Jeff Talbert

Zero-Shot Cross-lingual Transfer (ZS-XLT) utilizes a model trained in a source language to make predictions in another language, often with a performance loss. To alleviate this, additional improvements can be achieved through subsequent…

Computation and Language · Computer Science 2024-04-04 Emilio Villa-Cueva , A. Pastor López-Monroy , Fernando Sánchez-Vega , Thamar Solorio

ICD coding from electronic clinical records is a manual, time-consuming and expensive process. Code assignment is, however, an important task for billing purposes and database organization. While many works have studied the problem of…

Computation and Language · Computer Science 2020-11-18 Arthur D. Reys , Danilo Silva , Daniel Severo , Saulo Pedro , Marcia M. de Souza e Sá , Guilherme A. C. Salgado

Automatic ICD coding, the task of assigning disease and procedure codes to electronic medical records, is crucial for clinical documentation and billing. While existing methods primarily enhance model understanding of code hierarchies and…

Computation and Language · Computer Science 2025-11-11 Tuan-Dung Le , Shohreh Haddadan , Thanh Q. Thieu

Automatically associating ICD codes with electronic health data is a well-known NLP task in medical research. NLP has evolved significantly in recent years with the emergence of pre-trained language models based on Transformers…

Computation and Language · Computer Science 2023-04-07 Yakini Tchouka , Jean-François Couchot , David Laiymani , Philippe Selles , Azzedine Rahmani

Large language models (LLMs) excel at a range of tasks through in-context learning (ICL), where only a few task examples guide their predictions. However, prior research highlights that LLMs often overlook input-label mapping information in…

Computation and Language · Computer Science 2025-06-10 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Yancheng Yuan , Dacheng Tao

Multimodal Large Language Models (MLLMs) have achieved great success in Speech-to-Text Translation (S2TT) tasks. However, current research is constrained by two key challenges: language coverage and efficiency. Most of the popular S2TT…

Computation and Language · Computer Science 2026-04-14 Yexing Du , Kaiyuan Liu , Youcheng Pan , Bo Yang , Keqi Deng , Xie Chen , Yang Xiang , Ming Liu , Bing Qin , YaoWei Wang

The capability of in-context learning (ICL) enables large language models (LLMs) to perform novel tasks without parameter updates by conditioning on a few input-output examples. However, collecting high-quality examples for new or…

Artificial Intelligence · Computer Science 2025-10-29 Zihan Chen , Song Wang , Xingbo Fu , Chengshuai Shi , Zhenyu Lei , Cong Shen , Jundong Li

International Classification of Diseases (ICD) are the de facto codes used globally for clinical coding. These codes enable healthcare providers to claim reimbursement and facilitate efficient storage and retrieval of diagnostic…

Computation and Language · Computer Science 2022-02-22 Pavithra Rajendran , Alexandros Zenonos , Josh Spear , Rebecca Pope

Accurate diagnostic coding of medical notes is crucial for enhancing patient care, medical research, and error-free billing in healthcare organizations. Manual coding is a time-consuming task for providers, and diagnostic codes often…

Machine Learning · Computer Science 2024-12-17 Prajwal Kailas , Max Homilius , Rahul C. Deo , Calum A. MacRae

Cross-lingual transfer (CLT) is of various applications. However, labeled cross-lingual corpus is expensive or even inaccessible, especially in the fields where labels are private, such as diagnostic results of symptoms in medicine and user…

Computation and Language · Computer Science 2022-06-15 Yinpeng Guo , Liangyou Li , Xin Jiang , Qun Liu

In this paper, we introduce a speech-conditioned Large Language Model (LLM) integrated with a Mixture of Experts (MoE) based connector to address the challenge of Code-Switching (CS) in Automatic Speech Recognition (ASR). Specifically, we…

Sound · Computer Science 2024-11-01 Fengrun Zhang , Wang Geng , Hukai Huang , Yahui Shan , Cheng Yi , He Qu

Clinical trials are critical for advancing medical treatments but remain prohibitively expensive and time-consuming. Accurate prediction of clinical trial outcomes can significantly reduce research and development costs and accelerate drug…

Machine Learning · Computer Science 2025-06-06 Fengze Liu , Haoyu Wang , Joonhyuk Cho , Dan Roth , Andrew W. Lo