English
Related papers

Related papers: Temporal Entailment Pretraining for Clinical Langu…

200 papers

Electronic Health Records (EHRs) offer considerable potential for clinical prediction, but their complexity and heterogeneity challenge traditional machine learning. Domain-specific EHR foundation models trained on unlabeled EHR data have…

One of the cardinal tasks in achieving robust medical question answering systems is textual entailment. The existing approaches make use of an ensemble of pre-trained language models or data augmentation, often to clock higher numbers on…

Computation and Language · Computer Science 2020-11-11 Shweta Yadav , Vishal Pallagani , Amit Sheth

Text embeddings have become an essential part of a variety of language applications. However, methods for interpreting, exploring and reversing embedding spaces are limited, reducing transparency and precluding potentially valuable…

Computation and Language · Computer Science 2026-01-27 Brian Ondov , Chia-Hsuan Chang , Yujia Zhou , Mauro Giuffrè , Hua Xu

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei

Clinical trials are essential for drug development but often suffer from expensive, inaccurate and insufficient patient recruitment. The core problem of patient-trial matching is to find qualified patients for a trial, where patient…

Artificial Intelligence · Computer Science 2021-04-13 Xingyao Zhang , Cao Xiao , Lucas M. Glass , Jimeng Sun

Widespread adoption of electronic health records (EHRs) has fueled the development of using machine learning to build prediction models for various clinical outcomes. This process is often constrained by having a relatively small number of…

Computation and Language · Computer Science 2020-05-14 Ethan Steinberg , Ken Jung , Jason A. Fries , Conor K. Corbin , Stephen R. Pfohl , Nigam H. Shah

The data available in Electronic Health Records (EHRs) provides the opportunity to transform care, and the best way to provide better care for one patient is through learning from the data available on all other patients. Temporal modelling…

Computation and Language · Computer Science 2021-07-08 Zeljko Kraljevic , Anthony Shek , Daniel Bean , Rebecca Bendayan , James Teo , Richard Dobson

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information…

Machine Learning · Computer Science 2018-08-16 Jingshu Liu , Zachariah Zhang , Narges Razavian

Integrating multimodal Electronic Health Records (EHR) data, such as numerical time series and free-text clinical reports, has great potential in predicting clinical outcomes. However, prior work has primarily focused on capturing temporal…

Machine Learning · Computer Science 2025-11-10 Fuying Wang , Feng Wu , Yihan Tang , Lequan Yu

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

Clinical forecasting based on electronic medical records (EMR) can uncover the temporal correlations between patients' conditions and outcomes from sequences of longitudinal clinical measurements. In this work, we propose an…

Machine Learning · Computer Science 2019-12-05 Yuan Xue , Denny Zhou , Nan Du , Andrew Dai , Zhen Xu , Kun Zhang , Claire Cui

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

Improving large language models (LLMs) for electronic health record (EHR) reasoning is essential for enabling accurate and generalizable clinical predictions. While LLMs excel at medical text understanding, they underperform on EHR-based…

Artificial Intelligence · Computer Science 2025-08-20 Yue Fang , Yuxin Guo , Jiaran Gao , Hongxin Ding , Xinke Jiang , Weibin Liao , Yongxin Xu , Yinghao Zhu , Zhibang Yang , Liantao Ma , Junfeng Zhao , Yasha Wang

Electronic Health Records (EHR) have been heavily used in modern healthcare systems for recording patients' admission information to hospitals. Many data-driven approaches employ temporal features in EHR for predicting specific diseases,…

Machine Learning · Computer Science 2021-12-07 Chang Lu , Chandan K. Reddy , Yue Ning

The widespread adoption of electronic health records (EHRs) enables the acquisition of heterogeneous clinical data, spanning lab tests, vital signs, medications, and procedures, which offer transformative potential for artificial…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Mingcheng Zhu , Yu Liu , Zhiyao Luo , Tingting Zhu

Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded in the longand…

Machine Learning · Computer Science 2019-08-27 Luchen Liu , Haoran Li , Zhiting Hu , Haoran Shi , Zichang Wang , Jian Tang , Ming Zhang

In longitudinal electronic health records (EHRs), the event records of a patient are distributed over a long period of time and the temporal relations between the events reflect sufficient domain knowledge to benefit prediction tasks such…

Computation and Language · Computer Science 2020-06-16 Xueping Peng , Guodong Long , Tao Shen , Sen Wang , Jing Jiang , Michael Blumenstein

Effective clinical decision-making depends on iterative, multimodal reasoning across diverse sources of evidence. The recent emergence of multimodal reasoning models has significantly transformed the landscape of solving complex tasks.…

Computation and Language · Computer Science 2025-11-04 Zhongzhen Huang , Linjie Mu , Yakun Zhu , Xiangyu Zhao , Shaoting Zhang , Xiaofan Zhang

Electronic Health Records (EHRs) provide crucial information for clinical decision-making. However, their high-dimensionality, heterogeneity, and sparsity make clinical prediction challenging. Large Language Models (LLMs) allowed progress…

Computation and Language · Computer Science 2026-01-28 Jesus Lovon-Melgarejo , Jose G. Moreno , Christine Damase-Michel , Lynda Tamine