English
Related papers

Related papers: Multimodal data matters: language model pre-traini…

200 papers

Multimodal irregular time series (MITS) consist of asynchronous and irregularly sampled observations from heterogeneous numerical and textual channels. In healthcare, for example, patients' electronic health records (EHR) include irregular…

Machine Learning · Computer Science 2026-05-14 Hsing-Huan Chung , Shijun Li , Yoav Wald , Xing Han , Suchi Saria , Joydeep Ghosh

Healthcare systems generate diverse multimodal data, including Electronic Health Records (EHR), clinical notes, and medical images. Effectively leveraging this data for clinical prediction is challenging, particularly as real-world samples…

Machine Learning · Computer Science 2025-09-01 Xiaoyang Wang , Christopher C. Yang

Multimodal machine learning (MML) is rapidly reshaping the way mental-health disorders are detected, characterized, and longitudinally monitored. Whereas early studies relied on isolated data streams -- such as speech, text, or wearable…

Machine Learning · Computer Science 2025-06-25 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

Electronic Health Record (EHR) tables pose unique challenges among which is the presence of hidden contextual dependencies between medical features with a high level of data dimensionality and sparsity. This study presents the first…

Computation and Language · Computer Science 2025-01-17 Jesus Lovon , Martin Mouysset , Jo Oleiwan , Jose G. Moreno , Christine Damase-Michel , Lynda Tamine

Language modeling have shown impressive progress in generating compelling text with good accuracy and high semantic coherence. An interesting research direction is to augment these powerful models for specific applications using contextual…

Computation and Language · Computer Science 2023-04-05 Sabri Boughorbel , Fethi Jarray , Abdulaziz Al Homaid , Rashid Niaz , Khalid Alyafei

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information…

Machine Learning · Computer Science 2018-08-16 Jingshu Liu , Zachariah Zhang , Narges Razavian

Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time intervals. Dealing with…

Machine Learning · Computer Science 2023-06-07 Xinlu Zhang , Shiyang Li , Zhiyu Chen , Xifeng Yan , Linda Petzold

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

Multimodal electronic health record (EHR) data can offer a holistic assessment of a patient's health status, supporting various predictive healthcare tasks. Recently, several studies have embraced the multitask learning approach in the…

Machine Learning · Computer Science 2024-06-19 Muhao Xu , Zhenfeng Zhu , Youru Li , Shuai Zheng , Yawei Zhao , Kunlun He , Yao Zhao

The shift to electronic medical records (EMRs) has engendered research into machine learning and natural language technologies to analyze patient records, and to predict from these clinical outcomes of interest. Two observations motivate…

Computation and Language · Computer Science 2019-04-09 Sarthak Jain , Ramin Mohammadi , Byron C. Wallace

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

The application of the Multi-modal Large Language Models (MLLMs) in medical clinical scenarios remains underexplored. Previous benchmarks only focus on the capacity of the MLLMs in medical visual question-answering (VQA) or report…

Computation and Language · Computer Science 2024-08-19 Hongcheng Liu , Yusheng Liao , Siqv Ou , Yuhao Wang , Heyang Liu , Yanfeng Wang , Yu Wang

Accurate clinical prognosis requires synthesizing structured Electronic Health Records (EHRs) with real-time physiological signals like the Electrocardiogram (ECG). Large Language Models (LLMs) offer a powerful reasoning engine for this…

Machine Learning · Computer Science 2026-01-27 Jialu Tang , Tong Xia , Yuan Lu , Aaqib Saeed

Accessing longitudinal multimodal Electronic Healthcare Records (EHRs) is challenging due to privacy concerns, which hinders the use of ML for healthcare applications. Synthetic EHRs generation bypasses the need to share sensitive real…

Computation and Language · Computer Science 2022-11-04 Zifeng Wang , Jimeng Sun

Disease risk prediction has attracted increasing attention in the field of modern healthcare, especially with the latest advances in artificial intelligence (AI). Electronic health records (EHRs), which contain heterogeneous patient…

Artificial Intelligence · Computer Science 2022-01-19 Shuai Niu , Qing Yin , Yunya Song , Yike Guo , Xian Yang

Recently, the performance of Pre-trained Language Models (PLMs) has been significantly improved by injecting knowledge facts to enhance their abilities of language understanding. For medical domains, the background knowledge sources are…

Computation and Language · Computer Science 2021-08-23 Taolin Zhang , Zerui Cai , Chengyu Wang , Minghui Qiu , Bite Yang , Xiaofeng He

Pre-consultation is a critical component of effective healthcare delivery. However, generating comprehensive pre-consultation questionnaires from complex, voluminous Electronic Medical Records (EMRs) is a challenging task. Direct Large…

Artificial Intelligence · Computer Science 2025-08-04 Ruiqing Ding , Qianfang Sun , Yongkang Leng , Hui Yin , Xiaojian Li

Electronic health records (EHRs), digital collections of patient healthcare events and observations, are ubiquitous in medicine and critical to healthcare delivery, operations, and research. Despite this central role, EHRs are notoriously…

Electronic health record (EHR) data is sparse and irregular as it is recorded at irregular time intervals, and different clinical variables are measured at each observation point. In this work, we propose a multi-view features integration…

Machine Learning · Computer Science 2021-01-27 Yurim Lee , Eunji Jun , Heung-Il Suk

The extraction of relevant data from Electronic Health Records (EHRs) is crucial to identifying symptoms and automating epidemiological surveillance processes. By harnessing the vast amount of unstructured text in EHRs, we can detect…

Computation and Language · Computer Science 2025-02-10 Juliano Genari , Guilherme Tegoni Goedert