English
Related papers

Related papers: Graph-Text Multi-Modal Pre-training for Medical Re…

200 papers

Electrocardiograms (ECGs) are widely used non-invasive measurements of cardiac activity and play a central role in clinical diagnosis. Recent multimodal approaches align ECG signals with clinical reports to incorporate diagnostic semantics,…

Existing pre-trained models for knowledge-graph-to-text (KG-to-text) generation simply fine-tune text-to-text pre-trained models such as BART or T5 on KG-to-text datasets, which largely ignore the graph structure during encoding and lack…

Computation and Language · Computer Science 2021-06-22 Pei Ke , Haozhe Ji , Yu Ran , Xin Cui , Liwei Wang , Linfeng Song , Xiaoyan Zhu , Minlie Huang

Electronic medical record (EMR) data contains historical sequences of visits of patients, and each visit contains rich information, such as patient demographics, hospital utilisation and medical codes, including diagnosis, procedure and…

Machine Learning · Computer Science 2020-07-24 Bhagya Hettige , Yuan-Fang Li , Weiqing Wang , Suong Le , Wray Buntine

The growing adoption of electronic health record (EHR) systems has provided unprecedented opportunities for predictive modeling to guide clinical decision making. Structured EHRs contain longitudinal observations of patients across hospital…

Machine Learning · Computer Science 2026-03-12 Deyi Li , Zijun Yao , Qi Xu , Muxuan Liang , Lingyao Li , Zijian Xu , Mei Liu

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Learning efficient representations for concepts has been proven to be an important basis for many applications such as machine translation or document classification. Proper representations of medical concepts such as diagnosis, medication,…

Machine Learning · Computer Science 2016-02-18 Edward Choi , Mohammad Taha Bahadori , Elizabeth Searles , Catherine Coffey , Jimeng Sun

In real-world scenarios, texts in a graph are often linked by multiple semantic relations (e.g., papers in an academic graph are referenced by other publications, written by the same author, or published in the same venue), where text…

Computation and Language · Computer Science 2024-07-16 Bowen Jin , Wentao Zhang , Yu Zhang , Yu Meng , Han Zhao , Jiawei Han

Electronic Health Records (EHRs), which contain patients' medical histories in various multi-modal formats, often overlook the potential for joint reasoning across imaging and table modalities underexplored in current EHR Question Answering…

Computation and Language · Computer Science 2023-12-27 Seongsu Bae , Daeun Kyung , Jaehee Ryu , Eunbyeol Cho , Gyubok Lee , Sunjun Kweon , Jungwoo Oh , Lei Ji , Eric I-Chao Chang , Tackeun Kim , Edward Choi

Electronic health record (EHR) systems contain a wealth of multimodal clinical data including structured data like clinical codes and unstructured data such as clinical notes. However, many existing EHR-focused studies has traditionally…

Machine Learning · Statistics 2025-08-20 Tianxi Cai , Feiqing Huang , Ryumei Nakada , Linjun Zhang , Doudou Zhou

Deep-learning-based clinical decision support using structured electronic health records (EHR) has been an active research area for predicting risks of mortality and diseases. Meanwhile, large amounts of narrative clinical notes provide…

Computation and Language · Computer Science 2023-05-10 Weimin Lyu , Xinyu Dong , Rachel Wong , Songzhu Zheng , Kayley Abell-Hart , Fusheng Wang , Chao Chen

Benefiting from the powerful expressive capability of graphs, graph-based approaches have been popularly applied to handle multi-modal medical data and achieved impressive performance in various biomedical applications. For disease…

Machine Learning · Computer Science 2022-03-14 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yuchen Yang , Yao Zhao

Electronic health records (EHR) are widely believed to hold a profusion of actionable insights, encrypted in an irregular, semi-structured format, amidst a loud noise background. To simplify learning patterns of health and disease, medical…

Computation and Language · Computer Science 2022-12-13 David A. Bloore , Romane Gauriau , Anna L. Decker , Jacob Oppenheim

Universal graph pre-training has emerged as a key paradigm in graph representation learning, offering a promising way to train encoders to learn transferable representations from unlabeled graphs and to effectively generalize across a wide…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Yongqi Huang , Zhiyong Feng , Weixiong Zhang

Electronic health records (EHRs) are rich clinical data sources but complex repositories of patient data, spanning structured elements (demographics, vitals, lab results, codes), unstructured clinical notes and other modalities of data.…

Artificial Intelligence · Computer Science 2025-08-25 Sonish Sivarajkumar , Hang Zhang , Yuelyu Ji , Maneesh Bilalpur , Xizhi Wu , Chenyu Li , Min Gu Kwak , Shyam Visweswaran , Yanshan Wang

Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used…

Machine Learning · Computer Science 2019-09-23 Wei-Hung Weng , Peter Szolovits

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiological signals but lack…

Machine Learning · Computer Science 2026-01-21 Yuanyun Zhang , Han Zhou , Li Feng , Yilin Hong , Shi Li

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti

Electronic Health Records (EHRs) contain rich, longitudinal patient information across structured (e.g., labs, vitals, and imaging) and unstructured (e.g., clinical notes) modalities. While deep learning models such as RNNs and Transformers…

Machine Learning · Computer Science 2026-02-18 Mohammad Al Olaimat , Shaika Chowdhury , Serdar Bozdag

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

Machine Learning · Computer Science 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova