English
Related papers

Related papers: Graph-Text Multi-Modal Pre-training for Medical Re…

200 papers

The integration of multimodal Electronic Health Records (EHR) data has significantly advanced clinical predictive capabilities. Existing models, which utilize clinical notes and multivariate time-series EHR data, often fall short of…

Computation and Language · Computer Science 2025-02-27 Yinghao Zhu , Changyu Ren , Zixiang Wang , Xiaochen Zheng , Shiyun Xie , Junlan Feng , Xi Zhu , Zhoujun Li , Liantao Ma , Chengwei Pan

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing medical concepts.…

Machine Learning · Computer Science 2022-03-21 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

Multimodal electronic health record (EHR) data can offer a holistic assessment of a patient's health status, supporting various predictive healthcare tasks. Recently, several studies have embraced the multitask learning approach in the…

Machine Learning · Computer Science 2024-06-19 Muhao Xu , Zhenfeng Zhu , Youru Li , Shuai Zheng , Yawei Zhao , Kunlun He , Yao Zhao

Clinical language models have achieved strong performance on downstream tasks by pretraining on domain specific corpora such as discharge summaries and medical notes. However, most approaches treat the electronic health record as a static…

Computation and Language · Computer Science 2025-04-28 Tatsunori Tanaka , Fi Zheng , Kai Sato , Zhifeng Li , Yuanyun Zhang , Shi Li

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive embeddings for various applications such as retrieval,…

Deep learning models have shown tremendous potential in learning representations, which are able to capture some key properties of the data. This makes them great candidates for transfer learning: Exploiting commonalities between different…

The widespread adoption of electronic health records has created new opportunities for translational clinical research, yet this promise remains constrained by fragmented data across privacy-siloed institutions and substantial heterogeneity…

Electronic Health Records (EHRs) provide rich longitudinal clinical evidence that is central to medical decision-making, motivating the use of retrieval-augmented generation (RAG) to ground large language model (LLM) predictions. However,…

Artificial Intelligence · Computer Science 2026-01-30 Lang Cao , Qingyu Chen , Yue Guo

Effective modeling of electronic health records presents many challenges as they contain large amounts of irregularity most of which are due to the varying procedures and diagnosis a patient may have. Despite the recent progress in machine…

Machine Learning · Computer Science 2019-10-07 Sajad Darabi , Mohammad Kachuee , Majid Sarrafzadeh

Due to the increasing adoption of electronic health records (EHR), large scale EHRs have become another rich data source for translational clinical research. Despite its potential, deriving generalizable knowledge from EHR data remains…

Machine Learning · Statistics 2023-06-01 Junwei Lu , Jin Yin , Tianxi Cai

Pretraining molecular representations is crucial for drug and material discovery. Recent methods focus on learning representations from geometric structures, effectively capturing 3D position information. Yet, they overlook the rich…

Machine Learning · Computer Science 2024-11-19 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

Structured text understanding on Visually Rich Documents (VRDs) is a crucial part of Document Intelligence. Due to the complexity of content and layout in VRDs, structured text understanding has been a challenging task. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Yulin Li , Yuxi Qian , Yuchen Yu , Xiameng Qin , Chengquan Zhang , Yan Liu , Kun Yao , Junyu Han , Jingtuo Liu , Errui Ding

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

Multimodal datasets contain an enormous amount of relational information, which grows exponentially with the introduction of new modalities. Learning representations in such a scenario is inherently complex due to the presence of multiple…

Machine Learning · Computer Science 2019-09-24 Devanshu Arya , Stevan Rudinac , Marcel Worring

Electronic health record (EHR) foundation models have been an area ripe for exploration with their improved performance in various medical tasks. Despite the rapid advances, there exists a fundamental limitation: Processing unseen medical…

Artificial Intelligence · Computer Science 2025-08-15 Junmo Kim , Namkyeong Lee , Jiwon Kim , Kwangsoo Kim

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

One of the cardinal tasks in achieving robust medical question answering systems is textual entailment. The existing approaches make use of an ensemble of pre-trained language models or data augmentation, often to clock higher numbers on…

Computation and Language · Computer Science 2020-11-11 Shweta Yadav , Vishal Pallagani , Amit Sheth