English
Related papers

Related papers: Graph-Text Multi-Modal Pre-training for Medical Re…

200 papers

Learning joint embedding space for various modalities is of vital importance for multimodal fusion. Mainstream modality fusion approaches fail to achieve this goal, leaving a modality gap which heavily affects cross-modal fusion. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Sijie Mai , Haifeng Hu , Songlong Xing

Pre-trained models, e.g., from ImageNet, have proven to be effective in boosting the performance of many downstream applications. It is too demanding to acquire large-scale annotations to build such models for medical imaging. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xiaosong Wang , Ziyue Xu , Leo Tam , Dong Yang , Daguang Xu

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Hybrid question answering (HybridQA) over the financial report contains both textual and tabular data, and requires the model to select the appropriate evidence for the numerical reasoning task. Existing methods based on encoder-decoder…

Computation and Language · Computer Science 2023-05-08 Yifan Wei , Fangyu Lei , Yuanzhe Zhang , Jun Zhao , Kang Liu

Medical vision-language pretraining models (VLPM) have achieved remarkable progress in fusing chest X-rays (CXR) with clinical texts, introducing image-text data binding approaches that enable zero-shot learning and downstream clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuan Gao , Sangwook Kim , David E Austin , Chris McIntosh

In this paper, we present our approach to extracting structured information from unstructured Electronic Health Records (EHR) [2] which can be used to, for example, study adverse drug reactions in patients due to chemicals in their…

Computation and Language · Computer Science 2020-01-30 Amogh Kamat Tarcar , Aashis Tiwari , Vineet Naique Dhaimodker , Penjo Rebelo , Rahul Desai , Dattaraj Rao

The integration of graphs with Goal-conditioned Hierarchical Reinforcement Learning (GCHRL) has recently gained attention, as intermediate goals (subgoals) can be effectively sampled from graphs that naturally represent the overall task…

Machine Learning · Computer Science 2025-11-17 Shuyuan Zhang , Zihan Wang , Xiao-Wen Chang , Doina Precup

Self-supervised learning methods for medical images primarily rely on the imaging modality during pretraining. While such approaches deliver promising results, they do not leverage associated patient or scan information collected within…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Saeed Shurrab , Alejandro Guerra-Manzanares , Farah E. Shamout

Medical tabular data, abundant in Electronic Health Records (EHRs), is a valuable resource for diverse medical tasks such as risk prediction. While deep learning approaches, particularly transformer-based models, have shown remarkable…

Computation and Language · Computer Science 2025-04-11 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

Large-scale EHR prediction across institutions is hindered by substantial heterogeneity in schemas and code systems. Although Common Data Models (CDMs) can standardize records for multi-institutional learning, the manual harmonization and…

Computation and Language · Computer Science 2026-04-02 Kyunghoon Hur , Heeyoung Kwak , Jinsu Jang , Nakhwan Kim , Edward Choi

Building generalizable medical AI systems requires pretraining strategies that are data-efficient and domain-aware. Unlike internet-scale corpora, clinical datasets such as MIMIC-CXR offer limited image counts and scarce annotations, but…

Spatio-temporal trajectories provide valuable information about movement and travel behavior, enabling various downstream tasks that in turn power real-world applications. Learning trajectory embeddings can improve task performance but may…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yan Lin , Huaiyu Wan , Shengnan Guo , Jilin Hu , Christian S. Jensen , Youfang Lin

Forecasting how a patient's condition is likely to evolve, including possible deterioration, recovery, treatment needs, and care transitions, could support more proactive and personalized care, but requires modeling heterogeneous and…

Machine Learning · Computer Science 2026-03-26 Chantal Pellegrini , Ege Özsoy , David Bani-Harouni , Matthias Keicher , Nassir Navab

Electronic Health Record (EHR) provides abundant information through various modalities. However, learning multi-modal EHR is currently facing two major challenges, namely, 1) data embedding and 2) cases with missing modality. A lack of…

Machine Learning · Computer Science 2023-05-05 Kwanhyung Lee , Soojeong Lee , Sangchul Hahn , Heejung Hyun , Edward Choi , Byungeun Ahn , Joohyung Lee

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

Artificial Intelligence · Computer Science 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

Machine Learning · Computer Science 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy

The wide implementation of electronic health record (EHR) systems facilitates the collection of large-scale health data from real clinical settings. Despite the significant increase in adoption of EHR systems, this data remains largely…

Quantitative Methods · Quantitative Biology 2018-10-26 Jinghe Zhang , Kamran Kowsari , James H. Harrison , Jennifer M. Lobo , Laura E. Barnes

Electronic health records (EHRs) are usually highly dimensional, heterogeneous, and multimodal. Besides, the random recording of clinical variables results in high missing rates and uneven time intervals between adjacent records in the…

Machine Learning · Computer Science 2022-10-14 Ningtao Liu , Ruoxi Gao , Jing Yuan , Calire Park , Shuwei Xing , Shuiping Gou

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Understanding molecular structure and related knowledge is crucial for scientific research. Recent studies integrate molecular graphs with their textual descriptions to enhance molecular representation learning. However, they focus on the…

Artificial Intelligence · Computer Science 2025-06-02 Yibo Li , Yuan Fang , Mengmei Zhang , Chuan Shi