English
Related papers

Related papers: Graph-Text Multi-Modal Pre-training for Medical Re…

200 papers

Increasingly large electronic health records (EHRs) provide an opportunity to algorithmically learn medical knowledge. In one prominent example, a causal health knowledge graph could learn relationships between diseases and symptoms and…

Applications · Statistics 2019-10-04 Irene Y. Chen , Monica Agrawal , Steven Horng , David Sontag

The advent of the Internet era has led to an explosive growth in the Electronic Health Records (EHR) in the past decades. The EHR data can be regarded as a collection of clinical events, including laboratory results, medication records,…

Machine Learning · Computer Science 2019-11-14 Zichang Wang , Haoran Li , Luchen Liu , Haoxian Wu , Ming Zhang

Recent approaches in literature have exploited the multi-modal information in documents (text, layout, image) to serve specific downstream document tasks. However, they are limited by their - (i) inability to learn cross-modal…

Computation and Language · Computer Science 2022-01-06 Subhojeet Pramanik , Shashank Mujumdar , Hima Patel

Text-attributed graphs (TAGs) present unique challenges in representation learning by requiring models to capture both the semantic richness of node-associated texts and the structural dependencies of the graph. While graph neural networks…

Computation and Language · Computer Science 2026-05-26 Azadeh Beiranvand , Seyed Mehdi Vahidipour

Multi-task learning (MTL) is a machine learning technique aiming to improve model performance by leveraging information across many tasks. It has been used extensively on various data modalities, including electronic health record (EHR)…

Machine Learning · Computer Science 2020-07-21 Matthew B. A. McDermott , Bret Nestor , Evan Kim , Wancong Zhang , Anna Goldenberg , Peter Szolovits , Marzyeh Ghassemi

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

Machine Learning · Computer Science 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

Computation and Language · Computer Science 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

Objective: Temporal electronic health records (EHRs) can be a wealth of information for secondary uses, such as clinical events prediction or chronic disease management. However, challenges exist for temporal data representation. We…

Machine Learning · Computer Science 2024-06-11 Feng Xie , Han Yuan , Yilin Ning , Marcus Eng Hock Ong , Mengling Feng , Wynne Hsu , Bibhas Chakraborty , Nan Liu

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

Clinical Reasoning on Electronic Health Records (EHRs) is a fundamental yet challenging task in modern healthcare. While in-context learning (ICL) offers a promising inference-time adaptation paradigm for large language models (LLMs) in EHR…

Machine Learning · Computer Science 2026-04-09 Yue Fang , Weibin Liao , Yuxin Guo , Jiaran Gao , Hongxin Ding , Jinyang Zhang , Xinke Jiang , Zhibang Yang , Junfeng Zhao , Yasha Wang , Liantao Ma

Generating synthetic Electronic Health Records (EHRs) offers significant potential for data augmentation, privacy-preserving data sharing, and improving machine learning model training. We propose a novel tokenization strategy tailored for…

Machine Learning · Computer Science 2024-11-21 Hojjat Karami , David Atienza , Anisoara Ionescu

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

Clinicians spend a significant amount of time inputting free-form textual notes into Electronic Health Records (EHR) systems. Much of this documentation work is seen as a burden, reducing time spent with patients and contributing to…

Computation and Language · Computer Science 2018-08-09 Peter J. Liu

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Joint image-text embedding extracted from medical images and associated contextual reports is the bedrock for most biomedical vision-and-language (V+L) tasks, including medical visual question answering, clinical image-text retrieval,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Yikuan Li , Hanyin Wang , Yuan Luo

Patient similarity assessment, which identifies patients similar to a given patient, can help improve medical care. The assessment can be performed using Electronic Medical Records (EMRs). Patient similarity measurement requires converting…

Information Retrieval · Computer Science 2022-09-20 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Longitudinal data in electronic health records (EHRs) represent an individual`s clinical history through a sequence of codified concepts, including diagnoses, procedures, medications, and laboratory tests. Generative pre-trained…

The recent advancement of pre-trained Transformer models has propelled the development of effective text mining models across various biomedical tasks. However, these models are primarily learned on the textual data and often lack the…

Computation and Language · Computer Science 2021-07-02 Sriram Pingali , Shweta Yadav , Pratik Dutta , Sriparna Saha