English
Related papers

Related papers: Multimodal data matters: language model pre-traini…

200 papers

Traditional diagnosis of chronic diseases involves in-person consultations with physicians to identify the disease. However, there is a lack of research focused on predicting and developing application systems using clinical notes and blood…

Software Engineering · Computer Science 2024-06-27 Chun-Chieh Liao , Wei-Ting Kuo , I-Hsuan Hu , Yen-Chen Shih , Jun-En Ding , Feng Liu , Fang-Ming Hung

Electronic Health Record (EHR) data encompass diverse modalities -- text, images, and medical codes -- that are vital for clinical decision-making. To process these complex data, multimodal AI (MAI) has emerged as a powerful approach for…

Machine Learning · Computer Science 2026-03-03 Nikkie Hooman , Zhongjie Wu , Eric C. Larson , Mehak Gupta

Learning efficient representations for concepts has been proven to be an important basis for many applications such as machine translation or document classification. Proper representations of medical concepts such as diagnosis, medication,…

Machine Learning · Computer Science 2016-02-18 Edward Choi , Mohammad Taha Bahadori , Elizabeth Searles , Catherine Coffey , Jimeng Sun

Accurate short-term mortality prediction in heart failure (HF) remains challenging, particularly when relying on structured electronic health record (EHR) data alone. We evaluate transformer-based models on a French HF cohort, comparing…

Computation and Language · Computer Science 2026-04-03 Oumaima El Khettari , Virgile Barthet , Guillaume Hocquet , Joconde Weller , Emmanuel Morin , Pierre Zweigenbaum

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Structured electronic health records (EHR) are essential for clinical prediction. While count-based learners continue to perform strongly on such data, no benchmarking has directly compared them against more recent mixture-of-agents LLM…

Artificial Intelligence · Computer Science 2025-11-04 Jifan Gao , Michael Rosenthal , Brian Wolpin , Simona Cristea

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Multimodal clinical records contain structured measurements and clinical notes recorded over time, offering rich temporal information about the evolution of patient health. Yet these observations are sparse, and whether they are recorded…

Machine Learning · Computer Science 2026-04-24 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

We introduce LLMD, a large language model designed to analyze a patient's medical history based on their medical records. Along with domain knowledge, LLMD is trained on a large corpus of records collected over time and across facilities,…

Biomedical documents such as Electronic Health Records (EHRs) contain a large amount of information in an unstructured format. The data in EHRs is a hugely valuable resource documenting clinical narratives and decisions, but whilst the text…

Computation and Language · Computer Science 2019-12-24 Zeljko Kraljevic , Daniel Bean , Aurelie Mascio , Lukasz Roguski , Amos Folarin , Angus Roberts , Rebecca Bendayan , Richard Dobson

Electronic health records (EHRs) contain valuable patient data for health-related prediction tasks, such as disease prediction. Traditional approaches rely on supervised learning methods that require large labeled datasets, which can be…

Computation and Language · Computer Science 2024-03-26 Hejie Cui , Zhuocheng Shen , Jieyu Zhang , Hui Shao , Lianhui Qin , Joyce C. Ho , Carl Yang

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…

Electronic health records (EHR) offer unprecedented opportunities for in-depth clinical phenotyping and prediction of clinical outcomes. Combining multiple data sources is crucial to generate a complete picture of disease prevalence,…

Computation and Language · Computer Science 2022-12-01 Anna Munoz-Farre , Harry Rose , Sera Aylin Cakiroglu

Electronic Health Records (EHR) are high-dimensional data with implicit connections among thousands of medical concepts. These connections, for instance, the co-occurrence of diseases and lab-disease correlations can be informative when…

Machine Learning · Computer Science 2021-03-29 Weicheng Zhu , Narges Razavian

Most biomedical pretrained language models are monolingual and cannot handle the growing cross-lingual requirements. The scarcity of non-English domain corpora, not to mention parallel data, poses a significant hurdle in training…

Computation and Language · Computer Science 2023-11-21 Lei Geng , Xu Yan , Ziqiang Cao , Juntao Li , Wenjie Li , Sujian Li , Xinjie Zhou , Yang Yang , Jun Zhang

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

The MIMIC-IV dataset is a large, publicly available electronic health record (EHR) resource widely used for clinical machine learning research. It comprises multiple modalities, including structured data, clinical notes, waveforms, and…

Machine Learning · Computer Science 2026-01-21 Farzana Islam Adiba , Varsha Danduri , Fahmida Liza Piya , Ali Abbasi , Mehak Gupta , Rahmatollah Beheshti

Electronic health records (EHRs) form an invaluable resource for training clinical decision support systems. To leverage the potential of such systems in high-risk applications, we need large, structured tabular datasets on which we can…

Artificial Intelligence · Computer Science 2025-11-24 Paloma Rabaey , Adrick Tench , Stefan Heytens , Thomas Demeester

Effective modeling of electronic health records (EHR) is rapidly becoming an important topic in both academia and industry. A recent study showed that using the graphical structure underlying EHR data (e.g. relationship between diagnoses…

Machine Learning · Computer Science 2020-01-22 Edward Choi , Zhen Xu , Yujia Li , Michael W. Dusenberry , Gerardo Flores , Yuan Xue , Andrew M. Dai