English
Related papers

Related papers: Multi-Modal Contrastive Learning for Online Clinic…

200 papers

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Survival analysis plays a crucial role in many healthcare decisions, where the risk prediction for the events of interest can support an informative outlook for a patient's medical journey. Given the existence of data censoring, an…

Machine Learning · Computer Science 2023-09-29 Mohsen Nayebi Kerdabadi , Arya Hadizadeh Moghaddam , Bin Liu , Mei Liu , Zijun Yao

With large-scale well-labeled datasets, deep learning has shown significant success in medical image segmentation. However, it is challenging to acquire abundant annotations in clinical practice due to extensive expertise requirements and…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Ziyuan Zhao , Jinxuan Hu , Zeng Zeng , Xulei Yang , Peisheng Qian , Bharadwaj Veeravalli , Cuntai Guan

In this paper, we introduce a novel Multi-Modal Contrastive Pre-training Framework that synergistically combines X-rays, electrocardiograms (ECGs), and radiology/cardiology reports. Our approach leverages transformers to encode these…

Artificial Intelligence · Computer Science 2024-10-24 Samrajya Thapa , Koushik Howlader , Subhankar Bhattacharjee , Wei le

Multifold observations are common for different data modalities, e.g., a 3D shape can be represented by multi-view images and an image can be described with different captions. Existing cross-modal contrastive representation learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Ye Wang , Bowei Jiang , Changqing Zou , Rui Ma

Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded in the longand…

Machine Learning · Computer Science 2019-08-27 Luchen Liu , Haoran Li , Zhiting Hu , Haoran Shi , Zichang Wang , Jian Tang , Ming Zhang

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another.…

Machine Learning · Computer Science 2021-05-18 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Early identification of patients at risk for clinical deterioration in the intensive care unit (ICU) remains a critical challenge. Delayed recognition of impending adverse events, including mortality, vasopressor initiation, and mechanical…

Machine Learning · Computer Science 2026-03-17 Binesh Sadanandan

Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time intervals. Dealing with…

Machine Learning · Computer Science 2023-06-07 Xinlu Zhang , Shiyang Li , Zhiyu Chen , Xifeng Yan , Linda Petzold

Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acuity settings such as the ICU. This has driven the development of machine learning models…

Machine Learning · Computer Science 2026-04-21 Zhongyuan Liang , Junhyung Jo , Hyang-Jung Lee , Sang Kyu Kim , Irene Y. Chen

Advancements in technologies related to working with omics data require novel computation methods to fully leverage information and help develop a better understanding of human diseases. This paper studies the effects of introducing graph…

Genomics · Quantitative Biology 2023-10-17 Nishant Rajadhyaksha , Aarushi Chitkara

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

Machine Learning · Computer Science 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

In recent years, there has been a notable increase in the use of supervised detection methods of major depressive disorder (MDD) based on electroencephalogram (EEG) signals. However, the process of labeling MDD remains challenging. As a…

Machine Learning · Computer Science 2025-12-17 Li-Xuan Zhao , Chen-Yang Xu , Wen-Qiang Li , Bo Wang , Rong-Xing Wei , Qing-Hao Menga

Human action recognition (HAR) with multi-modal inputs (RGB-D, skeleton, point cloud) can achieve high accuracy but typically relies on large labeled datasets and degrades sharply when sensors fail or are noisy. We present Robust…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Hasan Akgul , Mari Eplik , Javier Rojas , Akira Yamamoto , Rajesh Kumar , Maya Singh

Unsupervised learning of disease subtypes from multi-omics data presents a significant opportunity for advancing personalized medicine. We introduce OmicsCL, a modular contrastive learning framework that jointly embeds heterogeneous omics…

Machine Learning · Computer Science 2025-05-02 Atahan Karagoz

Early identification of intensive care patients at risk of in-hospital mortality enables timely intervention and efficient resource allocation. Despite high predictive performance, existing machine learning approaches lack transparency and…

Machine Learning · Computer Science 2025-11-21 Alexander Bakumenko , Janine Hoelscher , Hudson Smith

In the high-stakes realm of healthcare, ensuring fairness in predictive models is crucial. Electronic Health Records (EHRs) have become integral to medical decision-making, yet existing methods for enhancing model fairness restrict…

Machine Learning · Computer Science 2024-08-06 Yuqing Wang , Malvika Pillai , Yun Zhao , Catherine Curtin , Tina Hernandez-Boussard

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei