English
Related papers

Related papers: MedFuse: Multiplicative Embedding Fusion For Irreg…

200 papers

Deep learning models for medical data are typically trained using task specific objectives that encourage representations to collapse onto a small number of discriminative directions. While effective for individual prediction problems, this…

Machine Learning · Computer Science 2026-02-10 Yuanyun Zhang , Mingxuan Zhang , Siyuan Li , Zihan Wang , Haoran Chen , Wenbo Zhou , Shi Li

If unaligned multimodal medical images can be simultaneously aligned and fused using a single-stage approach within a unified processing framework, it will not only achieve mutual promotion of dual tasks but also help reduce the complexity…

Image and Video Processing · Electrical Eng. & Systems 2024-12-16 Huafeng Li , Dayong Su , Qing Cai , Yafei Zhang

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

The automated analysis of medical time series, such as the electrocardiogram (ECG), electroencephalogram (EEG), pulse oximetry, etc, has the potential to serve as a valuable tool for diagnostic decisions, allowing for remote monitoring of…

Electronic Health Record (EHR) provides abundant information through various modalities. However, learning multi-modal EHR is currently facing two major challenges, namely, 1) data embedding and 2) cases with missing modality. A lack of…

Machine Learning · Computer Science 2023-05-05 Kwanhyung Lee , Soojeong Lee , Sangchul Hahn , Heejung Hyun , Edward Choi , Byungeun Ahn , Joohyung Lee

Healthcare time series data is vital for monitoring patient activity but often contains noise and missing values due to various reasons such as sensor errors or data interruptions. Imputation, i.e., filling in the missing values, is a…

Machine Learning · Computer Science 2024-12-17 Lien P. Le , Xuan-Hien Nguyen Thi , Thu Nguyen , Michael A. Riegler , Pål Halvorsen , Binh T. Nguyen

Compared to images, videos better reflect real-world acquisition and possess valuable temporal cues. However, existing multi-sensor fusion research predominantly integrates complementary context from multiple images rather than videos due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Linfeng Tang , Yeda Wang , Meiqi Gong , Zizhuo Li , Yuxin Deng , Xunpeng Yi , Chunyu Li , Han Xu , Hao Zhang , Jiayi Ma

Modern electronic health records (EHRs) hold immense promise in tracking personalized patient health trajectories through sequential deep learning, owing to their extensive breadth, scale, and temporal granularity. Nonetheless, how to…

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiological signals but lack…

Machine Learning · Computer Science 2026-01-21 Yuanyun Zhang , Han Zhou , Li Feng , Yilin Hong , Shi Li

The use of multi-modal data for deep machine learning has shown promise when compared to uni-modal approaches with fusion of multi-modal features resulting in improved performance in several applications. However, most state-of-the-art…

Machine Learning · Computer Science 2020-10-26 Darshana Priyasad , Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Time series data in real-world applications such as healthcare, climate modeling, and finance are often irregular, multimodal, and messy, with varying sampling rates, asynchronous modalities, and pervasive missingness. However, existing…

Machine Learning · Computer Science 2025-10-16 Ching Chang , Jeehyun Hwang , Yidan Shi , Haixin Wang , Wen-Chih Peng , Tien-Fu Chen , Wei Wang

In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly…

Artificial Intelligence · Computer Science 2024-02-20 Mafalda Malafaia , Thalea Schlender , Peter A. N. Bosman , Tanja Alderliesten

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

Urban time series, such as mobility flows, energy consumption, and pollution records, encapsulate complex urban dynamics and structures. However, data collection in each city is impeded by technical challenges such as budget limitations and…

Machine Learning · Computer Science 2025-11-26 Tong Nie , Wei Ma , Jian Sun , Yu Yang , Jiannong Cao

The widespread application of Electronic Health Records (EHR) data in the medical field has led to early successes in disease risk prediction using deep learning methods. These methods typically require extensive data for training due to…

Machine Learning · Computer Science 2024-11-28 Shibo Li , Hengliang Cheng , Weihua Li

Multiscale entropy (MSE) has been a prevalent algorithm to quantify the complexity of fluctuations in the local mean value of biomedical time series. Recent developments in the field have tried to improve the MSE by reducing its variability…

Computational Engineering, Finance, and Science · Computer Science 2017-05-04 Hamed Azami , Alberto Fernandez , Javier Escudero

Reconstructing precise clinical timelines is essential for modeling patient trajectories and forecasting risk in complex, heterogeneous conditions like sepsis. While unstructured clinical narratives offer semantically rich and contextually…

Computation and Language · Computer Science 2026-05-15 Sayantan Kumar , Shahriar Noroozizadeh , Juyong Kim , Jeremy C. Weiss

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

In the past decade, with the development of big data technology, an increasing amount of patient information has been stored as electronic health records (EHRs). Leveraging these data, various doctor recommendation systems have been…

Information Retrieval · Computer Science 2022-07-14 Luning Bi , Yunlong Wang , Fan Zhang , Zhuqing Liu , Yong Cai , Emily Zhao

Machine learning for data-driven diagnosis has been actively studied in medicine to provide better healthcare. Supporting analysis of a patient cohort similar to a patient under treatment is a key task for clinicians to make decisions with…

Medical Physics · Physics 2020-03-25 Rongchen Guo , Takanori Fujiwara , Yiran Li , Kelly M. Lima , Soman Sen , Nam K. Tran , Kwan-Liu Ma