English
Related papers

Related papers: A Unified Model for Longitudinal Multi-Modal Multi…

200 papers

Joint models for longitudinal and time-to-event data are commonly used in longitudinal studies to forecast disease trajectories over time. While there are many advantages to joint modeling, the standard forms suffer from limitations that…

Machine Learning · Statistics 2019-09-09 Bryan Lim , Mihaela van der Schaar

Multimodal learning seeks to combine data from multiple input sources to enhance the performance of different downstream tasks. In real-world scenarios, performance can degrade substantially if some input modalities are missing. Existing…

Machine Learning · Computer Science 2024-10-10 Niki Nezakati , Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a single modeling perspective, either treating series data as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Liuqing Chen , Shuhong Xiao , Shixian Ding , Shanhai Hu , Lingyun Sun

During multimodal model training and testing, certain data modalities may be absent due to sensor limitations, cost constraints, privacy concerns, or data loss, negatively affecting performance. Multimodal learning techniques designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Renjie Wu , Hu Wang , Hsiang-Ting Chen , Gustavo Carneiro

Multiple imaging modalities are often used for disease diagnosis, prediction, or population-based analyses. However, not all modalities might be available due to cost, different study designs, or changes in imaging technology. If the…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Boqi Chen , Marc Niethammer

Ophthalmologists typically require multimodal data sources to improve diagnostic accuracy in clinical decisions. However, due to medical device shortages, low-quality data and data privacy concerns, missing data modalities are common in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chengzhi Liu , Zile Huang , Zhe Chen , Feilong Tang , Yu Tian , Zhongxing Xu , Zihong Luo , Yalin Zheng , Yanda Meng

An active challenge in developing multimodal machine learning (ML) models for healthcare is handling missing modalities during training and deployment. As clinical datasets are inherently temporal and sparse in terms of modality presence,…

Machine Learning · Computer Science 2026-05-08 Andrew Wang , Ellie Pavlick , Ritambhara Singh

Large longitudinal studies provide lots of valuable information, especially in medical applications. A problem which must be taken care of in order to utilize their full potential is that of correlation between intra-subject measurements…

Methodology · Statistics 2022-02-14 Martin Hanik , Hans-Christian Hege , Christoph von Tycowicz

Conventional inclusion criteria used in osteoarthritis clinical trials are not very effective in selecting patients who would benefit from a therapy being tested. Typically majority of selected patients show no or limited disease…

Medical multimodal learning faces significant challenges with missing modalities prevalent in clinical practice. Existing approaches assume equal contribution of modality and random missing patterns, neglecting inherent uncertainty in…

Machine Learning · Computer Science 2026-01-30 Linxiao Gong , Yang Liu , Lianlong Sun , Yulai Bi , Jing Liu , Xiaoguang Zhu

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

Multimodal electronic health record (EHR) data are widely used in clinical applications. Conventional methods usually assume that each sample (patient) is associated with the unified observed modalities, and all modalities are available for…

Machine Learning · Computer Science 2022-11-01 Chaohe Zhang , Xu Chu , Liantao Ma , Yinghao Zhu , Yasha Wang , Jiangtao Wang , Junfeng Zhao

Personalized longitudinal disease assessment is central to quickly diagnosing, appropriately managing, and optimally adapting the therapeutic strategy of multiple sclerosis (MS). It is also important for identifying the idiosyncratic…

Electronic health record (EHR) data is sparse and irregular as it is recorded at irregular time intervals, and different clinical variables are measured at each observation point. In this work, we propose a multi-view features integration…

Machine Learning · Computer Science 2021-01-27 Yurim Lee , Eunji Jun , Heung-Il Suk

Knee osteoarthritis (OA) is the most common musculoskeletal disease without a cure, and current treatment options are limited to symptomatic relief. Prediction of OA progression is a very challenging and timely issue, and it could, if…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Aleksei Tiulpin , Stefan Klein , Sita M. A. Bierma-Zeinstra , Jérôme Thevenot , Esa Rahtu , Joyce van Meurs , Edwin H. G. Oei , Simo Saarakkala

Musculoskeletal disorders represent a leading cause of global disability, creating an urgent demand for precise interpretation of medical imaging. Current artificial intelligence (AI) approaches in orthopedics predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Kang Yu , Dingyu Wang , Zimu Yuan , Nan Zhou , Jiajun Liu , Jiaxin Liu , Shanggui Liu , Yaoyan Zheng , Huishu Yuan , Di Huang , Dong Jiang

Longitudinal electronic health record (EHR) data offer opportunities to study biomarker trajectories; however, association estimates-the primary inferential target-from standard models designed for regular observation times may be biased by…

Methodology · Statistics 2026-02-18 Cheng-Han Yang , Xu Shi , Bhramar Mukherjee

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

Machine Learning · Computer Science 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

The era of big data has made vast amounts of clinical data readily available, particularly in the form of electronic health records (EHRs), which provides unprecedented opportunities for developing data-driven diagnostic tools to enhance…

Machine Learning · Computer Science 2025-03-06 Zekai Wang , Tieming Liu , Bing Yao

Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time intervals. Dealing with…

Machine Learning · Computer Science 2023-06-07 Xinlu Zhang , Shiyang Li , Zhiyu Chen , Xifeng Yan , Linda Petzold