English
Related papers

Related papers: A Unified Model for Longitudinal Multi-Modal Multi…

200 papers

In longitudinal studies using routinely collected data, such as electronic health records (EHRs), patients tend to have more measurements when they are unwell; this informative observation pattern may lead to bias. While semi-parametric…

Methodology · Statistics 2024-10-02 Rose Garrett , Brian Feldman , Eleanor Pullenayegum

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Chronic diseases such as diabetes pose significant management challenges, particularly due to the risk of complications like hypoglycemia, which require timely detection and intervention. Continuous health monitoring through wearable…

Machine Learning · Computer Science 2026-01-08 Vaibhav Gupta , Florian Grensing , Beyza Cinar , Maria Maleshkova

Knee osteoarthritis (KOA) diagnosis from radiographs remains challenging due to the subtle morphological details that standard deep learning models struggle to capture effectively. We propose a novel multimodal framework that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Marouane Tliba , Mohamed Amine Kerkouri , Yassine Nasser , Nour Aburaed , Aladine Chetouani , Ulas Bagci , Rachid Jennane

In various biomedical studies, analysis often focuses on data magnitudes, particularly when algebraic signs are irrelevant or lost. For repeated measures studies involving magnitude outcomes, incorporating random effects is essential as…

Methodology · Statistics 2025-07-16 Wen Teng , Niall D. Ferguson , Ewan C. Goligher , Anna Heath

Electronic Health Records present a valuable modality for driving personalized medicine, where treatment is tailored to fit individual-level differences. For this purpose, many data-driven machine learning and statistical models rely on the…

Machine Learning · Computer Science 2024-12-16 Ghadeer O. Ghosheh , Jin Li , Tingting Zhu

Routine clinical visits of a patient produce not only image data, but also non-image data containing clinical information regarding the patient, i.e., medical data is multi-modal in nature. Such heterogeneous modalities offer different and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sein Kim , Namkyeong Lee , Junseok Lee , Dongmin Hyun , Chanyoung Park

Despite the recent success of Multimodal Large Language Models (MLLMs), existing approaches predominantly assume the availability of multiple modalities during training and inference. In practice, multimodal data is often incomplete because…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Divyam Madaan , Sumit Chopra , Kyunghyun Cho

Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Wanyu Bian , Qingchao Zhang , Xiaojing Ye , Yunmei Chen

Medical data range from genomic sequences and retinal photographs to structured laboratory results and unstructured clinical narratives. Although these modalities appear disparate, many encode convergent information about a single…

Quantitative Methods · Quantitative Biology 2025-06-06 Salil Patel

Multimodal data encountered in real-world scenarios are typically of low quality, with noisy modalities and missing modalities being typical forms that severely hinder model performance and robustness. However, prior works often handle…

Machine Learning · Computer Science 2026-03-04 Sijie Mai , Shiqin Han , Haifeng Hu

With the widespread of machine learning models for healthcare applications, there is increased interest in building applications for personalized medicine. Despite the plethora of proposed research for personalized medicine, very few focus…

Machine Learning · Computer Science 2024-02-27 Ghadeer O. Ghosheh , Jin Li , Tingting Zhu

The presence of missing values often reflects variations in data collection policies, which may shift across time or locations, even when the underlying feature distribution remains stable. Such shifts in the missingness distribution…

Machine Learning · Statistics 2025-08-15 Jihye Lee , Minseo Kang , Dongha Kim

In the traditional framework of spectral learning of stochastic time series models, model parameters are estimated based on trajectories of fully recorded observations. However, real-world time series data often contain missing values, and…

Machine Learning · Computer Science 2018-10-22 Tianlin Liu

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

Multimodal clinical prediction faces three challenges: multiple foundation models (FMs) with complementary strengths per modality, pervasive missing modalities at training and test time, and sample-specific variation in modality…

Machine Learning · Computer Science 2026-05-19 Seungik Cho , Anqi Li , Wei Qiu

Biomechanics and human movement research often involves measuring multiple kinematic or kinetic variables regularly throughout a movement, yielding data that present as smooth, multivariate, time-varying curves and are naturally amenable to…

In this paper we propose a novel method for the segmentation of longitudinal brain MRI scans of patients suffering from Multiple Sclerosis. The method builds upon an existing cross-sectional method for simultaneous whole-brain and lesion…

Image and Video Processing · Electrical Eng. & Systems 2021-01-05 Stefano Cerri , Andrew Hoopes , Douglas N. Greve , Mark Mühlau , Koen Van Leemput

Missing data is a ubiquitous problem. It is especially challenging in medical settings because many streams of measurements are collected at different - and often irregular - times. Accurate estimation of those missing measurements is…

Machine Learning · Computer Science 2017-11-27 Jinsung Yoon , William R. Zame , Mihaela van der Schaar