English
Related papers

Related papers: mmid: Multi-Modal Integration and Downstream analy…

200 papers

Developing predictive modelling solutions for risk estimation is extremely challenging in health-care informatics. Risk estimation involves integration of heterogeneous clinical sources having different representation from different…

Machine Learning · Computer Science 2016-09-30 Priyanka H U , Vivek R

Molecular dynamics (MD) simulations provide atomistic insights into the structure, dynamics, and function of biomolecules by generating time-resolved, high-dimensional trajectories. Analyzing such data benefits from estimating the minimal…

Biomolecules · Quantitative Biology 2026-03-02 Irene Cazzaniga , Toni Giorgino

We introduce MM-Mixing, a multi-modal mixing alignment framework for 3D understanding. MM-Mixing applies mixing-based methods to multi-modal data, preserving and optimizing cross-modal connections while enhancing diversity and improving…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaze Wang , Yi Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

When modeling complex, hierarchical, and time-dynamic systems, such as biological systems, good computational tools are essential. Current tools, while powerful, often lack comprehensive frameworks for modular model composition,…

Quantitative Methods · Quantitative Biology 2025-10-17 Henrik Podéus , Gustav Magnusson , Sasan Keshmiri , Kajsa Tunedal , Nicolas Sundqvist , William Lövfors , Gunnar Cedersund

Chronic liver disease represents a significant health challenge worldwide and accurate prognostic evaluations are essential for personalized treatment plans. Recent evidence suggests that integrating multimodal data, such as computed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Linglong Wu , Xuhao Shan , Ruiquan Ge , Ruoyu Liang , Chi Zhang , Yonghong Li , Ahmed Elazab , Huoling Luo , Yunbi Liu , Changmiao Wang

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Purpose High dimensional, multimodal data can nowadays be analyzed by huge deep neural networks with little effort. Several fusion methods for bringing together different modalities have been developed. Given the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Christian Gapp , Elias Tappeiner , Martin Welk , Karl Fritscher , Elke Ruth Gizewski , Rainer Schubert

Medical multi-modal learning is critical for integrating information from a large set of diverse modalities. However, when leveraging a high number of modalities in real clinical applications, it is often impractical to obtain full-modality…

Machine Learning · Computer Science 2026-03-03 Chenwei Wu , Zitao Shuai , Liyue Shen

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator. As real world data suffers from both local…

Machine Learning · Computer Science 2022-03-07 Manik Kuchroo , Abhinav Godavarthi , Alexander Tong , Guy Wolf , Smita Krishnaswamy

Medical image analysis increasingly relies on the integration of multiple imaging modalities to capture complementary anatomical and functional information, enabling more accurate diagnosis and treatment planning. Achieving aligned feature…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Yunhao Liu , Suyang Xi , Shiqi Liu , Hong Ding , Chicheng Jin , Chong Zhong , Junjun He , Catherine C. Liu , Yiqing Shen

Myocardial Infarction (MI) has the highest mortality of all cardiovascular diseases (CVDs). Detection of MI and information regarding its occurrence-time in particular, would enable timely interventions that may improve patient outcomes,…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Girmaw Abebe Tadesse , Hamza Javed , Yong Liu , Jin Liu , Jiyan Chen , Komminist Weldemariam , Tingting Zhu

Multi-modal medical image fusion (MMIF) is increasingly recognized as an essential technique for enhancing diagnostic precision and facilitating effective clinical decision-making within computer-aided diagnosis systems. MMIF combines data…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Muhammad Zubair , Muzammil Hussai , Mousa Ahmad Al-Bashrawi , Malika Bendechache , Muhammad Owais

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Summary: ipd is an open-source R software package for the downstream modeling of an outcome and its associated features where a potentially sizable portion of the outcome data has been imputed by an artificial intelligence or machine…

The adoption of digital systems in healthcare has resulted in the accumulation of vast electronic health records (EHRs), offering valuable data for machine learning methods to predict patient health outcomes. However, single-visit records…

Machine Learning · Computer Science 2024-11-19 Eric Yang , Pengfei Hu , Xiaoxue Han , Yue Ning

Routine clinical visits of a patient produce not only image data, but also non-image data containing clinical information regarding the patient, i.e., medical data is multi-modal in nature. Such heterogeneous modalities offer different and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sein Kim , Namkyeong Lee , Junseok Lee , Dongmin Hyun , Chanyoung Park

The freud Python package is a powerful library for analyzing simulation data. Written with modern simulation and data analysis workflows in mind, freud provides a Python interface to fast, parallelized C++ routines that run efficiently on…

Multi-modality images have been widely used and provide comprehensive information for medical image analysis. However, acquiring all modalities among all institutes is costly and often impossible in clinical settings. To leverage more…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Qi Chang , Hui Qu , Zhennan Yan , Yunhe Gao , Lohendran Baskaran , Dimitris Metaxas

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou