English
Related papers

Related papers: iMD4GC: Incomplete Multimodal Data Integration to …

200 papers

Accurate prediction of protein-ligand binding affinity plays a pivotal role in accelerating the discovery of novel drugs and vaccines, particularly for gastrointestinal (GI) diseases such as gastric ulcers, Crohn's disease, and ulcerative…

Machine Learning · Computer Science 2025-11-11 Ziyang Gao , Annie Cheung , Yihao Ou

Artificial intelligence holds strong potential to support clinical decision making in intensive care units where timely and accurate risk assessment is critical. However, many existing models focus on isolated outcomes or limited data…

Generalist Medical AI (GMAI) systems have demonstrated expert-level performance in biomedical perception tasks, yet their clinical utility remains limited by inadequate multi-modal explainability and suboptimal prognostic capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Honglong Yang , Shanshan Song , Yi Qin , Lehan Wang , Haonan Wang , Xinpeng Ding , Qixiang Zhang , Bodong Du , Xiaomeng Li

Cancer clinics capture disease data at various scales, from genetic to organ level. Current bioinformatic methods struggle to handle the heterogeneous nature of this data, especially with missing modalities. We propose PARADIGM, a Graph…

Cell Behavior · Quantitative Biology 2024-11-22 Asim Waqas , Aakash Tripathi , Paul Stewart , Mia Naeini , Matthew B. Schabath , Ghulam Rasool

Multi-modal knowledge graph completion (MMKGC) aims to predict the missing triples in the multi-modal knowledge graphs by incorporating structural, visual, and textual information of entities into the discriminant models. The information…

Artificial Intelligence · Computer Science 2024-02-26 Yichi Zhang , Zhuo Chen , Lei Liang , Huajun Chen , Wen Zhang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic…

Machine Learning · Computer Science 2025-02-04 Jie Peng , Shuang Zhou , Longwei Yang , Yiran Song , Mohan Zhang , Kaixiong Zhou , Feng Xie , Mingquan Lin , Rui Zhang , Tianlong Chen

Purpose: Immunotherapies have revolutionized the landscape of cancer treatments. However, our understanding of response patterns in advanced cancers treated with immunotherapy remains limited. By leveraging routinely collected noninvasive…

Pacreatic ductal adenocarcinoma (PDAC) remains one of the most lethal forms of cancer, with a five-year survival rate below 10% primarily due to late detection. This research develops and validates a deep learning framework for early PDAC…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Dennis Slobodzian , Amir Kordijazi

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

Pancreatic ductal adenocarcinoma (PDAC) is the third most common cause of cancer death in the United States. Predicting tumors like PDACs (including both classification and segmentation) from medical images by deep learning is becoming a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yan Wang , Peng Tang , Yuyin Zhou , Wei Shen , Elliot K. Fishman , Alan L. Yuille

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Aim: This study investigates treatment response prediction to neoadjuvant chemotherapy (NACT) in breast cancer patients, using longitudinal contrast-enhanced magnetic resonance images (CE-MRI) and clinical data. The goal is to develop…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Rahul Ravi , Ruizhe Li , Tarek Abdelfatah , Stephen Chan , Xin Chen

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Ovarian cancer is the most lethal gynecologic malignancy: around 60% of patients are diagnosed at an advanced stage, with an associated 5-year survival rate of about 30%. Early identification of non-responders to neoadjuvant chemotherapy…

Gastric cancer is one of the most commonly diagnosed cancers and has a high mortality rate. Due to limited medical resources, developing machine learning models for gastric cancer recognition provides an efficient solution for medical…

Machine Learning · Computer Science 2025-03-21 Yuxin Miao , Xinyuan Yang , Hongda Fan , Yichun Li , Yishu Hong , Xiechen Guo , Ali Braytee , Weidong Huang , Ali Anaissi

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

During the first wave of COVID-19, hospitals were overwhelmed with the high number of admitted patients. An accurate prediction of the most likely individual disease progression can improve the planning of limited resources and finding the…