English
Related papers

Related papers: A Multi-modal Fusion Framework Based on Multi-task…

200 papers

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Iain Swift , JingHua Ye

Lung cancer has a high rate of recurrence in early-stage patients. Predicting the post-surgical recurrence in lung cancer patients has traditionally been approached using single modality information of genomics or radiology images. We…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Vaishnavi Subramanian , Minh N. Do , Tanveer Syeda-Mahmood

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Brain tumors analysis is important in timely diagnosis and effective treatment to cure patients. Tumor analysis is challenging because of tumor morphology like size, location, texture, and heteromorphic appearance in the medical images. In…

Image and Video Processing · Electrical Eng. & Systems 2022-02-14 Mirza Mumtaz Zahoor , Shahzad Ahmad Qureshi , Saddam Hussain Khan , Asifullah Khan

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

The goal of multi-modal learning is to use complimentary information on the relevant task provided by the multiple modalities to achieve reliable and robust performance. Recently, deep learning has led significant improvement in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Jaekyum Kim , Junho Koh , Yecheol Kim , Jaehyung Choi , Youngbae Hwang , Jun Won Choi

Motivation. Understanding the pan-cancer mutational landscape offers critical insights into the molecular mechanisms underlying tumorigenesis. While patient-level machine learning techniques have been widely employed to identify tumor…

Machine Learning · Computer Science 2025-08-29 Yifan Dou , Adam Khadre , Ruben C Petreaca , Golrokh Mirzaei

Accurate evaluation of the response of glioblastoma to therapy is crucial for clinical decision-making and patient management. The Response Assessment in Neuro-Oncology (RANO) criteria provide a standardized framework to assess patients'…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Daniil Tikhonov , Matheus Scatolin , Mohor Banerjee , Qiankun Ji , Ahmed Jaheen , Mostafa Salem , Abdelrahman Elsayed , Hu Wang , Sarim Hashmi , Mohammad Yaqub

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

Aims Late diagnosis of Oral Squamous Cell Carcinoma (OSCC) contributes significantly to its high global mortality rate, with over 50\% of cases detected at advanced stages and a 5-year survival rate below 50\% according to WHO statistics.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R

Cancer survival analysis commonly integrates information across diverse medical modalities to make survival-time predictions. Existing methods primarily focus on extracting different decoupled features of modalities and performing fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Huayi Wang , Haochao Ying , Yuyang Xu , Qibo Qiu , Cheng Zhang , Danny Z. Chen , Ying Sun , Jian Wu

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

When diagnosing the brain tumor, doctors usually make a diagnosis by observing multimodal brain images from the axial view, the coronal view and the sagittal view, respectively. And then they make a comprehensive decision to confirm the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yi Ding , Wei Zheng , Guozheng Wu , Ji Geng , Mingsheng Cao , Zhiguang Qin