English
Related papers

Related papers: M2EF-NNs: Multimodal Multi-instance Evidence Fusio…

200 papers

Survival prediction of cancers is crucial for clinical practice, as it informs mortality risks and influences treatment plans. However, a static model trained on a single dataset fails to adapt to the dynamically evolving clinical…

Machine Learning · Computer Science 2026-01-21 Dianzhi Yu , Conghao Xiong , Yankai Chen , Wenqian Cui , Xinni Zhang , Yifei Zhang , Hao Chen , Joseph J. Y. Sung , Irwin King

Multi-modal MR imaging is routinely used in clinical practice to diagnose and investigate brain tumors by providing rich complementary information. Previous multi-modal MRI segmentation methods usually perform modal fusion by concatenating…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Zhaohu Xing , Lequan Yu , Liang Wan , Tong Han , Lei Zhu

Background: This research aims to improve glioblastoma survival prediction by integrating MR images, clinical and molecular-pathologic data in a transformer-based deep learning model, addressing data heterogeneity and performance…

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Survival prediction for esophageal squamous cell cancer (ESCC) is crucial for doctors to assess a patient's condition and tailor treatment plans. The application and development of multi-modal deep learning in this field have attracted…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Chengyu Wu , Yatao Zhang , Yaqi Wang , Qifeng Wang , Shuai Wang

Recently, deep learning methods have been widely used for tumor segmentation of multimodal medical images with promising results. However, most existing methods are limited by insufficient representational ability, specific modality number…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jun Shi , Hongyu Kan , Shulan Ruan , Ziqi Zhu , Minfan Zhao , Liang Qiao , Zhaohui Wang , Hong An , Xudong Xue

Accurate survival prediction in oncology requires integrating diverse imaging modalities to capture the complex interplay of tumor biology. Traditional single-modality approaches often fail to leverage the complementary insights provided by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ho Hin Lee , Alberto Santamaria-Pang , Jameson Merkov , Matthew Lungren , Ivan Tarapov

Accurate prognosis of non-small cell lung cancer (NSCLC) patients undergoing immunotherapy is essential for personalized treatment planning, enabling informed patient decisions, and improving both treatment outcomes and quality of life.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Bingxin Gong , Lian Yang , Junqing Yu , Wei Yang

Pulmonary nodules are an early sign of lung cancer, and detecting them early is vital for improving patient survival rates. Most current methods use only single Computed Tomography (CT) images to assess nodule malignancy. However, doctors…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Yin Shen , Zhaojie Fang , Ke Zhuang , Guanyu Zhou , Xiao Yu , Yucheng Zhao , Yuan Tian , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan , Ahmed Elazab

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

We propose a novel multimodal deep learning framework for patient-level survival prediction, which integrates whole-slide histology features, RNA-seq expression profiles, and clinical variables. Our architecture combines an ABMIL…

Quantitative Methods · Quantitative Biology 2026-05-15 Hassan Keshvarikhojasteh , Josien P. W. Pluim , Mitko Veta

Accurate survival prediction is critical in oncology for prognosis and treatment planning. Traditional approaches often rely on a single data modality, limiting their ability to capture the complexity of tumor biology. To address this…

Machine Learning · Computer Science 2025-07-11 Alba Garrido , Alejandro Almodóvar , Patricia A. Apellániz , Juan Parras , Santiago Zazo

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

This paper primarily addresses a dataset relating to cellular, chemical and physical conditions of patients gathered at the time they are operated upon to remove colorectal tumours. This data provides a unique insight into the biochemical…

Machine Learning · Computer Science 2016-11-17 Christopher Roadknight , Durga Suryanarayanan , Uwe Aickelin , John Scholefield , Lindy Durrant

Continuous dimensional emotion prediction is a challenging task where the fusion of various modalities usually achieves state-of-the-art performance such as early fusion or late fusion. In this paper, we propose a novel multi-modal fusion…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Shizhe Chen , Qin Jin

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Head and Neck Squamous Cell Carcinoma (HNSCC) is one of cancer type that is most distressing leading to acute pain, effecting speech and primary survival functions such as swallowing and breathing. The morbidity and mortality of HNSCC…

Genomics · Quantitative Biology 2021-05-18 Saurav Mandal , Akshansh Gupta , Waribam Pratibha Chanu

Survival prediction is a major concern for cancer management. Deep survival models based on deep learning have been widely adopted to perform end-to-end survival prediction from medical images. Recent deep survival models achieved promising…

Image and Video Processing · Electrical Eng. & Systems 2024-10-17 Mingyuan Meng , Bingxin Gu , Michael Fulham , Shaoli Song , Dagan Feng , Lei Bi , Jinman Kim

Breast cancer is a significant health concern affecting millions of women worldwide. Accurate survival risk stratification plays a crucial role in guiding personalised treatment decisions and improving patient outcomes. Here we present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen