中文
相关论文

相关论文: AMMASurv: Asymmetrical Multi-Modal Attention for A…

200 篇论文

Multimodal survival analysis aims to combine heterogeneous data sources (e.g., clinical, imaging, text, genomics) to improve the prediction quality of survival outcomes. However, this task is particularly challenging due to high…

机器学习 · 计算机科学 2024-12-03 Ling Huang , Yucheng Xing , Qika Lin , Su Ruan , Mengling Feng

Accurate survival prediction is essential for personalised cancer treatment. We propose ModalSurv, a multimodal deep survival framework integrating clinical, MRI, histopathology, and RNA-sequencing data via modality-specific projections and…

机器学习 · 计算机科学 2025-12-19 Noorul Wahab , Ethar Alzaid , Jiaqi Lv , Fayyaz Minhas , Adam Shephard , Shan E Ahmed Raza

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

图像与视频处理 · 电气工程与系统科学 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

定量方法 · 定量生物学 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

Survival analysis holds a crucial role across diverse disciplines, such as economics, engineering and healthcare. It empowers researchers to analyze both time-invariant and time-varying data, encompassing phenomena like customer churn,…

Histo-genomic multimodal survival prediction has garnered growing attention for its remarkable model performance and potential contributions to precision medicine. However, a significant challenge in clinical practice arises when only…

机器学习 · 计算机科学 2025-03-17 Fengchun Liu , Linghan Cai , Zhikang Wang , Zhiyuan Fan , Jin-gang Yu , Hao Chen , Yongbing Zhang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

图像与视频处理 · 电气工程与系统科学 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Accurate survival prediction in oncology requires integrating diverse imaging modalities to capture the complex interplay of tumor biology. Traditional single-modality approaches often fail to leverage the complementary insights provided by…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Ho Hin Lee , Alberto Santamaria-Pang , Jameson Merkov , Matthew Lungren , Ivan Tarapov

With the increasing availability of diverse data types, particularly images and time series data from medical experiments, there is a growing demand for techniques designed to combine various modalities of data effectively. Our motivation…

图像与视频处理 · 电气工程与系统科学 2024-05-27 Ali Rasekh , Reza Heidari , Amir Hosein Haji Mohammad Rezaie , Parsa Sharifi Sedeh , Zahra Ahmadi , Prasenjit Mitra , Wolfgang Nejdl

Whole Slide Images (WSIs) are critical for various clinical applications, including histopathological analysis. However, current deep learning approaches in this field predominantly focus on individual tumor types, limiting model…

图像与视频处理 · 电气工程与系统科学 2024-09-18 Sharon Peled , Yosef E. Maruvka , Moti Freiman

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

图像与视频处理 · 电气工程与系统科学 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

图像与视频处理 · 电气工程与系统科学 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Oncologists often rely on a multitude of data, including whole-slide images (WSIs), to guide therapeutic decisions, aiming for the best patient outcome. However, predicting the prognosis of cancer patients can be a challenging task due to…

图像与视频处理 · 电气工程与系统科学 2025-04-01 M Rita Verdelho , Alexandre Bernardino , Catarina Barata

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

The goal of multimodal summarization is to extract the most important information from different modalities to form output summaries. Unlike the unimodal summarization, the multimodal summarization task explicitly leverages cross-modal…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Bo He , Jun Wang , Jielin Qiu , Trung Bui , Abhinav Shrivastava , Zhaowen Wang

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…