中文
相关论文

相关论文: TTMFN: Two-stream Transformer-based Multimodal Fus…

200 篇论文

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Integrating the different data modalities of cancer patients can significantly improve the predictive performance of patient survival. However, most existing methods ignore the simultaneous utilization of rich semantic features at different…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Liangrui Pan , Yijun Peng , Yan Li , Yiyi Liang , Liwen Xu , Qingchun Liang , Shaoliang Peng

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Iain Swift , JingHua Ye

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Cancer survival prediction is an active area of research that can help prevent unnecessary therapies and improve patient's quality of life. Gene expression profiling is being widely used in cancer studies to discover informative biomarkers…

机器学习 · 计算机科学 2016-11-18 Hamid Reza Hassanzadeh , John H. Phan , May D. Wang

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, especially Long…

机器学习 · 计算机科学 2023-05-23 Sinan Rasiya Koya , Tirthankar Roy

Oral cancer is frequently diagnosed at later stages due to its similarity to other lesions. Existing research on computer aided diagnosis has made progress using deep learning; however, most approaches remain limited by small, imbalanced…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Joy Naoum , Revana Salama , Ali Hamdi

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

图像与视频处理 · 电气工程与系统科学 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Early cancer detection remains one of the most critical challenges in modern healthcare, where delayed diagnosis significantly reduces survival outcomes. Recent advancements in artificial intelligence, particularly deep learning, have…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Emmanuella Avwerosuoghene Oghenekaro

Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

Accurate tumor segmentation in PET/CT images is crucial for computer-aided cancer diagnosis and treatment. The primary challenge lies in effectively integrating the complementary information from PET and CT images. In clinical settings, the…

图像与视频处理 · 电气工程与系统科学 2025-01-03 Yuxuan Qi , Li Lin , Jiajun Wang , Bin Zhang , Jingya Zhang

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

信息检索 · 计算机科学 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

定量方法 · 定量生物学 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard

Accurate survival prediction is critical in oncology for prognosis and treatment planning. Traditional approaches often rely on a single data modality, limiting their ability to capture the complexity of tumor biology. To address this…

机器学习 · 计算机科学 2025-07-11 Alba Garrido , Alejandro Almodóvar , Patricia A. Apellániz , Juan Parras , Santiago Zazo

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Renal cell carcinoma represents a significant global health challenge with a low survival rate. This research aimed to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell…

计算机视觉与模式识别 · 计算机科学 2023-07-10 Maryamalsadat Mahootiha , Hemin Ali Qadir , Jacob Bergsland , Ilangko Balasingham

Survival prediction is a major concern for cancer management. Deep survival models based on deep learning have been widely adopted to perform end-to-end survival prediction from medical images. Recent deep survival models achieved promising…

图像与视频处理 · 电气工程与系统科学 2024-10-17 Mingyuan Meng , Bingxin Gu , Michael Fulham , Shaoli Song , Dagan Feng , Lei Bi , Jinman Kim