English
Related papers

Related papers: TTMFN: Two-stream Transformer-based Multimodal Fus…

200 papers

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimodal information…

Artificial Intelligence · Computer Science 2023-03-21 Xinhang Li , Xiangyu Zhao , Jiaxing Xu , Yong Zhang , Chunxiao Xing

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Accurate and interpretable survival analysis remains a core challenge in oncology. With growing multimodal data and the clinical need for transparent models to support validation and trust, this challenge increases in complexity. We propose…

Artificial Intelligence · Computer Science 2025-09-29 Mafalda Malafaia , Peter A. N. Bosman , Coen Rasch , Tanja Alderliesten

While attention-based approaches have shown considerable progress in enhancing image fusion and addressing the challenges posed by long-range feature dependencies, their efficacy in capturing local features is compromised by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Jingjing Liu , Li Zhang , Xiaoyang Zeng , Wanquan Liu , Jianhua Zhang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Early and accurate prediction of overall survival (OS) time can help to obtain better treatment planning for brain tumor patients. Although many OS time prediction methods have been developed and obtain promising results, there are still…

Image and Video Processing · Electrical Eng. & Systems 2020-07-16 Tao Zhou , Huazhu Fu , Yu Zhang , Changqing Zhang , Xiankai Lu , Jianbing Shen , Ling Shao

Depression is a serious mental health illness that significantly affects an individual's well-being and quality of life, making early detection crucial for adequate care and treatment. Detecting depression is often difficult, as it is based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Md Rezwanul Haque , Md. Milon Islam , S M Taslim Uddin Raju , Hamdi Altaheri , Lobna Nassar , Fakhri Karray

Breast cancer is a significant health concern affecting millions of women worldwide. Accurate survival risk stratification plays a crucial role in guiding personalised treatment decisions and improving patient outcomes. Here we present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

This paper primarily addresses a dataset relating to cellular, chemical and physical conditions of patients gathered at the time they are operated upon to remove colorectal tumours. This data provides a unique insight into the biochemical…

Machine Learning · Computer Science 2016-11-17 Christopher Roadknight , Durga Suryanarayanan , Uwe Aickelin , John Scholefield , Lindy Durrant

Cancer survival prediction using multi-modal medical imaging presents a critical challenge in oncology, mainly due to the vulnerability of deep learning models to noise and protocol variations across imaging centers. Current approaches…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Aiman Farooq , Azad Singh , Deepak Mishra , Santanu Chaudhury

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space…

Machine Learning · Computer Science 2023-11-07 Vinitra Swamy , Malika Satayeva , Jibril Frej , Thierry Bossy , Thijs Vogels , Martin Jaggi , Tanja Käser , Mary-Anne Hartley

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

The Cancer Genome Atlas (TCGA) has enabled novel discoveries and served as a large-scale reference dataset in cancer through its harmonized genomics, clinical, and imaging data. Numerous prior studies have developed bespoke deep learning…

Machine Learning · Computer Science 2026-05-11 Steven Song , Morgan Borjigin-Wang , Irene Madejski , Robert L. Grossman

Accurate prognosis of non-small cell lung cancer (NSCLC) patients undergoing immunotherapy is essential for personalized treatment planning, enabling informed patient decisions, and improving both treatment outcomes and quality of life.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Bingxin Gong , Lian Yang , Junqing Yu , Wei Yang

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Accurate beam prediction is essential for maintaining reliable links and high spectral efficiency in dynamic low-altitude wireless networks. However, existing approaches often fail to capture the deep correlations across heterogeneous…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Xiaotong Zhao , Yuanhao Cui , Weijie Yuan , Ziye Jia , Heng Liu , Chengwen Xing

The integration of pathologic images and genomic data for survival analysis has gained increasing attention with advances in multimodal learning. However, current methods often ignore biological characteristics, such as heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Shuaiyu Zhang , Xun Lin , Rongxiang Zhang , Yu Bai , Yong Xu , Tao Tan , Xunbin Zheng , Zitong Yu