English
Related papers

Related papers: Multimodal Feature Prototype Learning for Interpre…

200 papers

Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

Cancer survival prediction is an active area of research that can help prevent unnecessary therapies and improve patient's quality of life. Gene expression profiling is being widely used in cancer studies to discover informative biomarkers…

Machine Learning · Computer Science 2016-11-18 Hamid Reza Hassanzadeh , John H. Phan , May D. Wang

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

Major pathological response (pR) following neoadjuvant therapy is a clinically meaningful endpoint in non-small cell lung cancer, strongly associated with improved survival. However, accurate preoperative prediction of pR remains…

Thyroid nodule classification using ultrasound imaging is essential for early diagnosis and clinical decision-making; however, despite promising performance on in-distribution data, existing deep learning methods often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yangmei Chen , Zhongyuan Zhang , Xikun Zhang , Xinyu Hao , Mingliang Hou , Renqiang Luo , Ziqi Xu

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood

Survival prediction, utilizing pathological images and genomic profiles, is increasingly important in cancer analysis and prognosis. Despite significant progress, precise survival analysis still faces two main challenges: (1) The massive…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Songhan Jiang , Zhengyu Gan , Linghan Cai , Yifeng Wang , Yongbing Zhang

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

For multi-modal magnetic resonance (MR) brain tumor image segmentation, current methods usually directly extract the discriminative features from input images for tumor sub-region category determination and localization. However, the impact…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Yafei Zhang , Zhiyuan Li , Huafeng Li , Dapeng Tao

Motivation. Understanding the pan-cancer mutational landscape offers critical insights into the molecular mechanisms underlying tumorigenesis. While patient-level machine learning techniques have been widely employed to identify tumor…

Machine Learning · Computer Science 2025-08-29 Yifan Dou , Adam Khadre , Ruben C Petreaca , Golrokh Mirzaei

Multimodal recommendation aims to enhance user preference modeling by leveraging rich item content such as images and text. Yet dominant systems fuse modalities in the spatial domain, obscuring the frequency structure of signals and…

Information Retrieval · Computer Science 2026-02-02 Wei Yang , Rui Zhong , Yiqun Chen , Shixuan Li , Heng Ping , Chi Lu , Peng Jiang

Statistical inference on the cancer-site specificities of collective ultra-rare whole genome somatic mutations is an open problem. Traditional statistical methods cannot handle whole-genome mutation data due to their…

Methodology · Statistics 2023-01-02 Saptarshi Chakraborty , Zoe Guan , Colin B. Begg , Ronglai Shen

Prostate cancer is one of the leading causes of cancer-related death in men worldwide. Like many cancers, diagnosis involves expert integration of heterogeneous patient information such as imaging, clinical risk factors, and more. For this…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Gregory Holste , Douwe van der Wal , Hans Pinckaers , Rikiya Yamashita , Akinori Mitani , Andre Esteva

The diverse nature of protein prediction tasks has traditionally necessitated specialized models, hindering the development of broadly applicable and computationally efficient Protein Language Models (PLMs). In this work, we introduce…

Cancers are characterized by remarkable heterogeneity and diverse prognosis. Accurate cancer classification is essential for patient stratification and clinical decision-making. Although digital pathology has been advancing cancer diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Xiaofei Wang , Hanyu Liu , Yupei Zhang , Boyang Zhao , Hao Duan , Wanming Hu , Yonggao Mou , Stephen Price , Chao Li

Melanoma represents a critical health risk due to its aggressive progression and high mortality, underscoring the need for early, interpretable diagnostic tools. While deep learning has advanced in skin lesion classification, most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ciro Listone , Aniello Murano

Accurate and reliable histopathological image classification is essential for breast cancer diagnosis. However, many deep learning models remain sensitive to magnification variability and lack interpretability. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Enam Ahmed Taufika , Md Ahasanul Arafatha , Abhijit Kumar Ghoshb , Md. Tanzim Rezab , Md Ashad Alamc

The clinical adoption of biomedical vision-language models is hindered by prompt optimization techniques that produce either uninterpretable latent vectors or single textual prompts. This lack of transparency and failure to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Kaushitha Silva , Mansitha Eashwara , Sanduni Ubayasiri , Ruwan Tennakoon , Damayanthi Herath

Cancer detection and prognosis relies heavily on medical imaging, particularly CT and PET scans. Deep Neural Networks (DNNs) have shown promise in tumor segmentation by fusing information from these modalities. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Numan Saeed , Shahad Hardan , Muhammad Ridzuan , Nada Saadi , Karthik Nandakumar , Mohammad Yaqub

Prediction of survival in patients diagnosed with a brain tumour is challenging because of heterogeneous tumour behaviours and responses to treatment. Better estimations of prognosis would support treatment planning and patient support.…

Machine Learning · Computer Science 2021-06-18 Colleen E. Charlton , Michael Tin Chung Poon , Paul M. Brennan , Jacques D. Fleuriot