English
Related papers

Related papers: TMSS: An End-to-End Transformer-based Multimodal N…

200 papers

Survival prediction for esophageal squamous cell cancer (ESCC) is crucial for doctors to assess a patient's condition and tailor treatment plans. The application and development of multi-modal deep learning in this field have attracted…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Chengyu Wu , Yatao Zhang , Yaqi Wang , Qifeng Wang , Shuai Wang

With nearly one million new cases diagnosed worldwide in 2020, head \& neck cancer is a deadly and common malignity. There are challenges to decision making and treatment of such cancer, due to lesions in multiple locations and outcome…

Image and Video Processing · Electrical Eng. & Systems 2023-05-17 Angel Victor Juanco Muller , Joao F. C. Mota , Keith A. Goatman , Corne Hoogendoorn

In this work, we develop an attention convolutional neural network (CNN) to segment brain tumors from Magnetic Resonance Images (MRI). Further, we predict the survival rate using various machine learning methods. We adopt a 3D UNet…

Image and Video Processing · Electrical Eng. & Systems 2021-04-05 Mobarakol Islam , Vibashan VS , V Jeya Maria Jose , Navodini Wijethilake , Uppal Utkarsh , Hongliang Ren

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Past few years have witnessed the prevalence of deep learning in many application scenarios, among which is medical image processing. Diagnosis and treatment of brain tumors requires an accurate and reliable segmentation of brain tumors as…

Image and Video Processing · Electrical Eng. & Systems 2020-05-26 Feifan Wang , Runzhou Jiang , Liqin Zheng , Chun Meng , Bharat Biswal

Medical image segmentation, which aims to automatically extract anatomical or pathological structures, plays a key role in computer-aided diagnosis and disease analysis. Despite the problem has been widely studied, existing methods are…

Image and Video Processing · Electrical Eng. & Systems 2022-03-01 Han Zhang , Lok Ming Lui

Inspired by the recent success of Transformers for Natural Language Processing and vision Transformer for Computer Vision, many researchers in the medical imaging community have flocked to Transformer-based networks for various main stream…

Image and Video Processing · Electrical Eng. & Systems 2022-12-22 Ye Li , Junyu Chen , Se-in Jang , Kuang Gong , Quanzheng Li

Purpose: Immunotherapies have revolutionized the landscape of cancer treatments. However, our understanding of response patterns in advanced cancers treated with immunotherapy remains limited. By leveraging routinely collected noninvasive…

Survival prognosis is crucial for medical informatics. Practitioners often confront small-sized clinical data, especially cancer patient cases, which can be insufficient to induce useful patterns for survival predictions. This study deals…

Machine Learning · Computer Science 2025-01-23 Yonghao Zhao , Changtao Li , Chi Shu , Qingbin Wu , Hong Li , Chuan Xu , Tianrui Li , Ziqiang Wang , Zhipeng Luo , Yazhou He

Prediction of survival for cancer patients is an open area of research. However, many of these studies focus on datasets with a large number of patients. We present a novel method that is specifically designed to address the challenge of…

Machine Learning · Computer Science 2015-09-30 Hamid Reza Hassanzadeh , John H. Phan , May D. Wang

Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Yujiao Wu , Jie Ma , Xiaoshui Huang , Sai Ho Ling , Steven Weidong Su

Aims Late diagnosis of Oral Squamous Cell Carcinoma (OSCC) contributes significantly to its high global mortality rate, with over 50\% of cases detected at advanced stages and a 5-year survival rate below 50\% according to WHO statistics.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Deriving interpretable prognostic features from deep-learning-based prognostic histopathology models remains a challenge. In this study, we developed a deep learning system (DLS) for predicting disease specific survival for stage II and III…

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Iain Swift , JingHua Ye

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

Several deep learning algorithms have been developed to predict survival of cancer patients using whole slide images (WSIs).However, identification of image phenotypes within the WSIs that are relevant to patient survival and disease…

Image and Video Processing · Electrical Eng. & Systems 2022-11-30 Xingyu Li , Jitendra Jonnagaddala , Min Cen , Hong Zhang , Xu Steven Xu

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich