English
Related papers

Related papers: Path-GPTOmic: A Balanced Multi-modal Learning Fram…

200 papers

Accurately predicting early recurrence in brain tumor patients following surgical resection remains a clinical challenge. This study proposes a multi-modal machine learning framework that integrates structural MRI features with clinical…

Machine Learning · Computer Science 2025-09-03 Cheng Cheng , Zeping Chen , Rui Xie , Peiyao Zheng , Xavier Wang

Surgery planning in patients diagnosed with brain tumor is dependent on their survival prognosis. A poor prognosis might demand for a more aggressive treatment and therapy plan, while a favorable prognosis might enable a less risky surgery…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Sobia Yousaf , Syed Muhammad Anwar , Harish RaviPrakash , Ulas Bagci

Drug optimization has become increasingly crucial in light of fast-mutating virus strains and drug-resistant cancer cells. Nevertheless, it remains challenging as it necessitates retaining the beneficial properties of the original drug…

Biomolecules · Quantitative Biology 2025-08-12 Xuefeng Liu , Songhao Jiang , Ian Foster , Jinbo Xu , Rick Stevens

Emerging research has highlighted that artificial intelligence-based multimodal fusion of digital pathology and transcriptomic features can improve cancer diagnosis (grading/subtyping) and prognosis (survival risk) prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Samiran Dey , Christopher R. S. Banerji , Partha Basuchowdhuri , Sanjoy K. Saha , Deepak Parashar , Tapabrata Chakraborti

The Cox Proportional Hazards (PH) model is widely used in survival analysis. Recently, artificial neural network (ANN)-based Cox-PH models have been developed. However, training these Cox models with high-dimensional features typically…

Machine Learning · Computer Science 2026-01-29 Anchen Sun , Zhibin Chen , Xiaodong Cai

Lung cancer has a high rate of recurrence in early-stage patients. Predicting the post-surgical recurrence in lung cancer patients has traditionally been approached using single modality information of genomics or radiology images. We…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Vaishnavi Subramanian , Minh N. Do , Tanveer Syeda-Mahmood

Background and Objective: Colorectal cancer is a high mortality cancer. Clinical data analysis plays a crucial role in predicting the survival of colorectal cancer patients, enabling clinicians to make informed treatment decisions. However,…

Machine Learning · Computer Science 2023-09-06 Sadegh Soleimani , Mahsa Bahrami , Mansour Vali

Survival prediction is a critical task in pathology. In clinical practice, pathologists often examine multiple cases, leveraging a broader spectrum of cancer phenotypes to enhance pathological assessment. Despite significant advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinyang Li , Yi Zhang , Yi Xie , Jianfei Yang , Xi Wang , Hao Chen , Haixian Zhang

Motivation: Identification of genomic, molecular and clinical markers prognostic of patient survival is important for developing personalized disease prevention, diagnostic and treatment approaches. Modern omics technologies have made it…

Applications · Statistics 2024-03-05 Zhi Zhao , John Zobolas , Manuela Zucknick , Tero Aittokallio

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Renal cell carcinoma represents a significant global health challenge with a low survival rate. This research aimed to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Maryamalsadat Mahootiha , Hemin Ali Qadir , Jacob Bergsland , Ilangko Balasingham

Cancer has relational information residing at varying scales, modalities, and resolutions of the acquired data, such as radiology, pathology, genomics, proteomics, and clinical records. Integrating diverse data types can improve the…

Machine Learning · Computer Science 2024-07-29 Asim Waqas , Aakash Tripathi , Ravi P. Ramachandran , Paul Stewart , Ghulam Rasool

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guillaume Jaume , Anurag Vaidya , Richard Chen , Drew Williamson , Paul Liang , Faisal Mahmood

Wide heterogeneity exists in cancer patients' survival, ranging from a few months to several decades. To accurately predict clinical outcomes, it is vital to build an accurate predictive model that relates patients' molecular profiles with…

Machine Learning · Statistics 2023-10-12 Yaohua Rong , Sihai Dave Zhao , Xia Zheng , Yi Li

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jiaqi Yang , Wenting Chen , Xiaohan Xing , Sean He , Xiaoling Luo , Xinheng Lyu , Linlin Shen , Guoping Qiu

Accurately predicting the treatment outcome plays a greatly important role in tailoring and adapting a treatment planning in cancer therapy. Although the development of different modalities and personalized medicine can greatly improve the…

Outcome prediction is crucial for head and neck cancer patients as it can provide prognostic information for early treatment planning. Radiomics methods have been widely used for outcome prediction from medical images. However, these…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Mingyuan Meng , Lei Bi , Dagan Feng , Jinman Kim

Purpose: A reliable cancer prognosis model for clear cell renal cell carcinoma (ccRCC) can enhance personalized treatment. We developed a multi-modal ensemble model (MMEM) that integrates pretreatment clinical data, multi-omics data, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Meixu Chen , Kai Wang , Payal Kapur , James Brugarolas , Raquibul Hannan , Jing Wang

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianyi Wang , Jianan Fan , Dingxin Zhang , Dongnan Liu , Yong Xia , Heng Huang , Weidong Cai