English
Related papers

Related papers: MIRROR: Multi-Modal Pathological Self-Supervised R…

200 papers

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Histomorphology is crucial in cancer diagnosis. However, existing whole slide image (WSI) classification methods struggle to effectively incorporate histomorphology information, limiting their ability to capture key pathological features.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Baizhi Wang , Rui Yan , Wenxin Ma , Xu Zhang , Yuhao Wang , Xiaolong Li , Yunjie Gu , Zihang Jiang , S. Kevin Zhou

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Self-supervised learning (SSL) has driven major advances in computational pathology by enabling the learning of rich representations from histopathology data. Yet, tissue analysis alone may fall short in capturing broader molecular…

Machine Learning · Computer Science 2025-12-17 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Accurately predicting the survival rate of cancer patients is crucial for aiding clinicians in planning appropriate treatment, reducing cancer-related medical expenses, and significantly enhancing patients' quality of life. Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Liangrui Pan , Yijun Peng , Yan Li , Xiang Wang , Wenjuan Liu , Liwen Xu , Qingchun Liang , Shaoliang Peng

Definitive cancer diagnosis and management depend upon the extraction of information from microscopy images by pathologists. These images contain complex information requiring time-consuming expert human interpretation that is prone to…

Whole-slide image analysis via the means of computational pathology often relies on processing tessellated gigapixel images with only slide-level labels available. Applying multiple instance learning-based methods or transformer models is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Joshua Butke , Noriaki Hashimoto , Ichiro Takeuchi , Hiroaki Miyoshi , Koichi Ohshima , Jun Sakuma

Multimodal pathology-genomic analysis is critical for cancer survival prediction. However, existing approaches predominantly integrate formalin-fixed paraffin-embedded (FFPE) slides with genomic data, while neglecting the availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mingcheng Qu , Guang Yang , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation learning methods, among which multi-modal molecular…

Machine Learning · Computer Science 2025-05-13 Rong Yin , Ruyue Liu , Xiaoshuai Hao , Xingrui Zhou , Yong Liu , Can Ma , Weiping Wang

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Survival prediction of cancers is crucial for clinical practice, as it informs mortality risks and influences treatment plans. However, a static model trained on a single dataset fails to adapt to the dynamically evolving clinical…

Machine Learning · Computer Science 2026-01-21 Dianzhi Yu , Conghao Xiong , Yankai Chen , Wenqian Cui , Xinni Zhang , Yifei Zhang , Hao Chen , Joseph J. Y. Sung , Irwin King

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kyungwon Kim , Dosik Hwang

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Recently, multimodal deep learning, which integrates histopathology slides and molecular biomarkers, has achieved a promising performance in glioma grading. Despite great progress, due to the intra-modality complexity and inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Xiaohan Xing , Maximus C. F. Yeung , Zhen Chen

The ability of tumors to evolve and adapt by developing subclones in different genetic and epigenetic states is a major challenge in oncology. Traditional tools like multi-regional sequencing used to study tumor evolution and the resultant…

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents an even more difficult scenario. To cope with this challenge,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-16 Tianyi Liu , Zhaorui Tan , Haochuan Jiang , Xi Yang , Kaizhu Huang
‹ Prev 1 2 3 10 Next ›