English
Related papers

Related papers: Gene-induced Multimodal Pre-training for Image-omi…

200 papers

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Glioblastoma is a highly invasive brain tumor with rapid progression rates. Recent studies have shown that glioblastoma molecular subtype classification serves as a significant biomarker for effective targeted therapy selection. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Shekhnaz Idrissova , Islem Rekik

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Multiple instance learning (MIL) has emerged as a powerful framework for weakly supervised whole slide image (WSI) classification, enabling slide-level predictions without requiring detailed patch-level annotations. Despite its success, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Bryan Wong , Mun Yong Yi

In histopathology, intelligent diagnosis of Whole Slide Images (WSIs) is essential for automating and objectifying diagnoses, reducing the workload of pathologists. However, diagnostic models often face the challenge of forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Weixi Zheng , Aoling Huang , Jingping Yuan , Haoyu Zhao , Zhou Zhao , Yongchao Xu , Thierry Géraud

Deep learning has become the mainstream methodological choice for analyzing and interpreting whole-slide digital pathology images (WSIs). It is commonly assumed that tumor regions carry most predictive information. In this paper, we…

Quantitative Methods · Quantitative Biology 2022-04-26 Zihan Chen , Xingyu Li , Miaomiao Yang , Hong Zhang , Xu Steven Xu

We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. Our model consists of an encoder, a decoder and a classifier. The encoder learns a…

Multi-omic datasets offer opportunities for improved biomarker discovery in cancer research, but their high dimensionality and limited sample sizes make identifying compact and effective biomarker panels challenging. Feature selection in…

Genomics · Quantitative Biology 2026-04-02 Luca Cattelani , Vittorio Fortino

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

In this work, we present a deep learning framework for multi-class breast cancer image classification as our submission to the International Conference on Image Analysis and Recognition (ICIAR) 2018 Grand Challenge on BreAst Cancer…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yeeleng S. Vang , Zhen Chen , Xiaohui Xie

Whole-slide image analysis via the means of computational pathology often relies on processing tessellated gigapixel images with only slide-level labels available. Applying multiple instance learning-based methods or transformer models is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Joshua Butke , Noriaki Hashimoto , Ichiro Takeuchi , Hiroaki Miyoshi , Koichi Ohshima , Jun Sakuma

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

Quantitative Methods · Quantitative Biology 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He

Various multi-instance learning (MIL) based approaches have been developed and successfully applied to whole-slide pathological images (WSI). Existing MIL methods emphasize the importance of feature aggregators, but largely neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Yicheng Song , Tiancheng Lin , Die Peng , Su Yang , Yi Xu

Prediction of genetic biomarkers, e.g., microsatellite instability and BRAF in colorectal cancer is crucial for clinical decision making. In this paper, we propose a whole slide image (WSI) based genetic biomarker prediction method via…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Ling Zhang , Boxiang Yun , Xingran Xie , Qingli Li , Xinxing Li , Yan Wang

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

Multiple instance learning (MIL) has been successfully applied for whole slide images (WSIs) analysis in computational pathology, enabling a wide range of prediction tasks from tumor subtyping to inferring genetic mutations and multi-omics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Junyu Li , Ye Zhang , Wen Shu , Xiaobing Feng , Yingchun Wang , Pengju Yan , Xiaolin Li , Chulin Sha , Min He

Histology images with multi-gigapixel of resolution yield rich information for cancer diagnosis and prognosis. Most of the time, only slide-level label is available because pixel-wise annotation is labour intensive task. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Made Satria Wibawa , Kwok-Wai Lo , Lawrence Young , Nasir Rajpoot

Cancer diagnosis has greatly benefited from the integration of whole-slide images (WSIs) with multiple instance learning (MIL), enabling high-resolution analysis of tissue morphology. Graph-based MIL (GNN-MIL) approaches have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Jongwoo Kim , Bryan Wong , Huazhu Fu , Willmer Rafell Quiñones , Youngsin Ko , Mun Yong Yi

Deep models, such as convolutional neural networks (CNNs) and vision transformer (ViT), demonstrate remarkable performance in image classification. However, those deep models require large data to fine-tune, which is impractical in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yihang Wu , Muhammad Owais , Reem Kateb , Ahmad Chaddad