English
Related papers

Related papers: Gene-induced Multimodal Pre-training for Image-omi…

200 papers

Multiple instance learning (MIL) has become a preferred method for gigapixel whole slide image (WSI) classification without requiring patch-level annotations. Current MIL research primarily relies on embedding-based approaches, which…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Bryan Wong , Sungrae Hong , Mun Yong Yi

Gliomas are brain tumor types that have a high mortality rate which means early and accurate diagnosis is important for therapeutic intervention for the tumors. To address this difficulty, the proposed research will develop a hybrid deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Pandiyaraju V , Sreya Mynampati , Abishek Karthik , Poovarasan L , D. Saraswathi

Medical image segmentation is a relevant problem, with deep learning being an exponent. However, the necessity of a high volume of fully annotated images for training massive models can be a problem, especially for applications whose images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Matheus A. Cerqueira , Flávia Sprenger , Bernardo C. A. Teixeira , Alexandre X. Falcão

Whole Slide Images (WSIs) are critical for various clinical applications, including histopathological analysis. However, current deep learning approaches in this field predominantly focus on individual tumor types, limiting model…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Sharon Peled , Yosef E. Maruvka , Moti Freiman

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

Masked image modelling (MIM) is a powerful self-supervised representation learning paradigm, whose potential has not been widely demonstrated in medical image analysis. In this work, we show the capacity of MIM to capture rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Piotr Wójcik , Hussein Naji , Adrian Simon , Reinhard Büttner , Katarzyna Bożek

We introduce SLIMP (Skin Lesion Image-Metadata Pre-training) for learning rich representations of skin lesions through a novel nested contrastive learning approach that captures complex relationships between images and metadata. Melanoma…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dionysis Christopoulos , Sotiris Spanos , Eirini Baltzi , Valsamis Ntouskos , Konstantinos Karantzalos

This work addresses how to efficiently classify challenging histopathology images, such as gigapixel whole-slide images for cancer diagnostics with image-level annotation. We use images with annotated tumor regions to identify a set of…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Mohammad Iqbal Nouyed , Mary-Anne Hartley , Gianfranco Doretto , Donald A. Adjeroh

Multi-omic data provides multiple views of the same patients. Integrative analysis of multi-omic data is crucial to elucidate the molecular underpinning of disease etiology. However, multi-omic data has the "big p, small N" problem (the…

Machine Learning · Computer Science 2018-09-07 Tianle Ma , Aidong Zhang

Recent advances in prototypical learning have shown remarkable potential to provide useful decision interpretations associating activation maps and predictions with class-specific training prototypes. Such prototypical learning has been…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Chong Wang , Fengbei Liu , Yuanhong Chen , Helen Frazer , Gustavo Carneiro

Whole slide image (WSI) classification is a crucial problem for cancer diagnostics in clinics and hospitals. A WSI, acquired at gigapixel size, is commonly tiled into patches and processed by multiple-instance learning (MIL) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Doanh C. Bui , Jin Tae Kwak

Training neural networks with high-quality pixel-level annotation in histopathology whole-slide images (WSI) is an expensive process due to gigapixel resolution of WSIs. However, recent advances in self-supervised learning have shown that…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Nohemi Sofia Leon Contreras , Marina D'Amato , Francesco Ciompi , Clement Grisi , Witali Aswolinskiy , Simona Vatrano , Filippo Fraggetta , Iris Nagtegaal

Mixup has become a popular augmentation strategy for image classification, yet its naive pixel-wise interpolation often produces unrealistic images that can hinder learning, particularly in high-stakes medical applications. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hugo Carlesso , Maria Eliza Patulea , Moncef Garouani , Radu Tudor Ionescu , Josiane Mothe

Supervised learning tasks such as cancer survival prediction from gigapixel whole slide images (WSIs) are a critical challenge in computational pathology that requires modeling complex features of the tumor microenvironment. These learning…

Image and Video Processing · Electrical Eng. & Systems 2022-11-22 Iain Carmichael , Andrew H. Song , Richard J. Chen , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

Multiple instance learning (MIL) is a robust paradigm for whole-slide pathological image (WSI) analysis, processing gigapixel-resolution images with slide-level labels. As pioneering efforts, attention-based MIL (ABMIL) and its variants are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Linghan Cai , Shenjin Huang , Ye Zhang , Jinpeng Lu , Yongbing Zhang

Large-scale pre-training models have promoted the development of histopathology image analysis. However, existing self-supervised methods for histopathology images primarily focus on learning patch features, while there is a notable gap in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Kun Wu , Zhiguo Jiang , Kunming Tang , Jun Shi , Fengying Xie , Wei Wang , Haibo Wu , Yushan Zheng

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Eric Zimmermann , Julian Viret , Michal Zelechowski , James Brian Hall , Neil Tenenholtz , Adam Casson , George Shaikovski , Eugene Vorontsov , Siqi Liu , Kristen A Severson

Multiple Instance Learning (MIL) methods have succeeded remarkably in histopathology whole slide image (WSI) analysis. However, most MIL models only offer attention-based explanations that do not faithfully capture the model's decision…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Susu Sun , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Prognostic task is of great importance as it closely related to the survival analysis of patients, the optimization of treatment plans and the allocation of resources. The existing prognostic models have shown promising results on specific…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Binyu Zhang , Shichao Li , Junpeng Jian , Zhu Meng , Limei Guo , Zhicheng Zhao