English
Related papers

Related papers: Self-Supervised Vision Transformers Learn Visual C…

200 papers

Predicting drug response in patients from preclinical data remains a major challenge in precision oncology due to the substantial biological gap between in vitro cell lines and patient tumors. Rather than aiming to improve absolute in vitro…

Machine Learning · Computer Science 2026-03-18 Camille Jimenez Cortes , Philippe Lalanda , German Vega

Vision Transformers are at the heart of the current surge of interest in foundation models for histopathology. They process images by breaking them into smaller patches following a regular grid, regardless of their content. Yet, not all…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Clément Grisi , Geert Litjens , Jeroen van der Laak

Digital whole slide images (WSIs) are generally captured at microscopic resolution and encompass extensive spatial data. Directly feeding these images to deep learning models is computationally intractable due to memory constraints, while…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Manahil Raza , Ruqayya Awan , Raja Muhammad Saad Bashir , Talha Qaiser , Nasir M. Rajpoot

Microsatellite instability (MSI) is a tumor phenotype whose diagnosis largely impacts patient care in colorectal cancers (CRC), and is associated with response to immunotherapy in all solid tumors. Deep learning models detecting MSI tumors…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Charlie Saillard , Olivier Dehaene , Tanguy Marchand , Olivier Moindrot , Aurélie Kamoun , Benoit Schmauch , Simon Jegou

Medical image classification requires labeled, task-specific datasets which are used to train deep learning networks de novo, or to fine-tune foundation models. However, this process is computationally and technically demanding. In language…

Accurate skin disease classification is a critical yet challenging task due to high inter-class similarity, intra-class variability, and complex lesion textures. While deep learning-based computer-aided diagnosis (CAD) systems have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Enam Ahmed Taufik , Abdullah Khondoker , Antara Firoz Parsa , Seraj Al Mahmud Mostafa

In human learning, it is common to use multiple sources of information jointly. However, most existing feature learning approaches learn from only a single task. In this paper, we propose a novel multi-task deep network to learn…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Zhongzheng Ren , Yong Jae Lee

Whole-slide images are central to digital pathology, yet their extreme size and scarce annotations make self-supervised learning essential. Masked Autoencoders (MAEs) with Vision Transformer backbones have recently shown strong potential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Raneen Younis , Louay Hamdi , Lukas Chavez , Zahra Ahmadi

We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin (H&E) stained images of breast cancer. Our method is robust to stain variations inherent to the histology images acquisition process, which…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Alexandre Tiard , Alex Wong , David Joon Ho , Yangchao Wu , Eliram Nof , Alvin C. Goh , Stefano Soatto , Saad Nadeem

Hematoxylin- and eosin (H&E) stained whole-slide images (WSIs) are the foundation of diagnosis of cancer. In recent years, development of deep learning-based methods in computational pathology enabled the prediction of biomarkers directly…

Tissue typology annotation in Whole Slide histological images is a complex and tedious, yet necessary task for the development of computational pathology models. We propose to address this problem by applying Open Set Recognition techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Adrian Galdran , Katherine J. Hewitt , Narmin L. Ghaffari , Jakob N. Kather , Gustavo Carneiro , Miguel A. González Ballester

With the remarkable success of representation learning for prediction problems, we have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. However,…

Machine Learning · Computer Science 2024-03-06 David Ahmedt-Aristizabal , Mohammad Ali Armin , Simon Denman , Clinton Fookes , Lars Petersson

We propose a Deep learning-based weak label learning method for analyzing whole slide images (WSIs) of Hematoxylin and Eosin (H&E) stained tumor tissue not requiring pixel-level or tile-level annotations using Self-supervised pre-training…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Yoni Schirris , Efstratios Gavves , Iris Nederlof , Hugo Mark Horlings , Jonas Teuwen

While Multiple Instance Learning (MIL) has shown promising results in digital Pathology Whole Slide Image (WSI) classification, such a paradigm still faces performance and generalization problems due to challenges in high computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Honglin Li , Chenglu Zhu , Yunlong Zhang , Yuxuan Sun , Zhongyi Shui , Wenwei Kuang , Sunyi Zheng , Lin Yang

Self-supervised learning (SSL) is an approach to extract useful feature representations from unlabeled data, and enable fine-tuning on downstream tasks with limited labeled examples. Self-pretraining is a SSL approach that uses the curated…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Jue Jiang , Aneesh Rangnekar , Harini Veeraraghavan

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Maxime W. Lafarge , Erik J. Bekkers , Josien P. W. Pluim , Remco Duits , Mitko Veta

Accurate diagnosis of pediatric brain tumors, starting with histopathology, presents unique challenges for deep learning, including severe data scarcity, class imbalance, and fine-grained morphologic overlap across diagnostically distinct…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Joakim Nguyen , Jian Yu , Jinrui Fang , Nicholas Konz , Tianlong Chen , Sanjay Krishnan , Chandra Krishnan , Ying Ding , Hairong Wang , Ankita Shukla

Histopathology image analysis can be considered as a Multiple instance learning (MIL) problem, where the whole slide histopathology image (WSI) is regarded as a bag of instances (i.e, patches) and the task is to predict a single class label…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Meng Li , Lin Wu , Arnold Wiliem , Kun Zhao , Teng Zhang , Brian C. Lovell

In this paper, we present a comparative analysis of various self-supervised Vision Transformers (ViTs), focusing on their local representative power. Inspired by large language models, we examine the abilities of ViTs to perform various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Ani Vanyan , Alvard Barseghyan , Hakob Tamazyan , Vahan Huroyan , Hrant Khachatrian , Martin Danelljan

In recent years, the use of deep learning (DL) methods, including convolutional neural networks (CNNs) and vision transformers (ViTs), has significantly advanced computational pathology, enhancing both diagnostic accuracy and efficiency.…