English
Related papers

Related papers: Transcriptomics-guided Slide Representation Learni…

200 papers

Self-supervised learning (SSL) has recently shown tremendous potential to learn generic visual representations useful for many image analysis tasks. Despite their notable success, the existing SSL methods fail to generalize to downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Chetan L Srinidhi , Anne L Martel

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Multiple Instance Learning (MIL) has emerged as the best solution for Whole Slide Image (WSI) classification. It consists of dividing each slide into patches, which are treated as a bag of instances labeled with a global label. MIL includes…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Ali Mammadov , Loic Le Folgoc , Julien Adam , Anne Buronfosse , Gilles Hayem , Guillaume Hocquet , Pietro Gori

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Recently, wearable emotion recognition based on peripheral physiological signals has drawn massive attention due to its less invasive nature and its applicability in real-life scenarios. However, how to effectively fuse multimodal data…

Human-Computer Interaction · Computer Science 2023-04-03 Yujin Wu , Mohamed Daoudi , Ali Amad

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Computational cytology faces two major challenges: i) instance-level labels are unreliable and prohibitively costly to obtain, ii) witness rates are extremely low. We propose SLAM-AGS, a Slide-Label-Aware Multitask pretraining framework…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Marco Acerbis , Swarnadip Chatterjee , Christophe Avenel , Joakim Lindblad

Multi-modal learning adeptly integrates visual and textual data, but its application to histopathology image and text analysis remains challenging, particularly with large, high-resolution images like gigapixel Whole Slide Images (WSIs).…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Quan Liu , Ruining Deng , Can Cui , Tianyuan Yao , Vishwesh Nath , Yucheng Tang , Yuankai Huo

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

Contrastive, self-supervised learning (SSL) is used to train a model that predicts cancer type from miRNA, mRNA or RPPA expression data. This model, a pretrained FT-Transformer, is shown to outperform XGBoost and CatBoost, standard…

Machine Learning · Computer Science 2023-11-17 Christian John Hurry , Emma Slade

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Self-supervised learning (SSL) enables label efficient training for machine learning models. This is essential for domains such as medical imaging, where labels are costly and time-consuming to curate. However, the most effective supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Cara Van Uden , Jeremy Irvin , Mars Huang , Nathan Dean , Jason Carr , Andrew Ng , Curtis Langlotz

The effectiveness of self-supervised learning (SSL) for physiological time series depends on the ability of a pretraining objective to preserve information about the underlying physiological state while filtering out unrelated noise.…

Machine Learning · Computer Science 2025-12-02 Yenho Chen , Maxwell A. Xu , James M. Rehg , Christopher J. Rozell

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

Based on digital pathology slice scanning technology, artificial intelligence algorithms represented by deep learning have achieved remarkable results in the field of computational pathology. Compared to other medical images, pathology…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Hao Quan , Xingyu Li , Weixing Chen , Qun Bai , Mingchen Zou , Ruijie Yang , Tingting Zheng , Ruiqun Qi , Xinghua Gao , Xiaoyu Cui

The rapid growth of digital pathology and advances in self-supervised deep learning have enabled the development of foundational models for various pathology tasks across diverse diseases. While multimodal approaches integrating diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Ekaterina Redekop , Mara Pleasure , Zichen Wang , Kimberly Flores , Anthony Sisk , William Speier , Corey W. Arnold

Recent advances in self-supervised learning (SSL) using large models to learn visual representations from natural images are rapidly closing the gap between the results produced by fully supervised learning and those produced by SSL on…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Weiyao Wang , Byung-Hak Kim , Varun Ganapathi

The burgeoning discipline of computational pathology shows promise in harnessing whole slide images (WSIs) to quantify morphological heterogeneity and develop objective prognostic modes for human cancers. However, progress is impeded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Chao Tu , Kun Huang , Jie Zhang , Qianjin Feng , Yu Zhang , Zhenyuan Ning

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu