English
Related papers

Related papers: Transcriptomics-guided Slide Representation Learni…

200 papers

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Gabriele Campanella , Eugene Fluder , Jennifer Zeng , Chad Vanderbilt , Thomas J. Fuchs

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses…

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Annotating 3D medical images demands substantial time and expertise, driving the adoption of semi-supervised learning (SSL) for segmentation tasks. However, the complex anatomical structures of organs often lead to significant class…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuliang Gu , Weilun Tsao , Bo Du , Thierry Géraud , Yongchao Xu

Multi-modal learning integrating medical images and tabular data has significantly advanced clinical decision-making in recent years. Self-Supervised Learning (SSL) has emerged as a powerful paradigm for pretraining these models on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yibing Fu , Yunpeng Zhao , Zhitao Zeng , Cheng Chen , Yueming Jin

Increased levels of tumor infiltrating lymphocytes (TILs) in cancer tissue indicate favourable outcomes in many types of cancer. Manual quantification of immune cells is inaccurate and time consuming for pathologists. Our aim is to leverage…

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

Determining early-stage prognostic markers and stratifying patients for effective treatment are two key challenges for improving outcomes for melanoma patients. Previous studies have used tumour transcriptome data to stratify patients into…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Lucy Godson , Navid Alemi , Jeremie Nsengimana , Graham P. Cook , Emily L. Clarke , Darren Treanor , D. Timothy Bishop , Julia Newton-Bishop , Ali Gooya

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

Organoids, sophisticated in vitro models of human tissues, are crucial for medical research due to their ability to simulate organ functions and assess drug responses accurately. Accurate organoid instance segmentation is critical for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Gui Huang , Kangyuan Zheng , Xuan Cai , Jiaqi Wang , Jianjia Zhang , Kaida Ning , Wenbo Wei , Yujuan Zhu , Jiong Zhang , Mengting Liu

Self-supervised learning (SSL) is an approach to extract useful feature representations from unlabeled data, and enable fine-tuning on downstream tasks with limited labeled examples. Self-pretraining is a SSL approach that uses the curated…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Jue Jiang , Aneesh Rangnekar , Harini Veeraraghavan

Depression, a prevalent mental health disorder impacting millions globally, demands reliable assessment systems. Unlike previous studies that focus solely on either detecting depression or predicting its severity, our work identifies…

With the rapid advancement of pathology foundation models (FMs), the representation learning of whole slide images (WSIs) attracts increasing attention. Existing studies develop high-quality patch feature extractors and employ carefully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yuxuan Chen , Jiawen Li , Jiali Hu , Xitong Ling , Tian Guan , Anjia Han , Yonghong He

Recently, a few self-supervised representation learning (SSL) methods have outperformed the ImageNet classification pre-training for vision tasks such as object detection. However, its effects on 3D human body pose and shape estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Hongsuk Choi , Hyeongjin Nam , Taeryung Lee , Gyeongsik Moon , Kyoung Mu Lee

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Machine Learning · Computer Science 2023-04-11 Yangjun Ruan , Saurabh Singh , Warren Morningstar , Alexander A. Alemi , Sergey Ioffe , Ian Fischer , Joshua V. Dillon

Digital histopathology whole slide images (WSIs) provide gigapixel-scale high-resolution images that are highly useful for disease diagnosis. However, digital histopathology image analysis faces significant challenges due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Bodong Zhang , Xiwen Li , Hamid Manoochehri , Xiaoya Tang , Deepika Sirohi , Beatrice S. Knudsen , Tolga Tasdizen

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yishun Zhu , Jiaxin Qi , Jian Wang , Yuhua Zheng , Jianqiang Huang

The process of annotating relevant data in the field of digital microscopy can be both time-consuming and especially expensive due to the required technical skills and human-expert knowledge. Consequently, large amounts of microscopic image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Asmaa Haja , Eric Brouwer , Lambert Schomaker

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

The availability of large scale data with high quality ground truth labels is a challenge when developing supervised machine learning solutions for healthcare domain. Although, the amount of digital data in clinical workflows is increasing,…

Image and Video Processing · Electrical Eng. & Systems 2022-08-31 Sara Atito , Syed Muhammad Anwar , Muhammad Awais , Josef Kitler