English
Related papers

Related papers: Self-Supervised Modality-Agnostic Pre-Training of …

200 papers

Inter-modality image registration is an critical preprocessing step for many applications within the routine clinical pathway. This paper presents an unsupervised deep inter-modality registration network that can learn the optimal affine…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Chengjia Wang , Giorgos Papanastasiou , Agisilaos Chartsias , Grzegorz Jacenkow , Sotirios A. Tsaftaris , Heye Zhang

We are witnessing a modeling shift from CNN to Transformers in computer vision. In this work, we present a self-supervised learning approach called MoBY, with Vision Transformers as its backbone architecture. The approach basically has no…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Zhenda Xie , Yutong Lin , Zhuliang Yao , Zheng Zhang , Qi Dai , Yue Cao , Han Hu

Tissue phenotyping is a fundamental task in learning objective characterizations of histopathologic biomarkers within the tumor-immune microenvironment in cancer pathology. However, whole-slide imaging (WSI) is a complex computer vision in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Richard J. Chen , Rahul G. Krishnan

Precise medical image segmentation is fundamental for enabling computer aided diagnosis and effective treatment planning. Traditional models that rely solely on visual features often struggle when confronted with ambiguous or low contrast…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ashfak Yeafi , Parthaw Goswami , Md Khairul Islam , Ashifa Islam Shamme

Transformer-based supervised pre-training achieves great performance in person re-identification (ReID). However, due to the domain gap between ImageNet and ReID datasets, it usually needs a larger pre-training dataset (e.g. ImageNet-21K)…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Hao Luo , Pichao Wang , Yi Xu , Feng Ding , Yanxin Zhou , Fan Wang , Hao Li , Rong Jin

Shape information is a strong and valuable prior in segmenting organs in medical images. However, most current deep learning based segmentation algorithms have not taken shape information into consideration, which can lead to bias towards…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Yuan Yao , Fengze Liu , Zongwei Zhou , Yan Wang , Wei Shen , Alan Yuille , Yongyi Lu

Remarkable gains in deep learning usually rely on tremendous supervised data. Ensuring the modality diversity for one object in training set is critical for the generalization of cutting-edge deep models, but it burdens human with heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Jiang Lu , Lei Li , Changshui Zhang

Vision Transformer has recently gained tremendous popularity in medical image segmentation task due to its superior capability in capturing long-range dependencies. However, transformer requires a large amount of labeled data to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Lei Zhu , Jun Zhou , Rick Siow Mong Goh , Yong Liu

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Neha Kalibhat , Sam Sharpe , Jeremy Goodsitt , Bayan Bruss , Soheil Feizi

Medical image segmentation is a critical task in clinical workflows, particularly for the detection and delineation of pathological regions. While convolutional architectures like U-Net have become standard for such tasks, their limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Morteza Kiani Haftlang , Mohammadhossein Malmir , Foroutan Parand , Umberto Michelucci , Safouane El Ghazouali

The standard approach to modern self-supervised learning is to generate random views through data augmentations and minimise a loss computed from the representations of these views. This inherently encourages invariance to the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 David Torpey , Richard Klein

Transfer learning has become a standard practice to mitigate the lack of labeled data in medical classification tasks. Whereas finetuning a downstream task using supervised ImageNet pretrained features is straightforward and extensively…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tuan Truong , Sadegh Mohammadi , Matthias Lenga

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

Deep learning techniques have revolutionised medical imaging, improving diagnostic accuracy and enabling both more accurate and earlier disease detection. However, the relationship between pre-training strategies and downstream performance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Felix Krones

Model generalization capacity at domain shift (e.g., various imaging protocols and scanners) is crucial for deep learning methods in real-world clinical deployment. This paper tackles the challenging problem of domain generalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Quande Liu , Qi Dou , Pheng-Ann Heng

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

Unsupervised pre-training has been proven as an effective approach to boost various downstream tasks given limited labeled data. Among various methods, contrastive learning learns a discriminative representation by constructing positive and…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Jizong Peng , Ping Wang , Marco Pedersoli , Christian Desrosiers

Pretraining with large-scale 3D volumes has a potential for improving the segmentation performance on a target medical image dataset where the training images and annotations are limited. Due to the high cost of acquiring pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Guotai Wang , Jianghao Wu , Xiangde Luo , Xinglong Liu , Kang Li , Shaoting Zhang

Over the years, multimodal mobile sensing has been used extensively for inferences regarding health and well being, behavior, and context. However, a significant challenge hindering the widespread deployment of such models in real world…

Machine Learning · Computer Science 2024-04-29 Lakmal Meegahapola , Hamza Hassoune , Daniel Gatica-Perez