English
Related papers

Related papers: Using Deep Learning Models Pretrained by Self-Supe…

200 papers

The use of pretrained backbones with fine-tuning has been successful for 2D vision and natural language processing tasks, showing advantages over task-specific networks. In this work, we introduce a pretrained 3D backbone, called {\SST},…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yu-Qi Yang , Yu-Xiao Guo , Jian-Yu Xiong , Yang Liu , Hao Pan , Peng-Shuai Wang , Xin Tong , Baining Guo

Tissue phenotyping is a fundamental task in learning objective characterizations of histopathologic biomarkers within the tumor-immune microenvironment in cancer pathology. However, whole-slide imaging (WSI) is a complex computer vision in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Richard J. Chen , Rahul G. Krishnan

The promise of self-supervised learning (SSL) is to leverage large amounts of unlabeled data to solve complex tasks. While there has been excellent progress with simple, image-level learning, recent methods have shown the advantage of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Olivier J. Hénaff , Skanda Koppula , Evan Shelhamer , Daniel Zoran , Andrew Jaegle , Andrew Zisserman , João Carreira , Relja Arandjelović

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

We present a simple picture of the training process of joint embedding self-supervised learning methods. We find that these methods learn their high-dimensional embeddings one dimension at a time in a sequence of discrete, well-separated…

Machine Learning · Computer Science 2023-05-31 James B. Simon , Maksis Knutins , Liu Ziyin , Daniel Geisz , Abraham J. Fetterman , Joshua Albrecht

Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to overfit. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Alaaeldin El-Nouby , Gautier Izacard , Hugo Touvron , Ivan Laptev , Hervé Jegou , Edouard Grave

Semi-supervised learning (SSL) has emerged as a critical paradigm for medical image segmentation, mitigating the immense cost of dense annotations. However, prevailing SSL frameworks are fundamentally "inward-looking", recycling information…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Xinyu Liu , Guolei Sun

Human anatomy is the foundation of medical imaging and boasts one striking characteristic: its hierarchy in nature, exhibiting two intrinsic properties: (1) locality: each anatomical structure is morphologically distinct from the others;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Mohammad Reza Hosseinzadeh Taher , Michael B. Gotway , Jianming Liang

Self-supervised learning (SSL) leverages vast unannotated medical datasets, yet steep technical barriers limit adoption by clinical researchers. We introduce Vision Foundry, a code-free, HIPAA-compliant platform that democratizes…

Recent state-of-the-art semi-supervised learning (SSL) methods use a combination of image-based transformations and consistency regularization as core components. Such methods, however, are limited to simple transformations such as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Chia-Wen Kuo , Chih-Yao Ma , Jia-Bin Huang , Zsolt Kira

Land use/land cover change (LULC) maps are integral resources in earth science and agricultural research. Due to the nature of such maps, the creation of LULC maps is often constrained by the time and human resources necessary to accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Charles Moore , Dakota Hester

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Self-supervised learning (SSL) methods are popular since they can address situations with limited annotated data by directly utilising the underlying data distribution. However, the adoption of such methods is not explored enough in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Joseph Geo Benjamin , Mothilal Asokan , Amna Alhosani , Hussain Alasmawi , Werner Gerhard Diehl , Leanne Bricker , Karthik Nandakumar , Mohammad Yaqub

Deep learning has proven very promising for interpreting MRI in brain tumor diagnosis. However, deep learning models suffer from a scarcity of brain MRI datasets for effective training. Self-supervised learning (SSL) models provide…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Meryem Altin Karagoz , O. Ufuk Nalbantoglu , Geoffrey C. Fox

Most state-of-the-art vein recognition methods rely on closed-set classification, which inherently limits their scalability and prevents the adaptive enrollment of new users without complete model retraining. We rigorously evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Paweł Pilarek , Marcel Musiałek , Anna Górska

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Inferring biological relationships from cellular phenotypes in high-content microscopy screens provides significant opportunity and challenge in biological research. Prior results have shown that deep vision models can capture biological…

In the era of foundation models, CLIP has emerged as a powerful tool for aligning text & visual modalities into a common embedding space. However, the alignment objective used to train CLIP often results in subpar visual features for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Mohamed Fazli Imam , Rufael Fedaku Marew , Jameel Hassan , Mustansar Fiaz , Alham Fikri Aji , Hisham Cholakkal

Semi-supervised learning (SSL) has witnessed remarkable progress, resulting in the emergence of numerous method variations. However, practitioners often encounter challenges when attempting to deploy these methods due to their subpar…

Machine Learning · Computer Science 2024-05-21 Kai Gan , Tong Wei

Breast cancer is one of the leading causes of female mortality in the world. This can be reduced when diagnoses are performed at the early stages of progression. Further, the efficiency of the process can be significantly improved with…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Aravind Ravi