English
Related papers

Related papers: Self-Supervised Pre-Training with Contrastive and …

200 papers

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Hamish Haggerty , Rohitash Chandra

Medical image segmentation has been widely recognized as a pivot procedure for clinical diagnosis, analysis, and treatment planning. However, the laborious and expensive annotation process lags down the speed of further advances.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuowei Li , Zihao Liu , Zhiqiang Hu , Qing Xia , Ruiqin Xiong , Shaoting Zhang , Dimitris Metaxas , Tingting Jiang

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

Pretraining CNN models (i.e., UNet) through self-supervision has become a powerful approach to facilitate medical image segmentation under low annotation regimes. Recent contrastive learning methods encourage similar global representations…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhangsihao Yang , Mengwei Ren , Kaize Ding , Guido Gerig , Yalin Wang

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on deep learning and thus require vast amounts of training data. Due to their scarcity and minuscule size,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xiaochen Zheng , Benjamin Kellenberger , Rui Gong , Irena Hajnsek , Devis Tuia

New advancements in radio data post-processing are underway within the SKA precursor community, aiming to facilitate the extraction of scientific results from survey images through a semi-automated approach. Several of these developments…

The lack of large labeled medical imaging datasets, along with significant inter-individual variability compared to clinically established disease classes, poses significant challenges in exploiting medical imaging information in a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Matteo Ferrante , Tommaso Boccato , Simeon Spasov , Andrea Duggento , Nicola Toschi

This thesis works to address a pivotal challenge in medical image analysis: the reliance on extensive labeled datasets, which are often limited due to the need for expert annotation and constrained by privacy and legal issues. By focusing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Cristian Simionescu

Unsupervised pre-training has been proven as an effective approach to boost various downstream tasks given limited labeled data. Among various methods, contrastive learning learns a discriminative representation by constructing positive and…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Jizong Peng , Ping Wang , Marco Pedersoli , Christian Desrosiers

Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore, in this work, we…

Image and Video Processing · Electrical Eng. & Systems 2023-07-18 Mariana-Iuliana Georgescu

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Chetan L. Srinidhi , Seung Wook Kim , Fu-Der Chen , Anne L. Martel

Deep learning highly relies on the amount of annotated data. However, annotating medical images is extremely laborious and expensive. To this end, self-supervised learning (SSL), as a potential solution for deficient annotated data,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jiuwen Zhu , Yuexiang Li , Yifan Hu , S. Kevin Zhou

Increasing volume of Electronic Health Records (EHR) in recent years provides great opportunities for data scientists to collaborate on different aspects of healthcare research by applying advanced analytics to these EHR clinical data. A…

Machine Learning · Computer Science 2019-09-23 Najibesadat Sadati , Milad Zafar Nezhad , Ratna Babu Chinnam , Dongxiao Zhu

Self-supervised learning (SSL) methods have become a dominant paradigm for creating general purpose models whose capabilities can be transferred to downstream supervised learning tasks. However, most such methods rely on vast amounts of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Lakshay Sharma , Alex Marin

Plankton recognition is an important computer vision problem due to plankton's essential role in ocean food webs and carbon capture, highlighting the need for species-level monitoring. However, this task is challenging due to its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Joona Kareinen , Tuomas Eerola , Kaisa Kraft , Lasse Lensu , Sanna Suikkanen , Heikki Kälviäinen

The deep learning technique has been shown to be effectively addressed several image analysis tasks in the computer-aided diagnosis scheme for mammography. The training of an efficacious deep learning model requires large data with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Zheren Li , Zhiming Cui , Lichi Zhang , Sheng Wang , Chenjin Lei , Xi Ouyang , Dongdong Chen , Xiangyu Zhao , Yajia Gu , Zaiyi Liu , Chunling Liu , Dinggang Shen , Jie-Zhi Cheng

Increasing volume of Electronic Health Records (EHR) in recent years provides great opportunities for data scientists to collaborate on different aspects of healthcare research by applying advanced analytics to these EHR clinical data. A…

Machine Learning · Computer Science 2019-10-01 Najibesadat Sadati , Milad Zafar Nezhad , Ratna Babu Chinnam , Dongxiao Zhu

In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bashir Kazimi , Karina Ruzaeva , Stefan Sandfeld