English
Related papers

Related papers: Self-Supervised Pre-Training with Contrastive and …

200 papers

Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Yuyue Zhou , Jessica Knight , Banafshe Felfeliyan , Christopher Keen , Abhilash Rakkunedeth Hareendranathan , Jacob L. Jaremko

Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to overfit. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Alaaeldin El-Nouby , Gautier Izacard , Hugo Touvron , Ivan Laptev , Hervé Jegou , Edouard Grave

Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily workload, obtaining…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Wentao Pan , Jiangpeng Yan , Hanbo Chen , Jiawei Yang , Zhe Xu , Xiu Li , Jianhua Yao

Due to the scarcity of labeled data, self-supervised learning (SSL) has gained much attention in 3D medical image segmentation, by extracting semantic representations from unlabeled data. Among SSL strategies, Masked image modeling (MIM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yuheng Li , Tianyu Luan , Yizhou Wu , Shaoyan Pan , Yenho Chen , Xiaofeng Yang

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely on labeled data, can enhance robustness against noisy labels.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian Linte

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

The rapid evolution of deep learning has significantly advanced the field of medical image analysis. However, despite these achievements, the further enhancement of deep learning models for medical image analysis faces a significant…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Suruchi Kumari , Pravendra Singh

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for medical image segmentation, yet need plenty of manual annotations for training. Semi-Supervised Learning (SSL) methods are promising to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Ran Gu , Jingyang Zhang , Guotai Wang , Wenhui Lei , Tao Song , Xiaofan Zhang , Kang Li , Shaoting Zhang

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent application of deep learning methods for image reconstruction provides a successful data-driven approach to…

Image and Video Processing · Electrical Eng. & Systems 2022-05-20 Ling Chen , Zhishen Huang , Yong Long , Saiprasad Ravishankar

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due to the need of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Fengbei Liu , Yu Tian , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

Sound · Computer Science 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xiaochen Zheng

Surgical tool segmentation in endoscopic images is an important problem: it is a crucial step towards full instrument pose estimation and it is used for integration of pre- and intra-operative images into the endoscopic view. While many…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Daniil Pakhomov , Wei Shen , Nassir Navab

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Medical image segmentation has been significantly advanced by deep learning (DL) techniques, though the data scarcity inherent in medical applications poses a great challenge to DL-based segmentation methods. Self-supervised learning offers…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Binyan Hu , A. K. Qin

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

Machine Learning · Computer Science 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning (SSCL) has recently…

Image and Video Processing · Electrical Eng. & Systems 2022-05-26 Makiya Nakashima , Inyeop Jang , Ramesh Basnet , Mitchel Benovoy , W. H. Wilson Tang , Christopher Nguyen , Deborah Kwon , Tae Hyun Hwang , David Chen
‹ Prev 1 4 5 6 7 8 10 Next ›