中文
相关论文

相关论文: Self-Supervised Pre-Training with Contrastive and …

200 篇论文

Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large…

图像与视频处理 · 电气工程与系统科学 2023-09-19 Yuyue Zhou , Jessica Knight , Banafshe Felfeliyan , Christopher Keen , Abhilash Rakkunedeth Hareendranathan , Jacob L. Jaremko

Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to overfit. In this work,…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Alaaeldin El-Nouby , Gautier Izacard , Hugo Touvron , Ivan Laptev , Hervé Jegou , Edouard Grave

Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily workload, obtaining…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Wentao Pan , Jiangpeng Yan , Hanbo Chen , Jiawei Yang , Zhe Xu , Xiu Li , Jianhua Yao

Due to the scarcity of labeled data, self-supervised learning (SSL) has gained much attention in 3D medical image segmentation, by extracting semantic representations from unlabeled data. Among SSL strategies, Masked image modeling (MIM)…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Yuheng Li , Tianyu Luan , Yizhou Wu , Shaoyan Pan , Yenho Chen , Xiaofeng Yang

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely on labeled data, can enhance robustness against noisy labels.…

图像与视频处理 · 电气工程与系统科学 2024-01-17 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian Linte

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

计算机视觉与模式识别 · 计算机科学 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

The rapid evolution of deep learning has significantly advanced the field of medical image analysis. However, despite these achievements, the further enhancement of deep learning models for medical image analysis faces a significant…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Suruchi Kumari , Pravendra Singh

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for medical image segmentation, yet need plenty of manual annotations for training. Semi-Supervised Learning (SSL) methods are promising to reduce the…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Ran Gu , Jingyang Zhang , Guotai Wang , Wenhui Lei , Tao Song , Xiaofan Zhang , Kang Li , Shaoting Zhang

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent application of deep learning methods for image reconstruction provides a successful data-driven approach to…

图像与视频处理 · 电气工程与系统科学 2022-05-20 Ling Chen , Zhishen Huang , Yong Long , Saiprasad Ravishankar

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

计算机视觉与模式识别 · 计算机科学 2017-08-22 Gustav Larsson

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due to the need of…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Fengbei Liu , Yu Tian , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

声音 · 计算机科学 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

计算机视觉与模式识别 · 计算机科学 2022-11-11 Xiaochen Zheng

Surgical tool segmentation in endoscopic images is an important problem: it is a crucial step towards full instrument pose estimation and it is used for integration of pre- and intra-operative images into the endoscopic view. While many…

计算机视觉与模式识别 · 计算机科学 2020-07-10 Daniil Pakhomov , Wei Shen , Nassir Navab

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

图像与视频处理 · 电气工程与系统科学 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Medical image segmentation has been significantly advanced by deep learning (DL) techniques, though the data scarcity inherent in medical applications poses a great challenge to DL-based segmentation methods. Self-supervised learning offers…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Binyan Hu , A. K. Qin

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

图像与视频处理 · 电气工程与系统科学 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

机器学习 · 计算机科学 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning (SSCL) has recently…

图像与视频处理 · 电气工程与系统科学 2022-05-26 Makiya Nakashima , Inyeop Jang , Ramesh Basnet , Mitchel Benovoy , W. H. Wilson Tang , Christopher Nguyen , Deborah Kwon , Tae Hyun Hwang , David Chen