English
Related papers

Related papers: Depth Contrast: Self-Supervised Pretraining on 3DP…

200 papers

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Supervised deep learning-based methods yield accurate results for medical image segmentation. However, they require large labeled datasets for this, and obtaining them is a laborious task that requires clinical expertise.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Deep learning has achieved unprecedented success in various object detection tasks with huge amounts of labeled data. However, obtaining large-scale annotations for medical images is extremely challenging due to the high demand of labour…

Image and Video Processing · Electrical Eng. & Systems 2022-03-21 Zhizhong Chai , Luyang Luo , Huangjing Lin , Hao Chen , Anjia Han , Pheng-Ann Heng

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Costly, noisy, and over-specialized, labels are to be set aside in favor of unsupervised learning if we hope to learn cheap, reliable, and transferable models. To that end, spectral embedding, self-supervised learning, or generative…

Artificial Intelligence · Computer Science 2023-02-22 Randall Balestriero

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is particularly important for semantic segmentation tasks involving 3D datasets, which are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Considering the abundance of unlabeled speech data and the high labeling costs, unsupervised learning methods can be essential for better system development. One of the most successful methods is contrastive self-supervised methods, which…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-11 Jaejin Cho , Raghavendra Pappagari , Piotr Żelasko , Laureano Moro-Velazquez , Jesús Villalba , Najim Dehak

Though quite challenging, leveraging large-scale unlabeled or partially labeled images in a cost-effective way has increasingly attracted interests for its great importance to computer vision. To tackle this problem, many Active Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Keze Wang , Xiaopeng Yan , Dongyu Zhang , Lei Zhang , Liang Lin

Self-supervised learning methods have witnessed a recent surge of interest after proving successful in multiple application fields. In this work, we leverage these techniques, and we propose 3D versions for five different self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Aiham Taleb , Winfried Loetzsch , Noel Danz , Julius Severin , Thomas Gaertner , Benjamin Bergner , Christoph Lippert

Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the supervised fine-tuning on a few labeled examples can…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Wentao Zhu , Hang Shang , Tingxun Lv , Chao Liao , Sen Yang , Ji Liu

Existing public person Re-Identification~(ReID) datasets are small in modern terms because of labeling difficulty. Although unlabeled surveillance video is abundant and relatively easy to obtain, it is unclear how to leverage these footage…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Weiquan Huang , Yan Bai , Qiuyu Ren , Xinbo Zhao , Ming Feng , Yin Wang

Self-supervised learning has proved to be a powerful approach to learn image representations without the need of large labeled datasets. For underwater robotics, it is of great interest to design computer vision algorithms to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Alan Preciado-Grijalva , Bilal Wehbe , Miguel Bande Firvida , Matias Valdenegro-Toro

Weakly supervised point cloud semantic segmentation methods that require 1\% or fewer labels, hoping to realize almost the same performance as fully supervised approaches, which recently, have attracted extensive research attention. A…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tianfang Sun , Zhizhong Zhang , Xin Tan , Yanyun Qu , Yuan Xie , Lizhuang Ma

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Chang Liu , Han Yu , Boyang Li , Zhiqi Shen , Zhanning Gao , Peiran Ren , Xuansong Xie , Lizhen Cui , Chunyan Miao

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Unsupervised machine learning offers significant opportunities for extracting knowledge from unlabeled data sets and for achieving maximum machine learning performance. This paper demonstrates how to construct, use, and evaluate a high…

Materials Science · Physics 2021-04-13 Ryan Cohn , Elizabeth Holm

In this paper, we propose a novel self-supervised representation learning method, Self-EMD, for object detection. Our method directly trained on unlabeled non-iconic image dataset like COCO, instead of commonly used iconic-object image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Songtao Liu , Zeming Li , Jian Sun