中文
相关论文

相关论文: Contrastive Learning for Self-Supervised Pre-Train…

200 篇论文

Supervised learning in large discriminative models is a mainstay for modern computer vision. Such an approach necessitates investing in large-scale human-annotated datasets for achieving state-of-the-art results. In turn, the efficacy of…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Liang-Chieh Chen , Raphael Gontijo Lopes , Bowen Cheng , Maxwell D. Collins , Ekin D. Cubuk , Barret Zoph , Hartwig Adam , Jonathon Shlens

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

计算机视觉与模式识别 · 计算机科学 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

We investigate the utility of pretraining by contrastive self supervised learning on both natural-scene and medical imaging datasets when the unlabeled dataset size is small, or when the diversity within the unlabeled set does not lead to…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Ozan Ciga , Tony Xu , Anne L. Martel

Semantic segmentation of 3D point cloud data often comes with high annotation costs. Active learning automates the process of selecting which data to annotate, reducing the total amount of annotation needed to achieve satisfactory…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Johannes Meyer , Jasper Hoffmann , Felix Schulz , Dominik Merkle , Daniel Buescher , Alexander Reiterer , Joschka Boedecker , Wolfram Burgard

Surgical data science is a new research field that aims to observe all aspects of the patient treatment process in order to provide the right assistance at the right time. Due to the breakthrough successes of deep learning-based solutions…

Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Hao Yang , Haiyang Wang , Di Dai , Liwei Wang

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for…

图像与视频处理 · 电气工程与系统科学 2022-10-05 Antonio Montanaro , Diego Valsesia , Giulia Fracastoro , Enrico Magli

Transfer learning has long been a key factor in the advancement of many fields including 2D image analysis. Unfortunately, its applicability in 3D data processing has been relatively limited. While several approaches for point cloud…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Souhail Hadgi , Lei Li , Maks Ovsjanikov

Pretraining has been shown to improve performance in many domains, including semantic segmentation, especially in domains with limited labelled data. In this work, we perform a large-scale evaluation and benchmarking of various pretraining…

计算机视觉与模式识别 · 计算机科学 2024-02-28 David Torpey , Lawrence Pratt , Richard Klein

Despite their superior performance, deep-learning methods often suffer from the disadvantage of needing large-scale well-annotated training data. In response, recent literature has seen a proliferation of efforts aimed at reducing the…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Ji Yu

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

Contrastive learning is an essential method in self-supervised learning. It primarily employs a multi-branch strategy to compare latent representations obtained from different branches and train the encoder. In the case of multi-modal…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Chengzhi Wu , Qianliang Huang , Kun Jin , Julius Pfrommer , Jürgen Beyerer

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Zhenyuan Lu

Contrastive Language-Image Pre-training (CLIP) achieves promising results in 2D zero-shot and few-shot learning. Despite the impressive performance in 2D, applying CLIP to help the learning in 3D scene understanding has yet to be explored.…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Runnan Chen , Youquan Liu , Lingdong Kong , Xinge Zhu , Yuexin Ma , Yikang Li , Yuenan Hou , Yu Qiao , Wenping Wang

Semi-supervised learning has the potential to improve the data-efficiency of training data-hungry deep neural networks, which is especially important for medical image analysis tasks where labeled data is scarce. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Boon Peng Yap , Beng Koon Ng

Point cloud segmentation is a fundamental task in 3D vision that serves a wide range of applications. Although great progresses have been made these years, its practical usability is still limited by the availability of training data.…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Yixun Liang , Hao He , Shishi Xiao , Hao Lu , Yingcong Chen

As research interests in medical image analysis become increasingly fine-grained, the cost for extensive annotation also rises. One feasible way to reduce the cost is to annotate with coarse-grained superclass labels while using limited…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Linrui Dai , Wenhui Lei , Xiaofan Zhang

High annotation costs are a major bottleneck for the training of semantic segmentation systems. Therefore, methods working with less annotation effort are of special interest. This paper studies the problem of semi-supervised semantic…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Olga Zatsarynna , Johann Sawatzky , Juergen Gall