中文
相关论文

相关论文: Self-supervised Pretraining of Visual Features in …

200 篇论文

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

计算机视觉与模式识别 · 计算机科学 2021-06-04 Vladan Stojnić , Vladimir Risojević

Self-supervision has demonstrated to be an effective learning strategy when training target tasks on small annotated data-sets. While current research focuses on creating novel pretext tasks to learn meaningful and reusable representations…

计算机视觉与模式识别 · 计算机科学 2021-05-17 Fernando Navarro , Christopher Watanabe , Suprosanna Shit , Anjany Sekuboyina , Jan C. Peeken , Stephanie E. Combs , Bjoern H. Menze

Supervised learning can learn large representational spaces, which are crucial for handling difficult learning tasks. However, due to the design of the model, classical image classification approaches struggle to generalize to new problems…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Safwen Naimi , Rien van Leeuwen , Wided Souidene , Slim Ben Saoud

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

This study aims to optimize the few-shot image classification task and improve the model's feature extraction and classification performance by combining self-supervised learning with the deep network model ResNet-101. During the training…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Yuyang Xiao

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

Supervised training of deep neural networks on pairs of clean image and noisy measurement achieves state-of-the-art performance for many image reconstruction tasks, but such training pairs are difficult to collect. Self-supervised methods…

图像与视频处理 · 电气工程与系统科学 2023-10-30 Tobit Klug , Dogukan Atik , Reinhard Heckel

Self-supervised learning (SSL) holds promise in leveraging large amounts of unlabeled data. However, the success of popular SSL methods has limited on single-centric-object images like those in ImageNet and ignores the correlation among the…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Zhaowen Li , Yousong Zhu , Fan Yang , Wei Li , Chaoyang Zhao , Yingying Chen , Zhiyang Chen , Jiahao Xie , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Deep learning has demonstrated its power in image rectification by leveraging the representation capacity of deep neural networks via supervised training based on a large-scale synthetic dataset. However, the model may overfit the synthetic…

计算机视觉与模式识别 · 计算机科学 2021-06-21 Jinlong Fan , Jing Zhang , Dacheng Tao

Whilst computer vision models built using self-supervised approaches are now commonplace, some important questions remain. Do self-supervised models learn highly redundant channel features? What if a self-supervised network could…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Tarun Krishna , Ayush K. Rai , Yasser A. D. Djilali , Alan F. Smeaton , Kevin McGuinness , Noel E. O'Connor

Self-supervised learning has emerged as a powerful paradigm for label-free model pretraining, particularly in the video domain, where manual annotation is costly and time-intensive. However, existing self-supervised approaches employ…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh S Rawat

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

计算机视觉与模式识别 · 计算机科学 2021-11-04 Mrinal Anand , Aditya Garg

A novel semi-supervised learning technique is introduced based on a simple iterative learning cycle together with learned thresholding techniques and an ensemble decision support system. State-of-the-art model performance and increased…

计算机视觉与模式识别 · 计算机科学 2019-06-10 Robert Dupre , Jiri Fajtl , Vasileios Argyriou , Paolo Remagnin

In many critical computer vision scenarios unlabeled data is plentiful, but labels are scarce and difficult to obtain. As a result, semi-supervised learning which leverages unlabeled data to boost the performance of supervised classifiers…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Jay C. Rothenberger , Dimitrios I. Diochnos

This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabeled instance are…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Mahmoud Assran , Mathilde Caron , Ishan Misra , Piotr Bojanowski , Armand Joulin , Nicolas Ballas , Michael Rabbat

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

This paper shows that self-supervised visual pre-training from real-world images is effective for learning motor control tasks from pixels. We first train the visual representations by masked modeling of natural images. We then freeze the…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Tete Xiao , Ilija Radosavovic , Trevor Darrell , Jitendra Malik

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Self-supervised learning (SSL) has demonstrated significant potential in pre-training robust models with limited labeled data, making it particularly valuable for remote sensing (RS) tasks. A common assumption is that pre-training on…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Saad Lahrichi , Zion Sheng , Shufan Xia , Kyle Bradbury , Jordan Malof

Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which prevents them from leveraging abundant unlabeled data. From an information-theoretic perspective, we propose an effective unsupervised FSL method,…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Yuning Lu , Liangjian Wen , Jianzhuang Liu , Yajing Liu , Xinmei Tian