English
Related papers

Related papers: Selfie: Self-supervised Pretraining for Image Embe…

200 papers

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Recently, a few self-supervised representation learning (SSL) methods have outperformed the ImageNet classification pre-training for vision tasks such as object detection. However, its effects on 3D human body pose and shape estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Hongsuk Choi , Hyeongjin Nam , Taeryung Lee , Gyeongsik Moon , Kyoung Mu Lee

In fisheye images, rich distinct distortion patterns are regularly distributed in the image plane. These distortion patterns are independent of the visual content and provide informative cues for rectification. To make the best of such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hao Feng , Wendi Wang , Jiajun Deng , Wengang Zhou , Li Li , Houqiang Li

Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the images. Applied to ImageNet, this leads to object centric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Priya Goyal , Quentin Duval , Isaac Seessel , Mathilde Caron , Ishan Misra , Levent Sagun , Armand Joulin , Piotr Bojanowski

Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to overfit. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Alaaeldin El-Nouby , Gautier Izacard , Hugo Touvron , Ivan Laptev , Hervé Jegou , Edouard Grave

This paper shows that Masking the Deep hierarchical features is an efficient self-supervised method, denoted as MaskDeep. MaskDeep treats each patch in the representation space as an independent instance. We mask part of patches in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Fenggang Liu , Yangguang Li , Feng Liang , Jilan Xu , Bin Huang , Jing Shao

Self-supervised learning (SSL) methods such as masked language modeling have shown massive performance gains by pretraining transformer models for a variety of natural language processing tasks. The follow-up research adapted similar…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Gokul Karthik Kumar , Sahal Shaji Mullappilly , Abhishek Singh Gehlot

We study how to leverage Web images to augment human-curated object detection datasets. Our approach is two-pronged. On the one hand, we retrieve Web images by image-to-image search, which incurs less domain shift from the curated data than…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Yandong Li , Di Huang , Danfeng Qin , Liqiang Wang , Boqing Gong

As an agent moves through the world, the apparent motion of scene elements is (usually) inversely proportional to their depth. It is natural for a learning agent to associate image patterns with the magnitude of their displacement over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Huaizu Jiang , Erik Learned-Miller , Gustav Larsson , Michael Maire , Greg Shakhnarovich

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Norman Mu , Alexander Kirillov , David Wagner , Saining Xie

Fisheye cameras suffer from image distortion while having a large field of view(LFOV). And this fact leads to poor performance on some fisheye vision tasks. One of the solutions is to optimize the current vision algorithm for fisheye…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dianyi Yang , Jiadong Tang , Yu Gao , Yi Yang , Mengyin Fu

Self-supervised pretraining (SSP) has emerged as a popular technique in machine learning, enabling the extraction of meaningful feature representations without labelled data. In the realm of computer vision, pretrained vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Jiantao Wu , Shentong Mo , Muhammad Awais , Sara Atito , Zhenhua Feng , Josef Kittler

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Recent image inpainting methods have shown promising results due to the power of deep learning, which can explore external information available from the large training dataset. However, many state-of-the-art inpainting networks are still…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

Self-supervised representation learning solves auxiliary prediction tasks (known as pretext tasks) without requiring labeled data to learn useful semantic representations. These pretext tasks are created solely using the input features,…

Machine Learning · Computer Science 2021-11-16 Jason D. Lee , Qi Lei , Nikunj Saunshi , Jiacheng Zhuo

State-of-the-art self-supervised learning approaches for monocular depth estimation usually suffer from scale ambiguity. They do not generalize well when applied on distance estimation for complex projection models such as in fisheye and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Varun Ravi Kumar , Marvin Klingner , Senthil Yogamani , Stefan Milz , Tim Fingscheidt , Patrick Maeder

Most existing public face datasets, such as MS-Celeb-1M and VGGFace2, provide abundant information in both breadth (large number of IDs) and depth (sufficient number of samples) for training. However, in many real-world scenarios of face…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Hang Du , Hailin Shi , Yuchi Liu , Jun Wang , Zhen Lei , Dan Zeng , Tao Mei

Conventional computer vision models rely on very deep, feedforward networks processing whole images and trained offline with extensive labeled data. In contrast, biological vision relies on comparatively shallow, recurrent networks that…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Osvaldo M Velarde , Lucas C Parra

Accurately segmenting objects without any manual annotations remains one of the core challenges in computer vision. In this work, we introduce Selfment, a fully self-supervised framework that segments foreground objects directly from raw…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zuyao You , Zuxuan Wu , Yu-Gang Jiang