English
Related papers

Related papers: Self-supervision through Random Segments with Auto…

200 papers

Random Ferns -- as a less known example of Ensemble Learning -- have been successfully applied in many Computer Vision applications ranging from keypoint matching to object detection. This paper extends the Random Fern framework to the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Pengchao Wei , Ronny Hänsch

Self-supervised learning of image representations by predicting future frames is a promising direction but still remains a challenge. This is because of the under-determined nature of frame prediction; multiple potential futures can arise…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Huiwon Jang , Dongyoung Kim , Junsu Kim , Jinwoo Shin , Pieter Abbeel , Younggyo Seo

Self-supervised learning is showing great promise for monocular depth estimation, using geometry as the only source of supervision. Depth networks are indeed capable of learning representations that relate visual appearance to 3D properties…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Vitor Guizilini , Rui Hou , Jie Li , Rares Ambrus , Adrien Gaidon

We propose a Randomized Progressive Training algorithm (RPT) -- a stochastic proxy for the well-known Progressive Training method (PT) (Karras et al., 2017). Originally designed to train GANs (Goodfellow et al., 2014), PT was proposed as a…

Machine Learning · Computer Science 2023-06-07 Rafał Szlendak , Elnur Gasanov , Peter Richtárik

This work explores the use of spatial context as a source of free and plentiful supervisory signal for training a rich visual representation. Given only a large, unlabeled image collection, we extract random pairs of patches from each image…

Computer Vision and Pattern Recognition · Computer Science 2016-01-19 Carl Doersch , Abhinav Gupta , Alexei A. Efros

One of the main obstacles to 3D semantic segmentation is the significant amount of endeavor required to generate expensive point-wise annotations for fully supervised training. To alleviate manual efforts, we propose GIDSeg, a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Peng Yin , Lingyun Xu , Jianmin Ji , Sebastian Scherer , Howie Choset

Semi-supervised learning for medical image segmentation is an important area of research for alleviating the huge cost associated with the construction of reliable large-scale annotations in the medical domain. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Chae Eun Lee , Hyelim Park , Yeong-Gil Shin , Minyoung Chung

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah

Few-shot segmentation aims at assigning a category label to each image pixel with few annotated samples. It is a challenging task since the dense prediction can only be achieved under the guidance of latent features defined by sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Kai Zhu , Wei Zhai , Zheng-Jun Zha , Yang Cao

In this work, we develop convolutional neural generative coding (Conv-NGC), a generalization of predictive coding to the case of convolution/deconvolution-based computation. Specifically, we concretely implement a flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Alexander Ororbia , Ankur Mali

Speech accents present a serious challenge to the performance of state-of-the-art end-to-end Automatic Speech Recognition (ASR) systems. Even with self-supervised learning and pre-training of ASR models, accent invariance is seldom…

Computation and Language · Computer Science 2024-07-08 Darshan Prabhu , Abhishek Gupta , Omkar Nitsure , Preethi Jyothi , Sriram Ganapathy

Large scale datasets created from crowdsourced labels or openly available data have become crucial to provide training data for large scale learning algorithms. While these datasets are easier to acquire, the data are frequently noisy and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Rodrigo Caye Daudt , Bertrand Le Saux , Alexandre Boulch , Yann Gousseau

The unsupervised Pretraining method has been widely used in aiding human action recognition. However, existing methods focus on reconstructing the already present frames rather than generating frames which happen in future.In this paper, We…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Yu Runsheng , Shi Zhenyu , Ma Qiongxiong , Qing Laiyun

In order to leverage and profit from unlabelled data, semi-supervised frameworks for semantic segmentation based on consistency training have been proven to be powerful tools to significantly improve the performance of purely supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Max Coenen , Tobias Schack , Dries Beyer , Christian Heipke , Michael Haist

In order to autonomously learn wide repertoires of complex skills, robots must be able to learn from their own autonomously collected data, without human supervision. One learning signal that is always available for autonomously collected…

Robotics · Computer Science 2017-10-18 Frederik Ebert , Chelsea Finn , Alex X. Lee , Sergey Levine

We frame the task of predicting a semantic labeling as a sparse reconstruction procedure that applies a target-specific learned transfer function to a generic deep sparse code representation of an image. This strategy partitions training…

Computer Vision and Pattern Recognition · Computer Science 2014-10-17 Michael Maire , Stella X. Yu , Pietro Perona

Self-supervised representation learning solves auxiliary prediction tasks (known as pretext tasks) without requiring labeled data to learn useful semantic representations. These pretext tasks are created solely using the input features,…

Machine Learning · Computer Science 2021-11-16 Jason D. Lee , Qi Lei , Nikunj Saunshi , Jiacheng Zhuo

Autoregressive visual generation has garnered increasing attention due to its scalability and compatibility with other modalities compared with diffusion models. Most existing methods construct visual sequences as spatial patches for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yuanhui Huang , Weiliang Chen , Wenzhao Zheng , Yueqi Duan , Jie Zhou , Jiwen Lu

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework…

Machine Learning · Statistics 2017-04-19 Piotr Bojanowski , Armand Joulin

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev