English
Related papers

Related papers: Refining Pre-Trained Motion Models

200 papers

Self-supervision provides effective representations for downstream tasks without requiring labels. However, existing approaches lag behind fully supervised training and are often not thought beneficial beyond obviating or reducing the need…

Machine Learning · Computer Science 2019-10-30 Dan Hendrycks , Mantas Mazeika , Saurav Kadavath , Dawn Song

Unsupervised learning has been popular in various computer vision tasks, including visual object tracking. However, prior unsupervised tracking approaches rely heavily on spatial supervision from template-search pairs and are still unable…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Qiuhong Shen , Lei Qiao , Jinyang Guo , Peixia Li , Xin Li , Bo Li , Weitao Feng , Weihao Gan , Wei Wu , Wanli Ouyang

While supervised techniques in re-identification are extremely effective, the need for large amounts of annotations makes them impractical for large camera networks. One-shot re-identification, which uses a singular labeled tracklet for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Dripta S. Raychaudhuri , Amit K. Roy-Chowdhury

Self-supervised learning has unlocked the potential of scaling up pretraining to billions of images, since annotation is unnecessary. But are we making the best use of data? How more economical can we be? In this work, we attempt to answer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shashanka Venkataramanan , Mamshad Nayeem Rizve , João Carreira , Yuki M. Asano , Yannis Avrithis

We present a neural semi-supervised learning model termed Self-Pretraining. Our model is inspired by the classic self-training algorithm. However, as opposed to self-training, Self-Pretraining is threshold-free, it can potentially update…

Computation and Language · Computer Science 2021-10-01 Payam Karisani , Negin Karisani

Deep learning models for semantic segmentation rely on expensive, large-scale, manually annotated datasets. Labelling is a tedious process that can take hours per image. Automatically annotating video sequences by propagating sparsely…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Aditya Ganeshan , Alexis Vallet , Yasunori Kudo , Shin-ichi Maeda , Tommi Kerola , Rares Ambrus , Dennis Park , Adrien Gaidon

We investigate the utility of pretraining by contrastive self supervised learning on both natural-scene and medical imaging datasets when the unlabeled dataset size is small, or when the diversity within the unlabeled set does not lead to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Ozan Ciga , Tony Xu , Anne L. Martel

We introduce a self-supervised method for learning visual correspondence from unlabeled video. The main idea is to use cycle-consistency in time as free supervisory signal for learning visual representations from scratch. At training time,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Xiaolong Wang , Allan Jabri , Alexei A. Efros

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

State estimation is one of the greatest challenges for cloth manipulation due to cloth's high dimensionality and self-occlusion. Prior works propose to identify the full state of crumpled clothes by training a mesh reconstruction model in…

Robotics · Computer Science 2023-02-21 Zixuan Huang , Xingyu Lin , David Held

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

We present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled video. We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Silviu-Marian Udrescu , Max Tegmark

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount of data because…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Priya Goyal , Dhruv Mahajan , Abhinav Gupta , Ishan Misra

Self-training is a simple yet effective method for semi-supervised learning, during which pseudo-label selection plays an important role for handling confirmation bias. Despite its popularity, applying self-training to landmark detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haibo Jin , Haoxuan Che , Hao Chen

Previous methods on estimating detailed human depth often require supervised training with `ground truth' depth data. This paper presents a self-supervised method that can be trained on YouTube videos without known depth, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Feitong Tan , Hao Zhu , Zhaopeng Cui , Siyu Zhu , Marc Pollefeys , Ping Tan

Video Instance Segmentation (VIS) faces significant annotation challenges due to its dual requirements of pixel-level masks and temporal consistency labels. While recent unsupervised methods like VideoCutLER eliminate optical flow…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kaixuan Lu , Mehmet Onurcan Kaya , Dim P. Papadopoulos

In open-world semi-supervised learning, a machine learning model is tasked with uncovering novel categories from unlabeled data while maintaining performance on seen categories from labeled data. The central challenge is the substantial…

Machine Learning · Computer Science 2024-04-18 Bo Ye , Kai Gan , Tong Wei , Min-Ling Zhang

Faced with the scarcity of clean label data in real scenarios, seismic denoising methods based on supervised learning (SL) often encounter performance limitations. Specifically, when a model trained on synthetic data is directly applied to…

Geophysics · Physics 2023-11-07 Shijun Cheng , Zhiyao Cheng , Chao Jiang , Weijian Mao , Qingchen Zhang

In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often a domain shift…

Machine Learning · Computer Science 2020-06-23 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Despite the significant progress that depth-based 3D hand pose estimation methods have made in recent years, they still require a large amount of labeled training data to achieve high accuracy. However, collecting such data is both costly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Mohammad Rezaei , Farnaz Farahanipad , Alex Dillhoff , Vassilis Athitsos