English
Related papers

Related papers: PASS: An ImageNet replacement for self-supervised …

200 papers

In this paper, we study the problem of learning image classification models with label noise. Existing approaches depending on human supervision are generally not scalable as manually identifying correct or incorrect labels is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Kuang-Huei Lee , Xiaodong He , Lei Zhang , Linjun Yang

Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck for data collection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyungjune Baek , Yunjey Choi , Youngjung Uh , Jaejun Yoo , Hyunjung Shim

We present the One Pass ImageNet (OPIN) problem, which aims to study the effectiveness of deep learning in a streaming setting. ImageNet is a widely known benchmark dataset that has helped drive and evaluate recent advancements in deep…

Machine Learning · Computer Science 2021-11-04 Huiyi Hu , Ang Li , Daniele Calandriello , Dilan Gorur

Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet pre-training is commonly used to initialize the backbones of object detection and segmentation models. He et al., however, show a surprising result…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Barret Zoph , Golnaz Ghiasi , Tsung-Yi Lin , Yin Cui , Hanxiao Liu , Ekin D. Cubuk , Quoc V. Le

The growing Machine Learning (ML) services require extensive collections of user data, which may inadvertently include people's private information irrelevant to the services. Various studies have been proposed to protect private attributes…

Machine Learning · Computer Science 2025-07-10 Yizhuo Chen , Chun-Fu , Chen , Hsiang Hsu , Shaohan Hu , Tarek Abdelzaher

Person re-identification (person Re-Id) aims to retrieve the pedestrian images of a same person that captured by disjoint and non-overlapping cameras. Lots of researchers recently focuse on this hot issue and propose deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Chengyuan Zhang , Lei Zhu , Shichao Zhang

Obtaining labelled data to train deep learning methods for estimating animal pose is challenging. Recently, synthetic data has been widely used for pose estimation tasks, but most methods still rely on supervised learning paradigms…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jose Sosa , David Hogg

Hyperspectral imaging is a rich source of data, allowing for multitude of effective applications. However, such imaging remains challenging because of large data dimension and, typically, small pool of available training examples. While…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Wojciech Masarczyk , Przemysław Głomb , Bartosz Grabowski , Mateusz Ostaszewski

We investigate and improve self-supervision as a drop-in replacement for ImageNet pretraining, focusing on automatic colorization as the proxy task. Self-supervised training has been shown to be more promising for utilizing unlabeled data…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Gustav Larsson , Michael Maire , Gregory Shakhnarovich

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

One of the largest problems in medical image processing is the lack of annotated data. Labeling medical images often requires highly trained experts and can be a time-consuming process. In this paper, we evaluate a method of reducing the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Marin Benčević , Marija Habijan , Irena Galić , Aleksandra Pizurica

In recent years, person detection and human pose estimation have made great strides, helped by large-scale labeled datasets. However, these datasets had no guarantees or analysis of human activities, poses, or context diversity.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Salehe Erfanian Ebadi , You-Cyuan Jhang , Alex Zook , Saurav Dhakad , Adam Crespi , Pete Parisi , Steven Borkman , Jonathan Hogins , Sujoy Ganguly

In this work, we investigate the understudied effect of the training data used for image super-resolution (SR). Most commonly, novel SR methods are developed and benchmarked on common training datasets such as DIV2K and DF2K. However, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Go Ohtani , Ryu Tadokoro , Ryosuke Yamada , Yuki M. Asano , Iro Laina , Christian Rupprecht , Nakamasa Inoue , Rio Yokota , Hirokatsu Kataoka , Yoshimitsu Aoki

In many critical computer vision scenarios unlabeled data is plentiful, but labels are scarce and difficult to obtain. As a result, semi-supervised learning which leverages unlabeled data to boost the performance of supervised classifiers…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jay C. Rothenberger , Dimitrios I. Diochnos

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

Human-centric visual analysis plays a pivotal role in diverse applications, including surveillance, healthcare, and human-computer interaction. With the emergence of large-scale unlabeled human image datasets, there is an increasing need…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mingshuang Luo , Ruibing Hou , Bo Chao , Hong Chang , Zimo Liu , Yaowei Wang , Shiguang Shan

Recent advances in deep learning and computer vision have reduced many barriers to automated medical image analysis, allowing algorithms to process label-free images and improve performance. However, existing techniques have extreme…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Pranav Singh , Elena Sizikova , Jacopo Cirrone

Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to overfit. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Alaaeldin El-Nouby , Gautier Izacard , Hugo Touvron , Ivan Laptev , Hervé Jegou , Edouard Grave

Self-supervised learning has unlocked the potential of scaling up pretraining to billions of images, since annotation is unnecessary. But are we making the best use of data? How more economical can we be? In this work, we attempt to answer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shashanka Venkataramanan , Mamshad Nayeem Rizve , João Carreira , Yuki M. Asano , Yannis Avrithis

In many machine learning applications, labeling datasets can be an arduous and time-consuming task. Although research has shown that semi-supervised learning techniques can achieve high accuracy with very few labels within the field of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Evelyn J. Mannix , Howard D. Bondell