English
Related papers

Related papers: Unsupervised feature learning by augmenting single…

200 papers

Unsupervised learning on 3D point clouds has undergone a rapid evolution, especially thanks to data augmentation-based contrastive methods. However, data augmentation is not ideal as it requires a careful selection of the type of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Guofeng Mei , Cristiano Saltori , Fabio Poiesi , Jian Zhang , Elisa Ricci , Nicu Sebe , Qiang Wu

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

Self-supervised learning (SSL) has emerged as a promising alternative to create supervisory signals to real-world problems, avoiding the extensive cost of manual labeling. SSL is particularly attractive for unsupervised tasks such as…

Machine Learning · Computer Science 2023-07-31 Jaemin Yoo , Tiancheng Zhao , Leman Akoglu

We introduce a framework to leverage knowledge acquired from a repository of (heterogeneous) supervised datasets to new unsupervised datasets. Our perspective avoids the subjectivity inherent in unsupervised learning by reducing it to…

Artificial Intelligence · Computer Science 2018-02-19 Vikas K. Garg , Adam Kalai

Unsupervised learning allows us to leverage unlabelled data, which has become abundantly available, and to create embeddings that are usable on a variety of downstream tasks. However, the typical lack of interpretability of unsupervised…

Machine Learning · Computer Science 2023-09-29 Gregory Scafarto , Madalina Ciortan , Simon Tihon , Quentin Ferre

Over-parameterized deep neural networks have proven to be able to learn an arbitrary dataset with 100$\%$ training accuracy. Because of a risk of overfitting and computational cost issues, we cannot afford to increase the number of network…

Machine Learning · Computer Science 2019-04-08 Bukweon Kim , Sung Min Lee , Jin Keun Seo

We consider the problem of building high-level, class-specific feature detectors from only unlabeled data. For example, is it possible to learn a face detector using only unlabeled images? To answer this, we train a 9-layered locally…

Machine Learning · Computer Science 2017-04-17 Quoc V. Le , Marc'Aurelio Ranzato , Rajat Monga , Matthieu Devin , Kai Chen , Greg S. Corrado , Jeff Dean , Andrew Y. Ng

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Data augmentation has emerged as a powerful technique for improving the performance of deep neural networks and led to state-of-the-art results in computer vision. However, state-of-the-art data augmentation strongly distorts training…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Amil Merchant , Barret Zoph , Ekin Dogus Cubuk

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

For visual object recognition tasks, the illumination variations can cause distinct changes in object appearance and thus confuse the deep neural network based recognition models. Especially for some rare illumination conditions, collecting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Haipeng Zhang , Zhong Cao , Ziang Yan , Changshui Zhang

We aim at constructing a high performance model for defect detection that detects unknown anomalous patterns of an image without anomalous data. To this end, we propose a two-stage framework for building anomaly detectors using normal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Chun-Liang Li , Kihyuk Sohn , Jinsung Yoon , Tomas Pfister

Local discriminative representation is needed in many medical image analysis tasks such as identifying sub-types of lesion or segmenting detailed components of anatomical structures. However, the commonly applied supervised representation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Huai Chen , Jieyu Li , Renzhen Wang , Yijie Huang , Fanrui Meng , Deyu Meng , Qing Peng , Lisheng Wang

With the world population projected to near 10 billion by 2050, minimizing crop damage and guaranteeing food security has never been more important. Machine learning has been proposed as a solution to quickly and efficiently identify…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Frank Xiao

We propose a novel method to explain trained deep neural networks (DNNs), by distilling them into surrogate models using unsupervised clustering. Our method can be applied flexibly to any subset of layers of a DNN architecture and can…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yu-han Liu , Sercan O. Arik

The problem of feature selection has raised considerable interests in the past decade. Traditional unsupervised methods select the features which can faithfully preserve the intrinsic structures of data, where the intrinsic structures are…

Machine Learning · Computer Science 2015-04-06 Liang Du , Yi-Dong Shen

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

Learning to transfer visual attributes requires supervision dataset. Corresponding images with varying attribute values with the same identity are required for learning the transfer function. This largely limits their applications, because…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Taeksoo Kim , Byoungjip Kim , Moonsu Cha , Jiwon Kim