English
Related papers

Related papers: Unsupervised Pre-Training of Image Features on Non…

200 papers

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu

Subspace clustering methods based on data self-expression have become very popular for learning from data that lie in a union of low-dimensional linear subspaces. However, the applicability of subspace clustering has been limited because…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Junjian Zhang , Chun-Guang Li , Chong You , Xianbiao Qi , Honggang Zhang , Jun Guo , Zhouchen Lin

Image smoothing represents a fundamental component of many disparate computer vision and graphics applications. In this paper, we present a unified unsupervised (label-free) learning framework that facilitates generating flexible and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Qingnan Fan , Jiaolong Yang , David Wipf , Baoquan Chen , Xin Tong

We explore the problem of classification within a medical image data-set based on a feature vector extracted from the deepest layer of pre-trained Convolution Neural Networks. We have used feature vectors from several pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Brady Kieffer , Morteza Babaie , Shivam Kalra , H. R. Tizhoosh

We present a general methodology that learns to classify images without labels by leveraging pretrained feature extractors. Our approach involves self-distillation training of clustering heads based on the fact that nearest neighbours in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Nikolas Adaloglou , Felix Michels , Hamza Kalisch , Markus Kollmann

The process of annotating relevant data in the field of digital microscopy can be both time-consuming and especially expensive due to the required technical skills and human-expert knowledge. Consequently, large amounts of microscopic image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Asmaa Haja , Eric Brouwer , Lambert Schomaker

Our goal is to extract meaningful transformations from raw images, such as varying the thickness of lines in handwriting or the lighting in a portrait. We propose an unsupervised approach to learn such transformations by attempting to…

Machine Learning · Statistics 2017-11-08 Tatsunori B. Hashimoto , John C. Duchi , Percy Liang

With the rapid development of deep learning, a variety of change detection methods based on deep learning have emerged in recent years. However, these methods usually require a large number of training samples to train the network model, so…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weidong Yan , Pei Yan , Li Cao

Large training sets have become a cornerstone of machine learning and are the foundation for recent advances in language modeling and multimodal learning. While data curation for pre-training is often still ad-hoc, one common paradigm is to…

Artificial Intelligence · Computer Science 2023-11-07 Alex Fang , Albin Madappally Jose , Amit Jain , Ludwig Schmidt , Alexander Toshev , Vaishaal Shankar

Recently, intermediate feature maps of pre-trained convolutional neural networks have shown significant perceptual quality improvements, when they are used in the loss function for training new networks. It is believed that these features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Taimoor Tariq , Okan Tarhan Tursun , Munchurl Kim , Piotr Didyk

Machine learning techniques face numerous challenges to achieve optimal performance. These include computational constraints, the limitations of single-view learning algorithms and the complexity of processing large datasets from different…

Machine Learning · Computer Science 2025-12-08 Abdelmalik Moujahid , Fadi Dornaika

Deep learning architectures are an extremely powerful tool for recognizing and classifying images. However, they require supervised learning and normally work on vectors the size of image pixels and produce the best results when trained on…

Machine Learning · Computer Science 2020-10-20 Ryan Burt , Nina N. Thigpen , Andreas Keil , Jose C. Principe

Recent advances in person re-identification have demonstrated enhanced discriminability, especially with supervised learning or transfer learning. However, since the data requirements---including the degree of data curations---are becoming…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Kshitij Nikhal , Benjamin S. Riggan

This work proposes an unsupervised fusion framework based on deep convolutional transform learning. The great learning ability of convolutional filters for data analysis is well acknowledged. The success of convolutive features owes to…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Learning visual representations of medical images (e.g., X-rays) is core to medical image understanding but its progress has been held back by the scarcity of human annotations. Existing work commonly relies on fine-tuning weights…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yuhao Zhang , Hang Jiang , Yasuhide Miura , Christopher D. Manning , Curtis P. Langlotz

Transfer learning from supervised ImageNet models has been frequently used in medical image analysis. Yet, no large-scale evaluation has been conducted to benchmark the efficacy of newly-developed pre-training techniques for medical image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Ruibin Feng , Michael B. Gotway , Jianming Liang

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv