English
Related papers

Related papers: Spatial contrasting for deep unsupervised learning

200 papers

Estimating correspondences between pairs of non-rigid deformable 3D shapes remains a significant challenge in computer vision and graphics. While deep functional map methods have become the go-to solution for addressing this problem, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Feifan Luo , Hongyang Chen

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data.…

Machine Learning · Computer Science 2021-09-17 Xue Jiang , Jianhui Zhao , Bo Du , Zhiyong Yuan

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific…

Social and Information Networks · Computer Science 2022-02-22 Xovee Xu , Fan Zhou , Kunpeng Zhang , Siyuan Liu

Hyperspectral image (HSI) classification is gaining a lot of momentum in present time because of high inherent spectral information within the images. However, these images suffer from the problem of curse of dimensionality and usually…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shivam Pande , Nassim Ait Ali Braham , Yi Wang , Conrad M Albrecht , Biplab Banerjee , Xiao Xiang Zhu

Contrastive learning has recently demonstrated superior performance to supervised learning, despite requiring no training labels. We explore how contrastive learning can be applied to hundreds of thousands of unlabeled Mars terrain images,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Isaac Ronald Ward , Charles Moore , Kai Pak , Jingdao Chen , Edwin Goh

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

Machine Learning · Statistics 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

Self-supervised learning holds promise in leveraging large amounts of unlabeled data, however much of its progress has thus far been limited to highly curated pre-training data such as ImageNet. We explore the effects of contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yonglong Tian , Olivier J. Henaff , Aaron van den Oord

Self-supervised node representation learning aims to learn node representations from unlabelled graphs that rival the supervised counterparts. The key towards learning informative node representations lies in how to effectively gain…

Machine Learning · Computer Science 2023-02-13 Wei Dong , Dawei Yan , Peng Wang

In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive self-supervised learning to model large-scale heterogeneous data. Many existing foundation models benefit from the generalization capability…

Machine Learning · Computer Science 2024-04-02 Lecheng Zheng , Baoyu Jing , Zihao Li , Hanghang Tong , Jingrui He

Contrastive learning has demonstrated great success in representation learning, especially for image classification tasks. However, there is still a shortage in studies targeting regression tasks, and more specifically applications on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Mohamad Dhaini , Paul Honeine , Maxime Berar , Antonin Van Exem

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

The use of unsupervised data in addition to supervised data in training discriminative neural networks has improved the performance of this clas- sification scheme. However, the best results were achieved with a training process that is…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Juan Maroñas Molano , Alberto Albiol Colomer , Roberto Paredes Palacios

Deep neural networks are efficient learning machines which leverage upon a large amount of manually labeled data for learning discriminative features. However, acquiring substantial amount of supervised data, especially for videos can be a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Sujoy Paul , Sourya Roy , Amit K. Roy-Chowdhury

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

Machine Learning · Computer Science 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu