English
Related papers

Related papers: Deep unsupervised learning through spatial contras…

200 papers

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose…

Machine Learning · Computer Science 2019-01-23 Aaron van den Oord , Yazhe Li , Oriol Vinyals

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

Deep representation learning is a crucial procedure in multimedia analysis and attracts increasing attention. Most of the popular techniques rely on convolutional neural network and require a large amount of labeled data in the training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jinghua Wang , Adrian Hilton , Jianmin Jiang

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Visual place recognition is a key to unlocking spatial navigation for animals, humans and robots. While state-of-the-art approaches are trained in a supervised manner and therefore hardly capture the information needed for generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohamed Adel Musallam , Vincent Gaudillière , Djamila Aouada

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

The application of deep neural networks to remote sensing imagery is often constrained by the lack of ground-truth annotations. Adressing this issue requires models that generalize efficiently from limited amounts of labeled data, allowing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Jules Bourcier , Gohar Dashyan , Jocelyn Chanussot , Karteek Alahari

We present a new self-supervised pre-training of Vision Transformers for dense prediction tasks. It is based on a contrastive loss across views that compares pixel-level representations to global image representations. This strategy…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Jaonary Rabarisoa , Valentin Belissen , Florian Chabot , Quoc-Cuong Pham

Self-supervised learning holds promise in leveraging large amounts of unlabeled data, however much of its progress has thus far been limited to highly curated pre-training data such as ImageNet. We explore the effects of contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yonglong Tian , Olivier J. Henaff , Aaron van den Oord

Recently, deep learning approaches have become the main research frontier for biological image reconstruction and enhancement problems thanks to their high performance, along with their ultra-fast inference times. However, due to the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Mehmet Akçakaya , Burhaneddin Yaman , Hyungjin Chung , Jong Chul Ye

This paper proposes an efficient unsupervised method for detecting relevant changes between two temporally different images of the same scene. A convolutional neural network (CNN) for semantic segmentation is implemented to extract…

Neural and Evolutionary Computing · Computer Science 2019-03-22 Kevin Louis de Jong , Anna Sergeevna Bosman

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Small area change detection from synthetic aperture radar (SAR) is a highly challenging task. In this paper, a robust unsupervised approach is proposed for small area change detection from multi-temporal SAR images using deep learning.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Xinzheng Zhang , Hang Su , Ce Zhang , Xiaowei Gu , Xiaoheng Tan , Peter M. Atkinson

Self-training and contrastive learning have emerged as leading techniques for incorporating unlabeled data, both under distribution shift (unsupervised domain adaptation) and when it is absent (semi-supervised learning). However, despite…

Disentangled generative models map a latent code vector to a target space, while enforcing that a subset of the learned latent codes are interpretable and associated with distinct properties of the target distribution. Recent advances have…

Machine Learning · Computer Science 2020-08-10 Zinan Lin , Kiran Koshy Thekumparampil , Giulia Fanti , Sewoong Oh

Unsupervised learning methods for feature extraction are becoming more and more popular. We combine the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Zeyu Cao , Xiaorun Li , Liaoying Zhao

Graph contrastive learning is the state-of-the-art unsupervised graph representation learning framework and has shown comparable performance with supervised approaches. However, evaluating whether the graph contrastive learning is robust to…

Machine Learning · Computer Science 2022-01-28 Sixiao Zhang , Hongxu Chen , Xiangguo Sun , Yicong Li , Guandong Xu

Significant progress has been made in self-supervised image denoising (SSID) in the recent few years. However, most methods focus on dealing with spatially independent noise, and they have little practicality on real-world sRGB images with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junyi Li , Zhilu Zhang , Xiaoyu Liu , Chaoyu Feng , Xiaotao Wang , Lei Lei , Wangmeng Zuo

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

Accurate feature matching and correspondence in endoscopic images play a crucial role in various clinical applications, including patient follow-up and rapid anomaly localization through panoramic image generation. However, developing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Manel Farhat , Achraf Ben-Hamadou