English
Related papers

Related papers: Resampling Augmentation for Time Series Contrastiv…

200 papers

Machine learning methods for satellite data have a range of societally relevant applications, but labels used to train models can be difficult or impossible to acquire. Self-supervision is a natural solution in settings with limited labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Gabriel Tseng , Ruben Cartuyvels , Ivan Zvonkov , Mirali Purohit , David Rolnick , Hannah Kerner

Self-supervised learning (SSL) has the potential to benefit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yanhao Wu , Tong Zhang , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Due to the latest advances in technology, telescopes with significant sky coverage will produce millions of astronomical alerts per night that must be classified both rapidly and automatically. Currently, classification consists of…

Instrumentation and Methods for Astrophysics · Physics 2022-08-17 Germán García-Jara , Pavlos Protopapas , Pablo A. Estévez

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

While image data starts to enjoy the simple-but-effective self-supervised learning scheme built upon masking and self-reconstruction objective thanks to the introduction of tokenization procedure and vision transformer backbone,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zhi-Yi Chin , Chieh-Ming Jiang , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu

In this work, we propose a simple yet effective semi-supervised learning approach called Augmented Distribution Alignment. We reveal that an essential sampling bias exists in semi-supervised learning due to the limited number of labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Qin Wang , Wen Li , Luc Van Gool

Lack of annotated samples greatly restrains the direct application of deep learning in remote sensing image scene classification. Although researches have been done to tackle this issue by data augmentation with various image transformation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Dongao Ma , Ping Tang , Lijun Zhao

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

Domain adaptive object re-ID aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain to tackle the open-class re-identification problems. Although state-of-the-art pseudo-label-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yixiao Ge , Feng Zhu , Dapeng Chen , Rui Zhao , Hongsheng Li

The success of self-supervised contrastive learning hinges on identifying positive data pairs, such that when they are pushed together in embedding space, the space encodes useful information for subsequent downstream tasks. Constructing…

Machine Learning · Computer Science 2024-10-29 Maxwell A. Xu , Alexander Moreno , Hui Wei , Benjamin M. Marlin , James M. Rehg

Label-scarce, high-dimensional domains such as healthcare present a challenge for modern machine learning techniques. To overcome the difficulties posed by a lack of labeled data, we explore an "order-contrastive" method for self-supervised…

Machine Learning · Computer Science 2022-03-30 Monica Agrawal , Hunter Lang , Michael Offin , Lior Gazit , David Sontag

Modern neural recording techniques such as two-photon imaging or Neuropixel probes allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework…

Deep learning models are modern tools for spatio-temporal graph (STG) forecasting. Though successful, we argue that data scarcity is a key factor limiting their recent improvements. Meanwhile, contrastive learning has been an effective…

Machine Learning · Computer Science 2022-11-04 Xu Liu , Yuxuan Liang , Chao Huang , Yu Zheng , Bryan Hooi , Roger Zimmermann

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

Machine Learning · Computer Science 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

Remote sensing images are useful for a wide variety of planet monitoring applications, from tracking deforestation to tackling illegal fishing. The Earth is extremely diverse -- the amount of potential tasks in remote sensing images is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Favyen Bastani , Piper Wolters , Ritwik Gupta , Joe Ferdinando , Aniruddha Kembhavi

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Automatic Target Recognition (ATR) algorithms classify a given Synthetic Aperture Radar (SAR) image into one of the known target classes using a set of training images available for each class. Recently, learning methods have shown to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Tushar Agarwal , Nithin Sugavanam , Emre Ertin