English
Related papers

Related papers: SASSL: Enhancing Self-Supervised Learning via Neur…

200 papers

It is commonly recognized that color variations caused by differences in stains is a critical issue for histopathology image analysis. Existing methods adopt color matching, stain separation, stain transfer or the combination of them to…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Hai-Li Ye , Da-Han Wang

Using large training datasets enhances the generalization capabilities of neural networks. Semi-supervised learning (SSL) is useful when there are few labeled data and a lot of unlabeled data. SSL methods that use data augmentation are most…

Computation and Language · Computer Science 2024-01-09 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

The success of training deep Convolutional Neural Networks (CNNs) heavily depends on a significant amount of labelled data. Recent research has found that neural style transfer algorithms can apply the artistic style of one image to another…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xu Zheng , Tejo Chalasani , Koustav Ghosal , Sebastian Lutz , Aljosa Smolic

Self-supervised learning (SSL) methods have emerged as strong visual representation learners by training an image encoder to maximize similarity between features of different views of the same image. To perform this view-invariance task,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Varun Belagali , Srikar Yellapragada , Alexandros Graikos , Saarthak Kapse , Zilinghan Li , Tarak Nath Nandi , Ravi K Madduri , Prateek Prasanna , Joel Saltz , Dimitris Samaras

Self-Supervised Learning (SSL) enables training performant models using limited labeled data. One of the pillars underlying vision SSL is the use of data augmentations/perturbations of the input which do not significantly alter its semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Neha Kalibhat , Warren Morningstar , Alex Bijamov , Luyang Liu , Karan Singhal , Philip Mansfield

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Self-Supervised Learning (SSL) has allowed leveraging large amounts of unlabeled speech data to improve the performance of speech recognition models even with small annotated datasets. Despite this, speech SSL representations may fail while…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Salah Zaiem , Titouan Parcollet , Slim Essid

Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek…

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

Machine Learning · Computer Science 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL losses and conduct…

Machine Learning · Computer Science 2023-01-18 Xiang Li , Jinghuan Shang , Srijan Das , Michael S. Ryoo

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

These days deep learning is the fastest-growing area in the field of Machine Learning. Convolutional Neural Networks are currently the main tool used for image analysis and classification purposes. Although great achievements and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Agnieszka Mikołajczyk , Michał Grochowski

Self-Supervised Learning (SSL) has emerged as a powerful paradigm to mitigate the reliance on large, annotated datasets, a common bottleneck in medical image analysis. However, standard SSL methods, which rely on simple geometric and color…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Joao Batista Florindo

Unsupervised anomaly detection aims to build models to effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is…

Machine Learning · Computer Science 2022-01-04 Yuxin Zhang , Jindong Wang , Yiqiang Chen , Han Yu , Tao Qin

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Self-supervised representation learning is heavily dependent on data augmentations to specify the invariances encoded in representations. Previous work has shown that applying diverse data augmentations is crucial to downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Philip Andrew Mansfield , Arash Afkanpour , Warren Richard Morningstar , Karan Singhal

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Data augmentations play an important role in the recent success of self-supervised learning (SSL). While augmentations are commonly understood to encode invariances between different views into the learned representations, this…

Machine Learning · Computer Science 2025-06-10 Shlomo Libo Feigin , Maximilian Fleissner , Debarghya Ghoshdastidar

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak