English
Related papers

Related papers: Self-Supervised Learning Based on Transformed Imag…

200 papers

Magnetic Resonance Imaging (MRI) represents an important diagnostic modality; however, its inherently slow acquisition process poses challenges in obtaining fully-sampled $k$-space data under motion. In the absence of fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 George Yiasemis , Nikita Moriakov , Clara I. Sánchez , Jan-Jakob Sonke , Jonas Teuwen

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu

In this study, a novel self-supervised learning (SSL) method is proposed, which considers SSL in terms of variational inference to learn not only representation but also representation uncertainties. SSL is a method of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hiroki Nakamura , Masashi Okada , Tadahiro Taniguchi

Self-supervised learning (SSL) has recently shown tremendous potential to learn generic visual representations useful for many image analysis tasks. Despite their notable success, the existing SSL methods fail to generalize to downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Chetan L Srinidhi , Anne L Martel

Self-supervised learning (SSL) representation for speech has achieved state-of-the-art (SOTA) performance on several downstream tasks. However, there remains room for improvement in speech enhancement (SE) tasks. In this study, we used a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-06 Kuo-Hsuan Hung , Szu-wei Fu , Huan-Hsin Tseng , Hsin-Tien Chiang , Yu Tsao , Chii-Wann Lin

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Eric Zimmermann , Neil Tenenholtz , James Hall , George Shaikovski , Michal Zelechowski , Adam Casson , Fausto Milletari , Julian Viret , Eugene Vorontsov , Siqi Liu , Kristen Severson

Self-Supervised Learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be…

High Energy Physics - Phenomenology · Physics 2025-02-26 Philip Harris , Michael Kagan , Jeffrey Krupa , Benedikt Maier , Nathaniel Woodward

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

Discovering what is learned by neural networks remains a challenge. In self-supervised learning, classification is the most common task used to evaluate how good a representation is. However, relying only on such downstream task can limit…

Machine Learning · Computer Science 2022-08-17 Florian Bordes , Randall Balestriero , Pascal Vincent

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

Recent research in self-supervised learning (SSL) has shown its capability in learning useful semantic representations from images for classification tasks. Through our work, we study the usefulness of SSL for Fine-Grained Visual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Muhammad Maaz , Hanoona Abdul Rasheed , Dhanalaxmi Gaddam

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Speech inpainting consists in reconstructing corrupted or missing speech segments using surrounding context, a process that closely resembles the pretext tasks in Self-Supervised Learning (SSL) for speech encoders. This study investigates…

Sound · Computer Science 2025-12-09 Ihab Asaad , Maxime Jacquelin , Olivier Perrotin , Laurent Girin , Thomas Hueber

Simplicial Embeddings (SEM) are representations learned through self-supervised learning (SSL), wherein a representation is projected into $L$ simplices of $V$ dimensions each using a softmax operation. This procedure conditions the…

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Understanding how neural representations respond to geometric transformations is essential for evaluating whether learned features preserve meaningful spatial structure. Existing approaches primarily assess robustness primarily by comparing…

Machine Learning · Computer Science 2026-05-12 Huahua Lin , Katayoun Farrahi , Xiaohao Cai