English
Related papers

Related papers: Self-supervised learning for radio-astronomy sourc…

200 papers

The availability of large scale data with high quality ground truth labels is a challenge when developing supervised machine learning solutions for healthcare domain. Although, the amount of digital data in clinical workflows is increasing,…

Image and Video Processing · Electrical Eng. & Systems 2022-08-31 Sara Atito , Syed Muhammad Anwar , Muhammad Awais , Josef Kitler

Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Though self-supervised learning (SSL) has demonstrated incredible ability to learn robust representations from unlabeled data, the choice of optimal SSL strategy can lead to vastly different performance outcomes in specialized domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Vedrana Ivezić , Mara Pleasure , Ashwath Radhachandran , Saarang Panchavati , Shreeram Athreya , Vivek Sant , Benjamin Emert , Gregory Fishbein , Corey Arnold , William Speier

Self-Supervised Learning (SSL) presents an exciting opportunity to unlock the potential of vast, untapped clinical datasets, for various downstream applications that suffer from the scarcity of labeled data. While SSL has revolutionized…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Tassilo Wald , Constantin Ulrich , Stanislav Lukyanenko , Andrei Goncharov , Alberto Paderno , Maximilian Miller , Leander Maerkisch , Paul F. Jäger , Klaus Maier-Hein

Machine Learning algorithms are good tools for both classification and prediction purposes. These algorithms can further be used for scientific discoveries from the enormous data being collected in our era. We present ways of discovering…

Instrumentation and Methods for Astrophysics · Physics 2021-02-26 Shraddha Surana , Yogesh Wadadekar , Divya Oberoi

Self-supervised learning (SSL) methods based on Siamese networks learn visual representations by aligning different views of the same image. The multi-crop strategy, which incorporates small local crops to global ones, enhances many SSL…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Pierre-François De Plaen , Abhishek Jha , Luc Van Gool , Tinne Tuytelaars , Marc Proesmans

Deep learning has proven to be a very effective approach for Hyperspectral Image (HSI) classification. However, deep neural networks require large annotated datasets to generalize well. This limits the applicability of deep learning for HSI…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Nassim Ait Ali Braham , Lichao Mou , Jocelyn Chanussot , Julien Mairal , Xiao Xiang Zhu

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

Machine Learning · Computer Science 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Muhammad Ali , Sayed Hashim

The increasing adoption of solar energy necessitates advanced methodologies for monitoring and maintenance to ensure optimal performance of solar panel installations. A critical component in this context is the accurate segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Sankarshanaa Sagaram , Krish Didwania , Laven Srivastava , Aditya Kasliwal , Pallavi Kailas , Ujjwal Verma

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Mattson Ogg

Modern radio telescope surveys, capable of detecting billions of galaxies in wide-field surveys, have made manual morphological classification impracticable. This applies in particular when the Square Kilometre Array Observatory (SKAO)…

Astrophysics of Galaxies · Physics 2026-01-09 Philipp Denzel , Manuel Weiss , Elena Gavagnin , Frank-Peter Schilling

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

Machine Learning · Computer Science 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Joint-embedding self-supervised learning (SSL), the key paradigm for unsupervised representation learning from visual data, learns from invariances between semantically-related data pairs. We study the one-to-many mapping problem in SSL,…

Machine Learning · Computer Science 2026-02-03 Yipeng Zhang , Hafez Ghaemi , Jungyoon Lee , Shahab Bakhtiari , Eilif B. Muller , Laurent Charlin

Self-supervised learning (SSL) is an approach to extract useful feature representations from unlabeled data, and enable fine-tuning on downstream tasks with limited labeled examples. Self-pretraining is a SSL approach that uses the curated…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Jue Jiang , Aneesh Rangnekar , Harini Veeraraghavan

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hoang Hai Nam Nguyen , Phan Nguyen Duc Hieu , Ho Won Lee

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan