English
Related papers

Related papers: GSTBench: A Benchmark Study on the Transferability…

200 papers

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chathura Wimalasiri

Self-supervision as an emerging technique has been employed to train convolutional neural networks (CNNs) for more transferrable, generalizable, and robust representation learning of images. Its introduction to graph convolutional networks…

Machine Learning · Computer Science 2020-07-21 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Continued advances in self-supervised learning have led to significant progress in video representation learning, offering a scalable alternative to supervised approaches by removing the need for manual annotations. Despite strong…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Fida Mohammad Thoker , Letian Jiang , Chen Zhao , Piyush Bagad , Hazel Doughty , Bernard Ghanem , Cees G. M. Snoek

We present a graph-based semi-supervised learning (SSL) method for learning edge flows defined on a graph. Specifically, given flow measurements on a subset of edges, we want to predict the flows on the remaining edges. To this end, we…

Machine Learning · Computer Science 2019-05-21 Junteng Jia , Michael T. Schaub , Santiago Segarra , Austin R. Benson

Recently, pretraining methods for the Graph Neural Networks (GNNs) have been successful at learning effective representations from unlabeled graph data. However, most of these methods rely on pairwise relations in the graph and do not…

Machine Learning · Computer Science 2023-11-21 Abdalgader Abubaker , Takanori Maehara , Madhav Nimishakavi , Vassilis Plachouras

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Self-supervised learning (SSL) has emerged as a central paradigm for training foundation models by leveraging large-scale unlabeled datasets, often producing representations with strong generalization capabilities. These models are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Brown Ebouky , Ajad Chhatkuli , Cristiano Malossi , Christoph Studer , Roy Assaf , Andrea Bartezzaghi

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Graph neural networks (GNNs) are often trained on individual datasets, requiring specialized models and significant hyperparameter tuning due to the unique structures and features of each dataset. This approach limits the scalability and…

Machine Learning · Computer Science 2026-02-17 Divyansha Lachi , Mehdi Azabou , Vinam Arora , Eva Dyer

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand. Unfortunately,…

Social and Information Networks · Computer Science 2018-11-16 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Alex Bronstein , Emmanuel Müller

Graph pre-training has been concentrated on graph-level tasks involving small graphs (e.g., molecular graphs) or learning node representations on a fixed graph. Extending graph pre-trained models to web-scale graphs with billions of nodes…

Machine Learning · Computer Science 2025-11-07 Yufei He , Zhenyu Hou , Yukuo Cen , Jun Hu , Feng He , Xu Cheng , Jie Tang , Bryan Hooi

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Deep neural networks trained on Functional Connectivity (FC) networks extracted from functional Magnetic Resonance Imaging (fMRI) data have gained popularity due to the increasing availability of data and advances in model architectures,…

Machine Learning · Computer Science 2023-12-05 Jungwon Choi , Seongho Keum , EungGu Yun , Byung-Hoon Kim , Juho Lee

Self-supervised pretraining is the method of choice for natural language processing models and is rapidly gaining popularity in many vision tasks. Recently, self-supervised pretraining has shown to outperform supervised pretraining for many…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sara Atito , Muhammad Awais , Ammarah Farooq , Zhenhua Feng , Josef Kittler

Self-supervised learning (SSL) has emerged as a powerful paradigm for medical image representation learning, particularly in settings with limited labeled data. However, existing SSL methods often rely on complex architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Azad Singh , Deepak Mishra

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly…

Machine Learning · Computer Science 2024-12-25 Ahmed E. Samy , Zekarias T. Kefatoa , Sarunas Girdzijauskasa

Graphs naturally lend themselves to model the complexities of Hyperspectral Image (HSI) data as well as to serve as semi-supervised classifiers by propagating given labels among nearest neighbours. In this work, we present a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Madeleine Kotzagiannidis , Carola-Bibiane Schönlieb

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu