English
Related papers

Related papers: Scalable Graph Self-Supervised Learning

200 papers

Self-supervised learning (SSL), especially contrastive methods, has raised attraction recently as it learns effective transferable representations without semantic annotations. A common practice for self-supervised pre-training is to use as…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhili Liu , Jianhua Han , Lanqing Hong , Hang Xu , Kai Chen , Chunjing Xu , Zhenguo Li

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

Machine Learning · Computer Science 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Effective suppression of surface-related multiples is essential to prevent imaging artifacts and erroneous structural interpretations. While conventional approaches rely on accurate priors or subsurface model knowledge, and supervised…

Geophysics · Physics 2026-05-01 Huan Song , Shijun Cheng , Huanhuan Tang , Wei Ouyang , Weijian Mao

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

Machine Learning · Computer Science 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

We present a novel cost function for semi-supervised learning of neural networks that encourages compact clustering of the latent space to facilitate separation. The key idea is to dynamically create a graph over embeddings of labeled and…

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Graph self-supervised learning (SSL) holds considerable promise for mining and learning with graph-structured data. Yet, a significant challenge in graph SSL lies in the feature discrepancy among graphs across different domains. In this…

Machine Learning · Computer Science 2024-06-06 Zhenyu Hou , Haozhan Li , Yukuo Cen , Jie Tang , Yuxiao Dong

Graph-based Semi-supervised learning (SSL) algorithms have been successfully used in a large number of applications. These methods classify initially unlabeled nodes by propagating label information over the structure of graph starting from…

Machine Learning · Computer Science 2014-03-03 Partha Pratim Talukdar , William Cohen

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

Self-supervised learning (SSL) has shown great promise in graph representation learning. However, most existing graph SSL methods are developed and evaluated under a single-dataset setting, leaving their cross-dataset transferability…

Machine Learning · Computer Science 2025-09-10 Yu Song , Zhigang Hua , Yan Xie , Jingzhe Liu , Bo Long , Hui Liu

Semi-supervised learning (SSL) addresses the critical challenge of training accurate models when labeled data is scarce but unlabeled data is abundant. Graph-based SSL (GSSL) has emerged as a popular framework that captures data structure…

Machine Learning · Statistics 2026-02-10 Nadav Katz , Ariel Jaffe

In this paper, we tackle the problem of online semi-supervised learning (SSL). When data arrive in a stream, the dual problems of computation and data storage arise for any SSL method. We propose a fast approximate online SSL algorithm that…

Machine Learning · Computer Science 2012-03-19 Michal Valko , Branislav Kveton , Ling Huang , Daniel Ting

A wide range of graph embedding objectives decompose into two components: one that enforces similarity, attracting the embeddings of nodes that are perceived as similar, and another that enforces dissimilarity, repelling the embeddings of…

Machine Learning · Computer Science 2025-06-03 David Liu , Arjun Seshadri , Tina Eliassi-Rad , Johan Ugander

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

Our capacity to learn representations from data is related to our ability to design filters that can leverage their coupling with the underlying domain. Graph filters are one such tool for network data and have been used in a myriad of…

Signal Processing · Electrical Eng. & Systems 2022-03-16 Bishwadeep Das , Elvin Isufi

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

The abundance of complex and interconnected healthcare data offers numerous opportunities to improve prediction, diagnosis, and treatment. Graph-structured data, which includes entities and their relationships, is well-suited for capturing…

Machine Learning · Computer Science 2024-12-10 Safa Ben Atitallah , Chaima Ben Rabah , Maha Driss , Wadii Boulila , Anis Koubaa

Graph-based semi-supervised learning (SSL) algorithms predict labels for all nodes based on provided labels of a small set of seed nodes. Classic methods capture the graph structure through some underlying diffusion process that propagates…

Machine Learning · Computer Science 2017-03-16 Eliav Buchnik , Edith Cohen