English
Related papers

Related papers: HypeBoy: Generative Self-Supervised Representation…

200 papers

Self-supervised node representation learning aims to learn node representations from unlabelled graphs that rival the supervised counterparts. The key towards learning informative node representations lies in how to effectively gain…

Machine Learning · Computer Science 2023-02-13 Wei Dong , Dawei Yan , Peng Wang

Much progress has been made in semi-supervised learning (SSL) by combining methods that exploit different aspects of the data distribution, e.g. consistency regularisation relies on properties of $p(x)$, whereas entropy minimisation…

Machine Learning · Computer Science 2021-06-01 Carl Allen , Ivana Balažević , Timothy Hospedales

In this paper, we investigate what constitutes a good representation or model in self-supervised learning (SSL). We argue that a good representation should exhibit universality, characterized by three essential properties: discriminability,…

Machine Learning · Computer Science 2025-05-19 Wenwen Qiang , Jingyao Wang , Changwen Zheng , Hui Xiong , Gang Hua

Self-supervised learning (SSL) has emerged as a desirable paradigm in computer vision due to the inability of supervised models to learn representations that can generalize in domains with limited labels. The recent popularity of SSL has…

Machine Learning · Computer Science 2022-09-20 Romain Cosentino , Sarath Shekkizhar , Mahdi Soltanolkotabi , Salman Avestimehr , Antonio Ortega

Graph self-supervised learning (GSSL) has demonstrated strong potential for generating expressive graph embeddings without the need for human annotations, making it particularly valuable in domains with high labeling costs such as molecular…

Machine Learning · Computer Science 2026-02-25 Jiele Wu , Haozhe Ma , Zhihan Guo , Thanh Vinh Vo , Tze Yun Leong

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

In contrast to regular (simple) networks, hyper networks possess the ability to depict more complex relationships among nodes and store extensive information. Such networks are commonly found in real-world applications, such as in social…

Social and Information Networks · Computer Science 2023-11-08 Shu Liu , Cameron Lai , Fujio Toriumi

Representation learning methods for heterogeneous networks produce a low-dimensional vector embedding for each node that is typically fixed for all tasks involving the node. Many of the existing methods focus on obtaining a static vector…

Machine Learning · Computer Science 2021-04-28 Ping Wang , Khushbu Agarwal , Colby Ham , Sutanay Choudhury , Chandan K. Reddy

Semi-supervised learning (SSL) is an indispensable tool when there are few labeled entities and many unlabeled entities for which we want to predict labels. With graph-based methods, entities correspond to nodes in a graph and edges…

Machine Learning · Computer Science 2017-01-23 Edith Cohen

We present a method for learning multiple scene representations given a small labeled set, by exploiting the relationships between such representations in the form of a multi-task hypergraph. We also show how we can use the hypergraph to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Alina Marcu , Mihai Pirvu , Dragos Costea , Emanuela Haller , Emil Slusanschi , Ahmed Nabil Belbachir , Rahul Sukthankar , Marius Leordeanu

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xin Zhang , Liangxiu Han

E-commerce companies have to face abnormal sellers who sell potentially-risky products. Typically, the risk can be identified by jointly considering product content (e.g., title and image) and seller behavior. This work focuses on behavior…

Computation and Language · Computer Science 2021-06-15 Runshi Liu , Pengda Qin , Yuhong Li , Weigao Wen , Dong Li , Kefeng Deng , Qiang Wu

This paper studies unsupervised/self-supervised whole-graph representation learning, which is critical in many tasks such as molecule properties prediction in drug and material discovery. Existing methods mainly focus on preserving the…

Machine Learning · Computer Science 2021-06-09 Minghao Xu , Hang Wang , Bingbing Ni , Hongyu Guo , Jian Tang

Deep semi-supervised learning (SSL) has experienced significant attention in recent years, to leverage a huge amount of unlabeled data to improve the performance of deep learning with limited labeled data. Pseudo-labeling is a popular…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Xiaopeng Yan , Riquan Chen , Litong Feng , Jingkang Yang , Huabin Zheng , Wayne Zhang

Node classification on static graphs has achieved significant success, but achieving accurate node classification on dynamic graphs where node topology, attributes, and labels change over time has not been well addressed. Existing methods…

Social and Information Networks · Computer Science 2024-12-31 Xiaoxu Ma , Chen Zhao , Minglai Shao , Yujie Lin

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

Machine Learning · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

To take full advantage of fast-growing unlabeled networked data, this paper introduces a novel self-supervised strategy for graph representation learning by exploiting natural supervision provided by the data itself. Inspired by human…

Machine Learning · Computer Science 2025-11-20 Zhen Peng , Yixiang Dong , Minnan Luo , Xiao-Ming Wu , Qinghua Zheng

Self-supervised learning (SSL) in graphs has garnered significant attention, particularly in employing Graph Neural Networks (GNNs) with pretext tasks initially designed for other domains, such as contrastive learning and feature…

Machine Learning · Computer Science 2025-04-17 Heesoo Jung , Hogun Park

Hypergraph structure learning, which aims to learn the hypergraph structures from the observed signals to capture the intrinsic high-order relationships among the entities, becomes crucial when a hypergraph topology is not readily available…

Machine Learning · Computer Science 2025-03-12 Bohan Tang , Siheng Chen , Xiaowen Dong