English
Related papers

Related papers: HypeBoy: Generative Self-Supervised Representation…

200 papers

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

In this paper, we present a hypergraph neural networks (HGNN) framework for data representation learning, which can encode high-order data correlation in a hypergraph structure. Confronting the challenges of learning representation for…

Machine Learning · Computer Science 2019-02-26 Yifan Feng , Haoxuan You , Zizhao Zhang , Rongrong Ji , Yue Gao

Recently, hyperbolic space has risen as a promising alternative for semi-supervised graph representation learning. Many efforts have been made to design hyperbolic versions of neural network operations. However, the inspiring geometric…

Machine Learning · Computer Science 2022-01-24 Jiahong Liu , Menglin Yang , Min Zhou , Shanshan Feng , Philippe Fournier-Viger

Hypergraph Neural Networks (HyGNNs) have demonstrated remarkable success in modeling higher-order relationships among entities. However, their performance often degrades on heterophilic hypergraphs, where nodes connected by the same…

Machine Learning · Computer Science 2026-02-17 Tianyi Ma , Yiyue Qian , Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

Machine Learning · Computer Science 2026-01-16 Berken Utku Demirel , Christian Holz

Graph Neural Networks (GNNs) struggle to balance heterophily and homophily in representation learning, a challenge further amplified in self-supervised settings. We propose H$^3$GNNs, an end-to-end self-supervised learning framework that…

Machine Learning · Computer Science 2025-04-17 Rui Xue , Tianfu Wu

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

Machine Learning · Computer Science 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

Heterogeneous graph representation learning aims to learn low-dimensional vector representations of different types of entities and relations to empower downstream tasks. Existing methods either capture semantic relationships but indirectly…

Machine Learning · Computer Science 2025-08-14 Hao Xu , Shengqi Sang , Peizhen Bai , Laurence Yang , Haiping Lu

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Hypergraph data, which capture multi-way interactions among entities, are increasingly prevalent in the big data era. Generating new hyperlinks from an observed, usually high-dimensional hypergraph is an important yet challenging task with…

Methodology · Statistics 2026-05-14 Shihao Wu , Junyi Yang , Gongjun Xu , Ji Zhu

Graph neural networks have shown superior performance in a wide range of applications providing a powerful representation of graph-structured data. Recent works show that the representation can be further improved by auxiliary tasks.…

Machine Learning · Computer Science 2021-02-09 Dasol Hwang , Jinyoung Park , Sunyoung Kwon , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

Graph neural networks~(GNNs) apply deep learning techniques to graph-structured data and have achieved promising performance in graph representation learning. However, existing GNNs rely heavily on enough labels or well-designed negative…

Machine Learning · Computer Science 2020-11-13 Feihu Che , Guohua Yang , Dawei Zhang , Jianhua Tao , Pengpeng Shao , Tong Liu

Self-supervised learning (SSL) aims to learn intrinsic features without labels. Despite the diverse architectures of SSL methods, the projection head always plays an important role in improving the performance of the downstream task. In…

Machine Learning · Computer Science 2023-01-31 Jiajun Ma , Tianyang Hu , Wenjia Wang

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Over the past few years, graph representation learning (GRL) has been a powerful strategy for analyzing graph-structured data. Recently, GRL methods have shown promising results by adopting self-supervised learning methods developed for…

Machine Learning · Computer Science 2022-09-05 Namkyeong Lee , Dongmin Hyun , Junseok Lee , Chanyoung Park

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are…

Machine Learning · Computer Science 2022-04-19 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong

Self-supervised learning (SSL) approaches have shown promising capabilities in learning the representation from unlabeled data. Amongst them, momentum-based frameworks have attracted significant attention. Despite being a great success,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Trung X. Pham , Axi Niu , Zhang Kang , Sultan Rizky Madjid , Ji Woo Hong , Daehyeok Kim , Joshua Tian Jin Tee , Chang D. Yoo

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux