English
Related papers

Related papers: PyG-SSL: A Graph Self-Supervised Learning Toolkit

200 papers

Self-supervised learning (SSL) has gained significant interest in recent years as a solution to address the challenges posed by sparse and noisy data in recommender systems. Despite the growing number of SSL algorithms designed to provide…

Information Retrieval · Computer Science 2024-01-31 Xubin Ren , Lianghao Xia , Yuhao Yang , Wei Wei , Tianle Wang , Xuheng Cai , Chao Huang

Graph structure learning (GSL), which aims to learn the adjacency matrix for graph neural networks (GNNs), has shown great potential in boosting the performance of GNNs. Most existing GSL works apply a joint learning framework where the…

Machine Learning · Computer Science 2023-03-02 Jianan Zhao , Qianlong Wen , Mingxuan Ju , Chuxu Zhang , Yanfang Ye

Self-Supervised Learning (SSL) has demonstrated strong performance in speech processing, particularly in automatic speech recognition. In this paper, we explore an SSL pretraining framework that leverages masked language modeling with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Aleksandr Kutsakov , Alexandr Maximenko , Georgii Gospodinov , Pavel Bogomolov , Fyodor Minkin

Graph representation learning (GRL) is a fundamental task in machine learning, aiming to encode high-dimensional graph-structured data into low-dimensional vectors. Self-supervised learning (SSL) methods are widely used in GRL because they…

Machine Learning · Computer Science 2024-11-12 Shifeng Xie , Jhony H. Giraldo

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

Graph neural networks (GNNs) have recently emerged as a promising learning paradigm in learning graph-structured data and have demonstrated wide success across various domains such as recommendation systems, social networks, and electronic…

Machine Learning · Computer Science 2023-04-25 Ruixuan Wang , Fred Lin , Daniel Moore , Sriram Sankar , Xun Jiao

We present an open-source, pip installable toolkit, Sig-Networks, the first of its kind for longitudinal language modelling. A central focus is the incorporation of Signature-based Neural Network models, which have recently shown success in…

Computation and Language · Computer Science 2024-02-07 Talia Tseriotou , Ryan Sze-Yin Chan , Adam Tsakalidis , Iman Munire Bilal , Elena Kochkina , Terry Lyons , Maria Liakata

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

Computation and Language · Computer Science 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

Machine Learning · Computer Science 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

The proliferation of various data sources in urban and territorial environments has significantly facilitated the development of geospatial artificial intelligence (GeoAI) across a wide range of geospatial applications. However, geospatial…

Artificial Intelligence · Computer Science 2025-04-28 Yile Chen , Weiming Huang , Kaiqi Zhao , Yue Jiang , Gao Cong

Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Suichan Li , Bin Liu , Dongdong Chen , Qi Chu , Lu Yuan , Nenghai Yu

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

As Graph Neural Networks (GNNs) become increasingly prevalent in a variety of fields, from social network analysis to protein-protein interaction studies, growing concerns have emerged regarding the unauthorized utilization of personal…

Cryptography and Security · Computer Science 2023-10-12 Yixin Liu , Chenrui Fan , Xun Chen , Pan Zhou , Lichao Sun

Over the past few years, graph neural networks (GNNs) have become powerful and practical tools for learning on (static) graph-structure data. However, many real-world applications, such as social networks and e-commerce, involve temporal…

In recent years, phishing scams have become the crime type with the largest money involved on Ethereum, the second-largest blockchain platform. Meanwhile, graph neural network (GNN) has shown promising performance in various node…

Machine Learning · Computer Science 2021-06-21 Shucheng Li , Fengyuan Xu , Runchuan Wang , Sheng Zhong

Attributed Graph Clustering (AGC) is a fundamental unsupervised task that integrates structural topology and node attributes to uncover latent patterns in graph-structured data. Despite its significance in industrial applications such as…

Machine Learning · Computer Science 2026-02-10 Yunhui Liu , Pengyu Qiu , Yu Xing , Yongchao Liu , Peng Du , Chuntao Hong , Jiajun Zheng , Tao Zheng , Tieke He

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

The success of graph neural networks on graph-based web mining highly relies on abundant human-annotated data, which is laborious to obtain in practice. When only few labeled nodes are available, how to improve their robustness is a key to…

Machine Learning · Computer Science 2022-12-13 Kaize Ding , Elnaz Nouri , Guoqing Zheng , Huan Liu , Ryen White