English
Related papers

Related papers: Robustness of Graph Self-Supervised Learning to Re…

200 papers

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

Inspired by the recent success of self-supervised methods applied on images, self-supervised learning on graph structured data has seen rapid growth especially centered on augmentation-based contrastive methods. However, we argue that…

Machine Learning · Computer Science 2021-12-08 Namkyeong Lee , Junseok Lee , Chanyoung Park

Pre-training Graph Foundation Models (GFMs) on text-attributed graphs (TAGs) is central to web-scale applications such as search, recommendation, and knowledge discovery. However, existing CLIP-style graph-text aligners face two key…

Machine Learning · Computer Science 2025-10-23 Yuhang Liu , Minglai Shao , Zengyi Wo , Yunlong Chu , Bing Hao , Shengzhong Liu , Ruijie Wang , Jianxin Li

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

In regularization Self-Supervised Learning (SSL) methods for graphs, computational complexity increases with the number of nodes in graphs and embedding dimensions. To mitigate the scalability of non-contrastive graph SSL, we propose a…

Machine Learning · Computer Science 2024-02-16 Ali Saheb Pasand , Reza Moravej , Mahdi Biparva , Raika Karimi , Ali Ghodsi

Structured data, such as tables, graphs, and databases, play a critical role in plentiful NLP tasks such as question answering and dialogue system. Recently, inspired by Vision-Language Models, Graph Neutral Networks (GNNs) have been…

Computation and Language · Computer Science 2025-02-11 Yao Xu , Shizhu He , Jiabei Chen , Zeng Xiangrong , Bingning Wang , Guang Liu , Jun Zhao , Kang Liu

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Developing generalizable models that can effectively learn from limited data and with minimal reliance on human supervision is a significant objective within the machine learning community, particularly in the era of deep neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wenxuan Ma , Shuang Li , Lincan Cai , Jingxuan Kang

This paper aims to provide a novel design of a multiscale framelet convolution for spectral graph neural networks (GNNs). While current spectral methods excel in various graph learning tasks, they often lack the flexibility to adapt to…

Machine Learning · Computer Science 2024-07-30 Mengxi Yang , Dai Shi , Xuebin Zheng , Jie Yin , Junbin Gao

Learning low-dimensional representations on graphs has proved to be effective in various downstream tasks. However, noises prevail in real-world networks, which compromise networks to a large extent in that edges in networks propagate…

Social and Information Networks · Computer Science 2020-12-07 Junshan Wang , Ziyao Li , Qingqing Long , Weiyu Zhang , Guojie Song , Chuan Shi

Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use…

Machine Learning · Computer Science 2022-12-26 Le Yu , Leilei Sun , Bowen Du , Tongyu Zhu , Weifeng Lv

Graph Neural Networks (GNNs) have demonstrated their effectiveness in various graph learning tasks, yet their reliance on neighborhood aggregation during inference poses challenges for deployment in latency-sensitive applications, such as…

Machine Learning · Computer Science 2024-12-06 Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

Graph Neural Networks (GNNs) have emerged as a powerful tool for representation learning on graphs, but they often suffer from overfitting and label noise issues, especially when the data is scarce or imbalanced. Different from the paradigm…

Machine Learning · Computer Science 2023-12-15 Yifan Li , Zhen Tan , Kai Shu , Zongsheng Cao , Yu Kong , Huan Liu

The era of "data deluge" has sparked renewed interest in graph-based learning methods and their widespread applications ranging from sociology and biology to transportation and communications. In this context of graph-aware methods, the…

Machine Learning · Computer Science 2020-12-30 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis

The search for new high-performance organic semiconducting molecules is challenging due to the vastness of the chemical space, machine learning methods, particularly deep learning models like graph neural networks (GNNs), have shown…

Chemical Physics · Physics 2021-12-06 Zaixi Zhang , Qi Liu , Shengyu Zhang , Chang-Yu Hsieh , Liang Shi , Chee-Kong Lee

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the…

Machine Learning · Computer Science 2024-10-07 Xingyu Ji , Jiale Liu , Lu Li , Maojun Wang , Zeyu Zhang

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

Graph domain adaptation (GDA) has achieved great attention due to its effectiveness in addressing the domain shift between train and test data. A significant bottleneck in existing graph domain adaptation methods is their reliance on…

Artificial Intelligence · Computer Science 2025-10-10 Xiangwei Lv , JinLuan Yang , Wang Lin , Jingyuan Chen , Beishui Liao