English
Related papers

Related papers: Cold Brew: Distilling Graph Node Representations w…

200 papers

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Graph Neural Networks (GNNs) have shown superior performance for semi-supervised learning of numerous web applications, such as classification on web services and pages, analysis of online social networks, and recommendation in e-commerce.…

Social and Information Networks · Computer Science 2023-06-06 Keke Huang , Jing Tang , Juncheng Liu , Renchi Yang , Xiaokui Xiao

Graph Neural Networks (GNNs) achieve state-of-the-art performance on graph-structured data across numerous domains. Their underlying ability to represent nodes as summaries of their vicinities has proven effective for homophilous graphs in…

Machine Learning · Computer Science 2022-12-27 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

Machine Learning · Computer Science 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) have achieved tremendous success in various real-world applications due to their strong ability in graph representation learning. GNNs explore the graph structure and node features by aggregating and…

Machine Learning · Computer Science 2021-03-09 Wei Jin , Tyler Derr , Yiqi Wang , Yao Ma , Zitao Liu , Jiliang Tang

Given the prevalence of large-scale graphs in real-world applications, the storage and time for training neural models have raised increasing concerns. To alleviate the concerns, we propose and study the problem of graph condensation for…

Machine Learning · Computer Science 2022-09-29 Wei Jin , Lingxiao Zhao , Shichang Zhang , Yozen Liu , Jiliang Tang , Neil Shah

Cold start is an essential and persistent problem in recommender systems. State-of-the-art solutions rely on training hybrid models for both cold-start and existing users/items, based on the auxiliary information. Such a hybrid model would…

Information Retrieval · Computer Science 2022-09-27 Hao Chen , Zefan Wang , Yue Xu , Xiao Huang , Feiran Huang

Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling…

Machine Learning · Computer Science 2023-08-03 Zhiyuan Ning , Pengfei Wang , Pengyang Wang , Ziyue Qiao , Wei Fan , Denghui Zhang , Yi Du , Yuanchun Zhou

Graph Neural Networks (GNNs) are gaining extensive attention for their application in graph data. However, the black-box nature of GNNs prevents users from understanding and trusting the models, thus hampering their applicability. Whereas…

Machine Learning · Computer Science 2023-05-23 Qizhang Feng , Ninghao Liu , Fan Yang , Ruixiang Tang , Mengnan Du , Xia Hu

Graph neural networks (GNNs) have achieved remarkable advances in graph-oriented tasks. However, real-world graphs invariably contain a certain proportion of heterophilous nodes, challenging the homophily assumption of traditional GNNs and…

Machine Learning · Computer Science 2025-02-04 Jiajun Zhou , Shengbo Gong , Xuanze Chen , Chenxuan Xie , Shanqing Yu , Qi Xuan , Xiaoniu Yang

The cold start problem in recommender systems is a long-standing challenge, which requires recommending to new users (items) based on attributes without any historical interaction records. In these recommendation systems, warm users (items)…

Information Retrieval · Computer Science 2021-06-01 Shuai Wang , Kun Zhang , Le Wu , Haiping Ma , Richang Hong , Meng Wang

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Graph Neural Networks (GNNs) have emerged as the de facto standard for representation learning on graphs, owing to their ability to effectively integrate graph topology and node attributes. However, the inherent suboptimal nature of node…

Machine Learning · Computer Science 2023-12-27 Zhiyao Zhou , Sheng Zhou , Bochao Mao , Xuanyi Zhou , Jiawei Chen , Qiaoyu Tan , Daochen Zha , Yan Feng , Chun Chen , Can Wang

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Graph convolution is the core of most Graph Neural Networks (GNNs) and usually approximated by message passing between direct (one-hop) neighbors. In this work, we remove the restriction of using only the direct neighbors by introducing a…

Social and Information Networks · Computer Science 2022-04-06 Johannes Gasteiger , Stefan Weißenberger , Stephan Günnemann

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). Despite their great academic success, Multi-Layer Perceptrons (MLPs) remain the primary workhorse for practical industrial…

Machine Learning · Computer Science 2023-06-06 Lirong Wu , Jun Xia , Haitao Lin , Zhangyang Gao , Zicheng Liu , Guojiang Zhao , Stan Z. Li