English
Related papers

Related papers: Layer-wise training for self-supervised learning o…

200 papers

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

Machine Learning · Computer Science 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Theoretical studies on the representation power of GNNs have been centered around understanding the equivalence of GNNs, using WL-Tests for detecting graph isomorphism. In this paper, we argue that such equivalence ignores the accompanying…

Machine Learning · Computer Science 2024-08-26 P. Krishna Kumar a , Harish G. Ramaswamy

Self-supervision as an emerging technique has been employed to train convolutional neural networks (CNNs) for more transferrable, generalizable, and robust representation learning of images. Its introduction to graph convolutional networks…

Machine Learning · Computer Science 2020-07-21 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

Graph neural networks (GNNs) have achieved superior performance in various applications, but training dedicated GNNs can be costly for large-scale graphs. Some recent work started to study the pre-training of GNNs. However, none of them…

Machine Learning · Computer Science 2021-10-27 Qi Zhu , Carl Yang , Yidan Xu , Haonan Wang , Chao Zhang , Jiawei Han

In this work, we study the problem of decentralized multi-agent perimeter defense that asks for computing actions for defenders with local perceptions and communications to maximize the capture of intruders. One major challenge for…

Multiagent Systems · Computer Science 2023-01-25 Elijah S. Lee , Lifeng Zhou , Alejandro Ribeiro , Vijay Kumar

We study the problem of learning features through self-supervision that are generalisable to multiple graphs. State-of-the-art graph self-supervision restricts training to only one graph, resulting in graph-specific models that are…

Machine Learning · Computer Science 2024-07-31 Laya Das , Sai Munikoti , Nrushad Joshi , Mahantesh Halappanavar

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

Information Retrieval · Computer Science 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

Graph neural networks aim to learn representations for graph-structured data and show impressive performance, particularly in node classification. Recently, many methods have studied the representations of GNNs from the perspective of…

Machine Learning · Computer Science 2023-05-30 Jiaqi Sun , Lin Zhang , Guangyi Chen , Kun Zhang , Peng XU , Yujiu Yang

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Graph neural networks (GNNs) have shown great power in learning on attributed graphs. However, it is still a challenge for GNNs to utilize information faraway from the source node. Moreover, general GNNs require graph attributes as input,…

Machine Learning · Computer Science 2021-12-28 Danhao Zhu , Xin-yu Dai , Jiajun Chen

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu

Graph Neural Networks (GNN) have been extensively used to extract meaningful representations from graph structured data and to perform predictive tasks such as node classification and link prediction. In recent years, there has been a lot…

Image and Video Processing · Electrical Eng. & Systems 2020-07-10 Arijit Sehanobish , Neal G. Ravindra , David van Dijk

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Modern deep neural networks (DNNs) are typically trained with a global cross-entropy loss in a supervised end-to-end manner: neurons need to store their outgoing weights; training alternates between a forward pass (computation) and a…

Machine Learning · Computer Science 2025-11-03 Shuyan Lyu , Zhanzimo Wu , Junliang Du

The application of deep learning to symbolic domains remains an active research endeavour. Graph neural networks (GNN), consisting of trained neural modules which can be arranged in different topologies at run time, are sound alternatives…

Social and Information Networks · Computer Science 2019-12-02 Pedro H. C. Avelar , Henrique Lemos , Marcelo O. R. Prates , Luis Lamb

Classical graph algorithms work well for combinatorial problems that can be thoroughly formalized and abstracted. Once the algorithm is derived, it generalizes to instances of any size. However, developing an algorithm that handles complex…

Machine Learning · Computer Science 2022-12-12 Florian Grötschla , Joël Mathys , Roger Wattenhofer

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

Machine Learning · Computer Science 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Graph neural networks (GNNs) are composed of layers consisting of graph convolutions and pointwise nonlinearities. Due to their invariance and stability properties, GNNs are provably successful at learning representations from data…

Machine Learning · Computer Science 2023-08-09 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro