English
Related papers

Related papers: Rethinking Graph Regularization for Graph Neural N…

200 papers

The common graph Laplacian regularizer is well-established in semi-supervised learning and spectral dimensionality reduction. However, as a first-order regularizer, it can lead to degenerate functions in high-dimensional manifolds. The…

Computer Vision and Pattern Recognition · Computer Science 2016-02-12 Kwang In Kim , James Tompkin , Hanspeter Pfister , Christian Theobalt

Stability of graph neural networks (GNNs) characterizes how GNNs react to graph perturbations and provides guarantees for architecture performance in noisy scenarios. This paper develops a self-regularized graph neural network (SR-GNN)…

Signal Processing · Electrical Eng. & Systems 2022-11-15 Zhan Gao , Elvin Isufi

While Graph Neural Networks (GNNs) recently became powerful tools in graph learning tasks, considerable efforts have been spent on improving GNNs' structural encoding ability. A particular line of work proposed subgraph GNNs that use…

Machine Learning · Computer Science 2023-10-31 Lecheng Kong , Jiarui Feng , Hao Liu , Dacheng Tao , Yixin Chen , Muhan Zhang

Regularization plays a vital role in the context of deep learning by preventing deep neural networks from the danger of overfitting. This paper proposes a novel deep learning regularization method named as DL-Reg, which carefully reduces…

Machine Learning · Computer Science 2020-11-05 Maryam Dialameh , Ali Hamzeh , Hossein Rahmani

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

Machine Learning · Computer Science 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Learning a graph with a specific structure is essential for interpretability and identification of the relationships among data. It is well known that structured graph learning from observed samples is an NP-hard combinatorial problem. In…

Machine Learning · Statistics 2019-09-26 Sandeep Kumar , Jiaxi Ying , Jos'e Vin'icius de M. Cardoso , Daniel P. Palomar

This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex knowledge reasoning tasks. The traditional RAG model has…

Information Retrieval · Computer Science 2024-11-07 Yuxin Dong , Shuo Wang , Hongye Zheng , Jiajing Chen , Zhenhong Zhang , Chihang Wang

Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on. Many works have recently proposed to…

Machine Learning · Computer Science 2022-06-24 Haorui Wang , Haoteng Yin , Muhan Zhang , Pan Li

Graph Neural Networks (GNNs) have achieved notable success in the analysis of non-Euclidean data across a wide range of domains. However, their applicability is constrained by the dependence on the observed graph structure. To solve this…

Machine Learning · Computer Science 2024-09-19 Ziyan Wang , Yaxuan He , Bin Liu

Semi-supervised learning on graph structured data has received significant attention with the recent introduction of Graph Convolution Networks (GCN). While traditional methods have focused on optimizing a loss augmented with Laplacian…

Machine Learning · Computer Science 2019-01-04 Prateek Yadav , Madhav Nimishakavi , Naganand Yadati , Shikhar Vashishth , Arun Rajkumar , Partha Talukdar

The core operation of current Graph Neural Networks (GNNs) is the aggregation enabled by the graph Laplacian or message passing, which filters the neighborhood node information. Though effective for various tasks, in this paper, we show…

Machine Learning · Computer Science 2022-11-04 Sitao Luan , Mingde Zhao , Chenqing Hua , Xiao-Wen Chang , Doina Precup

Graph neural networks are emerging as continuation of deep learning success w.r.t. graph data. Tens of different graph neural network variants have been proposed, most following a neighborhood aggregation scheme, where the node features are…

Machine Learning · Computer Science 2021-02-09 Dawei Leng , Jinjiang Guo , Lurong Pan , Jie Li , Xinyu Wang

Graph representation learning is gaining popularity in a wide range of applications, such as social networks analysis, computational biology, and recommender systems. However, different with positive results from many academic studies,…

Machine Learning · Statistics 2020-08-21 Young-Jin Park , Kyuyong Shin , Kyung-Min Kim

We consider the graph similarity computation (GSC) task based on graph edit distance (GED) estimation. State-of-the-art methods treat GSC as a learning-based prediction task using Graph Neural Networks (GNNs). To capture fine-grained…

Machine Learning · Computer Science 2024-06-24 Wei Zhuo , Guang Tan

Given graphs as input, Graph Neural Networks (GNNs) support the inference of nodes, edges, attributes, or graph properties. Graph Rewriting investigates the rule-based manipulation of graphs to model complex graph transformations. We…

Machine Learning · Computer Science 2023-05-31 Adam Machowczyk , Reiko Heckel

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

In many real world applications, data are characterized by a complex structure, that can be naturally encoded as a graph. In the last years, the popularity of deep learning techniques has renewed the interest in neural models able to…

Machine Learning · Computer Science 2020-04-20 Matteo Tiezzi , Giuseppe Marra , Stefano Melacci , Marco Maggini , Marco Gori

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan