English
Related papers

Related papers: Beyond Homophily with Graph Echo State Networks

200 papers

While a growing body of literature has been studying new Graph Neural Networks (GNNs) that work on both homophilic and heterophilic graphs, little has been done on adapting classical GNNs to less-homophilic graphs. Although the ability to…

Machine Learning · Computer Science 2024-04-30 Shouheng Li , Dongwoo Kim , Qing Wang

Graph Neural Networks (GNNs) have been broadly applied in many urban applications upon formulating a city as an urban graph whose nodes are urban objects like regions or points of interest. Recently, a few enhanced GNN architectures have…

Machine Learning · Computer Science 2023-06-22 Congxi Xiao , Jingbo Zhou , Jizhou Huang , Tong Xu , Hui Xiong

Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initialization and two-layer…

Computation and Language · Computer Science 2023-01-26 Jiayuan Chen , Boyu Zhang , Yinfei Xu , Meng Wang

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)?…

Machine Learning · Computer Science 2023-06-27 Shuaicheng Zhang , Haohui Wang , Si Zhang , Dawei Zhou

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

In the context of machine learning for graphs, many researchers have empirically observed that Deep Graph Networks (DGNs) perform favourably on node classification tasks when the graph structure is homophilic (\ie adjacent nodes are…

Machine Learning · Computer Science 2024-05-03 Daniele Castellana

The success of graph embeddings or node representation learning in a variety of downstream tasks, such as node classification, link prediction, and recommendation systems, has led to their popularity in recent years. Representation learning…

Machine Learning · Computer Science 2018-09-07 Saba A. Al-Sayouri , Danai Koutra , Evangelos E. Papalexakis , Sarah S. Lam

Graph similarity learning (GSL), also referred to as graph matching in many scenarios, is a fundamental problem in computer vision, pattern recognition, and graph learning. However, previous GSL methods assume that graphs are homogeneous…

Machine Learning · Computer Science 2025-03-13 Shilong Sang , Ke-Jia Chen , Zheng liu

Graph neural networks (GNNs) have achieved great success in various graph problems. However, most GNNs are Message Passing Neural Networks (MPNNs) based on the homophily assumption, where nodes with the same label are connected in graphs.…

Machine Learning · Computer Science 2022-10-18 Junjie Xu , Enyan Dai , Xiang Zhang , Suhang Wang

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Echo State Networks (ESNs) are a reservoir computing framework widely used for nonlinear time-series prediction. However, despite their effectiveness, randomly initialized reservoirs often contain redundant nodes, leading to unnecessary…

Machine Learning · Computer Science 2026-05-07 Sudip Laudari

Graph neural networks (GNNs) based methods have achieved impressive performance on node clustering task. However, they are designed on the homophilic assumption of graph and clustering on heterophilic graph is overlooked. Due to the lack of…

Social and Information Networks · Computer Science 2023-05-09 Erlin Pan , Zhao Kang

This paper proposes a novel and interpretable recurrent neural-network structure using the echo-state network (ESN) paradigm for time-series prediction. While the traditional ESNs perform well for dynamical systems prediction, it needs a…

Machine Learning · Computer Science 2024-04-01 Debdipta Goswami

In real-world applications such as emotion recognition from recorded brain activity, data are captured from electrodes over time. These signals constitute a multidimensional time series. In this paper, Echo State Network (ESN), a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Rahma Fourati , Boudour Ammar , Javier Sanchez-Medina , Adel M. Alimi

In recent years, hypergraph learning has attracted great attention due to its capacity in representing complex and high-order relationships. However, current neural network approaches designed for hypergraphs are mostly shallow, thus…

Machine Learning · Computer Science 2022-11-03 Guanzi Chen , Jiying Zhang , Xi Xiao , Yang Li

Reservoir Computing (RC) is a popular methodology for the efficient design of Recurrent Neural Networks (RNNs). Recently, the advantages of the RC approach have been extended to the context of multi-layered RNNs, with the introduction of…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

Graph Neural Network (GNN), with the main idea of encoding graph structure information of graphs by propagation and aggregation, has developed rapidly. It achieved excellent performance in representation learning of multiple types of graphs…

Machine Learning · Computer Science 2024-07-04 Yushan Zhu , Wen Zhang , Yajing Xu , Zhen Yao , Mingyang Chen , Huajun Chen

Graph convolutional networks learn effective node embeddings that have proven to be useful in achieving high-accuracy prediction results in semi-supervised learning tasks, such as node classification. However, these networks suffer from the…

Machine Learning · Computer Science 2020-10-21 Mahsa Mesgaran , A. Ben Hamza

Graph Neural Networks (GNNs) learn node representations through iterative network-based message-passing. While powerful, deep GNNs suffer from oversmoothing, where node features converge to a homogeneous, non-informative state. We re-frame…

Machine Learning · Computer Science 2026-02-18 Erkan Turan , Gaspard Abel , Maysam Behmanesh , Emery Pierson , Maks Ovsjanikov

Graph Neural Networks (GNNs) achieve state-of-the-art performance on graph-structured data across numerous domains. Their underlying ability to represent nodes as summaries of their vicinities has proven effective for homophilous graphs in…

Machine Learning · Computer Science 2022-12-27 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio