English
Related papers

Related papers: Facilitating Graph Neural Networks with Random Wal…

200 papers

Random walk sampling methods have been widely used in graph sampling in recent years, while it has bias towards higher degree nodes in the sample. To overcome this deficiency, classical methods such as MHRW design weighted walking by…

Methodology · Statistics 2022-09-27 Xiao Qi

The random walk is a fundamental stochastic process that underlies many numerical tasks in scientific computing applications. We consider here two neural algorithms that can be used to efficiently implement random walks on spiking…

Neural and Evolutionary Computing · Computer Science 2018-05-03 William Severa , Rich Lehoucq , Ojas Parekh , James B. Aimone

Our objective is to sample the node set of a large unknown graph via crawling, to accurately estimate a given metric of interest. We design a random walk on an appropriately defined weighted graph that achieves high efficiency by…

Social and Information Networks · Computer Science 2011-03-29 M. Kurant , M. Gjoka , C. T. Butts , A. Markopoulou

Message-passing graph neural networks (GNNs) excel at capturing local relationships but struggle with long-range dependencies in graphs. In contrast, graph transformers (GTs) enable global information exchange but often oversimplify the…

Machine Learning · Computer Science 2024-10-08 Dexiong Chen , Till Hendrik Schulz , Karsten Borgwardt

Several state-of-the-art neural graph embedding methods are based on short random walks (stochastic processes) because of their ease of computation, simplicity in capturing complex local graph properties, scalability, and interpretibility.…

Machine Learning · Computer Science 2020-07-30 Charu Sharma , Jatin Chauhan , Manohar Kaul

We propose a flexible framework for clustering hypergraph-structured data based on recently proposed random walks utilizing edge-dependent vertex weights. When incorporating edge-dependent vertex weights (EDVW), a weight is associated with…

Machine Learning · Computer Science 2020-10-28 Koby Hayashi , Sinan G. Aksoy , Cheong Hee Park , Haesun Park

Simplicial complexes are generalizations of graphs that describe higher-order network interactions among nodes in the graph. Network dynamics described by graph Laplacian flows have been widely studied in network science and control theory,…

Optimization and Control · Mathematics 2026-02-04 Mathias Hudoba de Badyn , Tyler Summers

Random walks are at the heart of many existing deep learning algorithms for graph data. However, such algorithms have many limitations that arise from the use of random walks, e.g., the features resulting from these methods are unable to…

Recently a variety of methods have been developed to encode graphs into low-dimensional vectors that can be easily exploited by machine learning algorithms. The majority of these methods start by embedding the graph nodes into a…

Machine Learning · Computer Science 2018-09-13 Yu Jin , Joseph F. JaJa

Random walks play an important role in probing the structure of complex networks. On traditional networks, they can be used to extract community structure, understand node centrality, perform link prediction, or capture the similarity…

Physics and Society · Physics 2024-06-13 Shazia'Ayn Babul , Yu Tian , Renaud Lambiotte

An important part of many machine learning workflows on graphs is vertex representation learning, i.e., learning a low-dimensional vector representation for each vertex in the graph. Recently, several powerful techniques for unsupervised…

Machine Learning · Computer Science 2019-01-23 Hooman Peiro Sajjad , Andrew Docherty , Yuriy Tyshetskiy

We present an algorithm to grow a graph with scale-free structure of {\it in-} and {\it out-links} and variable wiring diagram in the class of the world-wide Web. We then explore the graph by intentional random walks using local…

Statistical Mechanics · Physics 2009-11-10 Bosiljka Tadic

Graph Transformers are popular neural networks that extend the well-known Transformer architecture to the graph domain. These architectures operate by applying self-attention on graph nodes and incorporating graph structure through the use…

Machine Learning · Computer Science 2025-02-04 Linus Bao , Emily Jin , Michael Bronstein , İsmail İlkan Ceylan , Matthias Lanzinger

Recent advances in neural networks have solved common graph problems such as link prediction, node classification, node clustering, node recommendation by developing embeddings of entities and relations into vector spaces. Graph embeddings…

Social and Information Networks · Computer Science 2021-11-19 Archit Parnami , Mayuri Deshpande , Anant Kumar Mishra , Minwoo Lee

Positional encodings (PEs) are essential for building powerful and expressive graph neural networks and graph transformers, as they effectively capture the relative spatial relationships between nodes. Although extensive research has been…

Machine Learning · Computer Science 2026-03-16 Yinan Huang , Haoyu Wang , Pan Li

It is not until recently that graph neural networks (GNNs) are adopted to perform graph representation learning, among which, those based on the aggregation of features within the neighborhood of a node achieved great success. However,…

Machine Learning · Computer Science 2019-12-10 Yilun Jin , Guojie Song , Chuan Shi

We introduce the notion of a "random basic walk" on an infinite graph, give numerous examples, list potential applications, and provide detailed comparisons between the random basic walk and existing generalizations of simple random walks.…

Discrete Mathematics · Computer Science 2013-08-06 David White

We construct a new type of quantum walks on simplicial complexes as a natural extension of the well-known Szegedy walk on graphs. One can numerically observe that our proposing quantum walks possess linear spreading and localization as in…

Mathematical Physics · Physics 2015-08-05 Kaname Matsue , Osamu Ogurisu , Etsuo Segawa

Node2Vec is a state-of-the-art general-purpose feature learning method for network analysis. However, current solutions cannot run Node2Vec on large-scale graphs with billions of vertices and edges, which are common in real-world…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-02 Dongyan Zhou , Songjie Niu , Shimin Chen

Graph classification is a fundamental but challenging issue for numerous real-world applications. Despite recent great progress in image/video classification, convolutional neural networks (CNNs) cannot yet cater to graphs well because of…

Social and Information Networks · Computer Science 2020-01-13 Jiatao Jiang , Chunyan Xu , Zhen Cui , Tong Zhang , Wenming Zheng , Jian Yang