English
Related papers

Related papers: Simple Path Structural Encoding for Graph Transfor…

200 papers

Nodes residing in different parts of a graph can have similar structural roles within their local network topology. The identification of such roles provides key insight into the organization of networks and can be used for a variety of…

Social and Information Networks · Computer Science 2018-06-21 Claire Donnat , Marinka Zitnik , David Hallac , Jure Leskovec

Two main families of node feature augmentation schemes have been explored for enhancing GNNs: random features and spectral positional encoding. Surprisingly, however, there is still no clear understanding of the relation between these two…

Machine Learning · Computer Science 2023-07-20 Moshe Eliasof , Fabrizio Frasca , Beatrice Bevilacqua , Eran Treister , Gal Chechik , Haggai Maron

Graph Transformers have emerged as a powerful alternative to Message-Passing Graph Neural Networks (MP-GNNs) to address limitations such as over-squashing of information exchange. However, incorporating graph inductive bias into transformer…

Machine Learning · Computer Science 2024-04-09 Zihan Pengmei , Zimu Li

Graph Neural Networks (GNNs) have shown promising results in various tasks, among which link prediction is an important one. GNN models usually follow a node-centric message passing procedure that aggregates the neighborhood information to…

Machine Learning · Computer Science 2022-01-17 Baole Ai , Zhou Qin , Wenting Shen , Yong Li

This paper follows cognitive studies to investigate a graph representation for sketches, where the information of strokes, i.e., parts of a sketch, are encoded on vertices and information of inter-stroke on edges. The resultant graph…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Sheng Cheng , Yi Ren , Yezhou Yang

Graph embedding maps a graph into a convenient vector-space representation for graph analysis and machine learning applications. Many graph embedding methods hinge on a sampling of context nodes based on random walks. However, random walks…

Machine Learning · Computer Science 2021-10-18 Sadamori Kojaku , Jisung Yoon , Isabel Constantino , Yong-Yeol Ahn

In this article, we propose a novel navigation framework that leverages a two layered graph representation of the environment for efficient large-scale exploration, while it integrates a novel uncertainty awareness scheme to handle dynamic…

Robotics · Computer Science 2024-02-07 Akash Patel , Mario A V Saucedo , Christoforos Kanellakis , George Nikolakopoulos

We frame the task of predicting a semantic labeling as a sparse reconstruction procedure that applies a target-specific learned transfer function to a generic deep sparse code representation of an image. This strategy partitions training…

Computer Vision and Pattern Recognition · Computer Science 2014-10-17 Michael Maire , Stella X. Yu , Pietro Perona

Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Accurately forecasting crowd trajectories is challenging due to the uncertain nature of human motions in different…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Yu Liu , Yuexin Zhang , Kunming Li , Yongliang Qiao , Stewart Worrall , You-Fu Li , He Kong

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data,…

Machine Learning · Computer Science 2019-05-28 Amin Salehi , Hasan Davulcu

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Pretrained encoders for mathematical texts have achieved significant improvements on various tasks such as formula classification and information retrieval. Yet they remain limited in representing and capturing student strategies for entire…

Computers and Society · Computer Science 2026-04-13 Siddhartha Pradhan , Ethan Prihar , Erin Ottmar

In this paper, we consider the problem of counting and sampling structures in graphs. We define a class of "edge universal labeling problems"---which include proper $k$-colorings, independent sets, and downsets---and describe simple…

Data Structures and Algorithms · Computer Science 2020-08-20 Christine T. Cheng , Will Rosenbaum

Generative self-supervised learning (SSL), especially masked autoencoders, has become one of the most exciting learning paradigms and has shown great potential in handling graph data. However, real-world graphs are always heterogeneous,…

Machine Learning · Computer Science 2023-02-13 Yijun Tian , Kaiwen Dong , Chunhui Zhang , Chuxu Zhang , Nitesh V. Chawla

Graph transformers have emerged as a promising architecture for a variety of graph learning and representation tasks. Despite their successes, though, it remains challenging to scale graph transformers to large graphs while maintaining…

Machine Learning · Computer Science 2023-07-25 Hamed Shirzad , Ameya Velingker , Balaji Venkatachalam , Danica J. Sutherland , Ali Kemal Sinop

Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xili Dai , Ke Chen , Shengbang Tong , Jingyuan Zhang , Xingjian Gao , Mingyang Li , Druv Pai , Yuexiang Zhai , XIaojun Yuan , Heung-Yeung Shum , Lionel M. Ni , Yi Ma

Many applications require to learn, mine, analyze and visualize large-scale graphs. These graphs are often too large to be addressed efficiently using conventional graph processing technologies. Many applications have requirements to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-23 Santosh Pandey , Lingda Li , Adolfy Hoisie , Xiaoye S. Li , Hang Liu

Link prediction is a fundamental problem for graph-structured data (e.g., social networks, drug side-effect networks, etc.). Graph neural networks have offered robust solutions for this problem, specifically by learning the representation…

Machine Learning · Computer Science 2022-06-27 Paul Louis , Shweta Ann Jacob , Amirali Salehi-Abari

Invertible transformation of large graphs into fixed dimensional vectors (embeddings) remains a challenge. Its overcoming would reduce any operation on graphs to an operation in a vector space. However, most existing methods are limited to…

Machine Learning · Computer Science 2022-07-12 Adam Małkowski , Jakub Grzechociński , Paweł Wawrzyński

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey