English
Related papers

Related papers: Cycle Invariant Positional Encoding for Graph Repr…

200 papers

Heterogeneous graph representation learning aims to learn low-dimensional vector representations of different types of entities and relations to empower downstream tasks. Existing methods either capture semantic relationships but indirectly…

Machine Learning · Computer Science 2025-08-14 Hao Xu , Shengqi Sang , Peizhen Bai , Laurence Yang , Haiping Lu

Origin-Destination Estimation plays an important role in the era of Intelligent Transportation. Nevertheless, as a under-determined problem, OD estimation confronts many challenges from cross-space inference to non-convex, non-linear…

Machine Learning · Computer Science 2022-08-24 Guanzhou Li , Yujing He , Jianping Wu , Duowei Li

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

One of the emerging techniques in node classification in heterogeneous graphs is to restrict message aggregation to pre-defined, semantically meaningful structures called metapaths. This work is the first attempt to incorporate attention…

Machine Learning · Computer Science 2024-12-31 Calder Katyal

Although graph-based learning has attracted a lot of attention, graph representation learning is still a challenging task whose resolution may impact key application fields such as chemistry or biology. To this end, we introduce GRALE, a…

Machine Learning · Computer Science 2025-10-21 Paul Krzakala , Gabriel Melo , Charlotte Laclau , Florence d'Alché-Buc , Rémi Flamary

We introduce graphcodes, a novel multi-scale summary of the topological properties of a dataset that is based on the well-established theory of persistent homology. Graphcodes handle datasets that are filtered along two real-valued scale…

Algebraic Topology · Mathematics 2024-05-24 Michael Kerber , Florian Russold

Transformer models are permutation equivariant. To supply the order and type information of the input tokens, position and segment embeddings are usually added to the input. Recent works proposed variations of positional encodings with…

Computation and Language · Computer Science 2021-11-04 Pu-Chin Chen , Henry Tsai , Srinadh Bhojanapalli , Hyung Won Chung , Yin-Wen Chang , Chun-Sung Ferng

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classification, based on the…

Machine Learning · Computer Science 2025-01-23 Yongduo Sui , Jie Sun , Shuyao Wang , Zemin Liu , Qing Cui , Longfei Li , Xiang Wang

The most prevalent class of neural networks operating on graphs are message passing neural networks (MPNNs), in which the representation of a node is updated iteratively by aggregating information in the 1-hop neighborhood. Since this…

Machine Learning · Computer Science 2023-10-25 Floor Eijkelboom , Erik Bekkers , Michael Bronstein , Francesco Di Giovanni

Most previous work on neural text generation from graph-structured data relies on standard sequence-to-sequence methods. These approaches linearise the input graph to be fed to a recurrent neural network. In this paper, we propose an…

Computation and Language · Computer Science 2018-10-24 Diego Marcheggiani , Laura Perez-Beltrachini

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Invariant and equivariant networks have been successfully used for learning images, sets, point clouds, and graphs. A basic challenge in developing such networks is finding the maximal collection of invariant and equivariant linear layers.…

Machine Learning · Computer Science 2019-05-01 Haggai Maron , Heli Ben-Hamu , Nadav Shamir , Yaron Lipman

The Transformer architecture has become a dominant choice in many domains, such as natural language processing and computer vision. Yet, it has not achieved competitive performance on popular leaderboards of graph-level prediction compared…

Machine Learning · Computer Science 2021-11-25 Chengxuan Ying , Tianle Cai , Shengjie Luo , Shuxin Zheng , Guolin Ke , Di He , Yanming Shen , Tie-Yan Liu

Computation graphs are Directed Acyclic Graphs (DAGs) where the nodes correspond to mathematical operations and are used widely as abstractions in optimizations of neural networks. The device placement problem aims to identify optimal…

This paper proposes a novel heterogeneous grid convolution that builds a graph-based image representation by exploiting heterogeneity in the image content, enabling adaptive, efficient, and controllable computations in a convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Ryuhei Hamaguchi , Yasutaka Furukawa , Masaki Onishi , Ken Sakurada

Encoding a sequence of observations is an essential task with many applications. The encoding can become highly efficient when the observations are generated by a dynamical system. A dynamical system imposes regularities on the observations…

Machine Learning · Statistics 2018-05-29 Arash Mehrjou , Friedrich Solowjow , Sebastian Trimpe , Bernhard Schölkopf

We present Graformer, a novel Transformer-based encoder-decoder architecture for graph-to-text generation. With our novel graph self-attention, the encoding of a node relies on all nodes in the input graph - not only direct neighbors -…

Computation and Language · Computer Science 2021-04-28 Martin Schmitt , Leonardo F. R. Ribeiro , Philipp Dufter , Iryna Gurevych , Hinrich Schütze

Graph representation learning is fundamental for analyzing graph-structured data. Exploring invariant graph representations remains a challenge for most existing graph representation learning methods. In this paper, we propose a cross-view…

Machine Learning · Computer Science 2025-04-15 Jie Chen , Hua Mao , Wai Lok Woo , Chuanbin Liu , Xi Peng

Modeling information that resides on vertices of large graphs is a key problem in several real-life applications, ranging from social networks to the Internet-of-things. Signal Processing on Graphs and, in particular, graph wavelets can…

Data Structures and Algorithms · Computer Science 2016-06-14 Arlei Silva , Xuan-Hong Dang , Prithwish Basu , Ambuj K Singh , Ananthram Swami

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph…

Artificial Intelligence · Computer Science 2017-07-18 Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , Shantanu Jaiswal