English
Related papers

Related papers: Learning Efficient Positional Encodings with Graph…

200 papers

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in various graph-based learning tasks. However, enabling privacy-preserving GNNs in encrypted domains, such as under Fully Homomorphic Encryption (FHE), typically…

Cryptography and Security · Computer Science 2025-07-15 Kaixiang Zhao , Joseph Yousry Attalla , Qian Lou , Yushun Dong

Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world…

Machine Learning · Computer Science 2024-11-11 Luis Müller , Daniel Kusuma , Blai Bonet , Christopher Morris

This paper presents $\mathrm{E}(n)$ Equivariant Message Passing Simplicial Networks (EMPSNs), a novel approach to learning on geometric graphs and point clouds that is equivariant to rotations, translations, and reflections. EMPSNs can…

Machine Learning · Computer Science 2023-10-24 Floor Eijkelboom , Rob Hesselink , Erik Bekkers

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their…

Machine Learning · Computer Science 2019-10-03 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

We put forth a principled design of a neural architecture to learn nodal Adjacency Spectral Embeddings (ASE) from graph inputs. By bringing to bear the gradient descent (GD) method and leveraging the principle of algorithm unrolling, we…

Machine Learning · Computer Science 2025-08-29 Sofía Pérez Casulo , Marcelo Fiori , Federico Larroca , Gonzalo Mateos

We propose a novel pool-based Active Learning framework constructed on a sequential Graph Convolution Network (GCN). Each image's feature from a pool of data represents a node in the graph and the edges encode their similarities. With a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Razvan Caramalau , Binod Bhattarai , Tae-Kyun Kim

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

Machine Learning · Computer Science 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

Positional encoding is essential for supplementing transformer with positional information of tokens. Existing positional encoding methods demand predefined token/feature order, rendering them unsuitable for real-world data with…

Machine Learning · Computer Science 2025-09-25 Kaichen Xu , Yihang Du , Mianpeng Liu , Zimu Yu , Xiaobo Sun

Recent graph neural networks (GNN) has achieved remarkable performance in node representation learning. One key factor of GNN's success is the \emph{smoothness} property on node representations. Despite this, most GNN models are fragile to…

Machine Learning · Computer Science 2023-05-08 Xu Chen , Yuangang Pan , Ivor Tsang , Ya Zhang

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Message passing neural networks have become a method of choice for learning on graphs, in particular the prediction of chemical properties and the acceleration of molecular dynamics studies. While they readily scale to large training data…

Machine Learning · Computer Science 2021-06-08 Kristof T. Schütt , Oliver T. Unke , Michael Gastegger

Transformers are increasingly employed for graph data, demonstrating competitive performance in diverse tasks. To incorporate graph information into these models, it is essential to enhance node and edge features with positional encodings.…

Can we combine heterogenous graph structure with text to learn high-quality semantic and behavioural representations? Graph neural networks (GNN)s encode numerical node attributes and graph structure to achieve impressive performance in a…

Machine Learning · Computer Science 2022-06-23 Vassilis N. Ioannidis , Xiang Song , Da Zheng , Houyu Zhang , Jun Ma , Yi Xu , Belinda Zeng , Trishul Chilimbi , George Karypis

Graph Transformers, which incorporate self-attention and positional encoding, have recently emerged as a powerful architecture for various graph learning tasks. Despite their impressive performance, the complex non-convex interactions…

Machine Learning · Computer Science 2024-06-05 Hongkang Li , Meng Wang , Tengfei Ma , Sijia Liu , Zaixi Zhang , Pin-Yu Chen

The expressive power of Graph Neural Networks (GNNs) has been studied extensively through the Weisfeiler-Leman (WL) graph isomorphism test. However, standard GNNs and the WL framework are inapplicable for geometric graphs embedded in…

Machine Learning · Computer Science 2024-03-05 Chaitanya K. Joshi , Cristian Bodnar , Simon V. Mathis , Taco Cohen , Pietro Liò

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Low-dimension graph embeddings have proved extremely useful in various downstream tasks in large graphs, e.g., link-related content recommendation and node classification tasks, etc. Most existing embedding approaches take nodes as the…

Machine Learning · Computer Science 2020-12-14 You Li , Binli Luo , Ning Gui

Photonics can offer a hardware-native route for machine learning (ML). However, efficient deployment of photonics-enhanced ML requires hybrid workflows that integrate optical processing with conventional CPU/GPU based neural network…

Optics · Physics 2025-12-18 Yuan Wang , Oleksandr Kyriienko

Network data can be conveniently modeled as a graph signal, where data values are assigned to nodes of a graph that describes the underlying network topology. Successful learning from network data is built upon methods that effectively…

Machine Learning · Computer Science 2021-05-26 Fernando Gama , Elvin Isufi , Geert Leus , Alejandro Ribeiro