English

RELATE: A Schema-Agnostic Perceiver Encoder for Multimodal Relational Graphs

Artificial Intelligence 2025-11-04 v3 Databases Machine Learning

Abstract

Relational multi-table data is common in domains such as e-commerce, healthcare, and scientific research, and can be naturally represented as heterogeneous temporal graphs with multi-modal node attributes. Existing graph neural networks (GNNs) rely on schema-specific feature encoders, requiring separate modules for each node type and feature column, which hinders scalability and parameter sharing. We introduce RELATE (Relational Encoder for Latent Aggregation of Typed Entities), a schema-agnostic, plug-and-play feature encoder that can be used with any general purpose GNN. RELATE employs shared modality-specific encoders for categorical, numerical, textual, and temporal attributes, followed by a Perceiver-style cross-attention module that aggregates features into a fixed-size, permutation-invariant node representation. We evaluate RELATE on ReLGNN and HGT in the RelBench benchmark, where it achieves performance within 3% of schema-specific encoders while reducing parameter counts by up to 5x. This design supports varying schemas and enables multi-dataset pretraining for general-purpose GNNs, paving the way toward foundation models for relational graph data.

Keywords

Cite

@article{arxiv.2510.19954,
  title  = {RELATE: A Schema-Agnostic Perceiver Encoder for Multimodal Relational Graphs},
  author = {Joe Meyer and Divyansha Lachi and Mahmoud Mohammadi and Roshan Reddy Upendra and Eva L. Dyer and Mark Li and Tom Palczewski},
  journal= {arXiv preprint arXiv:2510.19954},
  year   = {2025}
}

Comments

6 pages

R2 v1 2026-07-01T07:00:37.260Z