English

NOFE - Neural Operator Function Embedding

Machine Learning 2026-05-19 v2

Abstract

Most dimensionality reduction methods treat data as discrete point clouds, ignoring the continuous domain structure inherent to many real-world processes. To bridge this gap, we introduce Neural Operator Function Embedding (NOFE), a domain-aware framework for continuous dimensionality reduction. NOFE learns function-to-function mappings via a Graph Kernel Operator, enabling mesh-free evaluation at arbitrary query locations independent of input discretization. We establish NOFE as approximation of sheaf-to-sheaf mappings, generalizing Sheaf Neural Networks to continuous domains. We evaluate NOFE across different datasets, comparing it against PCA, t-SNE, and UMAP. Our results demonstrate that NOFE significantly outperforms baselines in local structure preservation, achieving a local Stress of 0.111 compared to 0.398 for PCA, 0.773 for t-SNE, and 0.791 for UMAP for the ERA5 climate reanalysis dataset. NOFE also exhibits robust sampling independence, reducing the Patch Stitching Error by up to 20.0×20.0\times relative to UMAP (59.0 vs. 267.6 under regional normalization) and ensuring consistency across disjoint domain patches. While maintaining competitive global structure preservation (Stress-1: 0.379 vs. PCA's 0.268), NOFE resolves fine-grained structures and produces smooth, consistent embeddings that generalize across varying sample densities, addressing key limitations of discrete reduction methods.

Keywords

Cite

@article{arxiv.2605.11970,
  title  = {NOFE - Neural Operator Function Embedding},
  author = {Lars Uebbing and Harald L. Joakimsen and Siyan Chen and Georgios Leontidis and Kristoffer K. Wickstrøm and Michael C. Kampffmeyer and Sébastien Lefèvre and Arnt-Børre Salberg and Robert Jenssen},
  journal= {arXiv preprint arXiv:2605.11970},
  year   = {2026}
}

Comments

21 pages, 11 figures, 12 tables