English

Graded Neural Networks

Machine Learning 2026-04-24 v2 Artificial Intelligence

Abstract

This paper presents a novel framework for graded neural networks (GNNs) built over graded vector spaces \V\wn\V_\w^n, extending classical neural architectures by incorporating algebraic grading. Leveraging a coordinate-wise grading structure with scalar action λ\x=(λqixi)\lambda \star \x = (\lambda^{q_i} x_i), defined by a tuple \w=(q0,,qn1)\w = (q_0, \ldots, q_{n-1}), we introduce graded neurons, layers, activation functions, and loss functions that adapt to feature significance. Theoretical properties of graded spaces are established, followed by a comprehensive GNN design, addressing computational challenges like numerical stability and gradient scaling. Potential applications span machine learning and photonic systems, exemplified by high-speed laser-based implementations. This work offers a foundational step toward graded computation, unifying mathematical rigor with practical potential, with avenues for future empirical and hardware exploration.

Keywords

Cite

@article{arxiv.2502.17751,
  title  = {Graded Neural Networks},
  author = {Tony Shaska},
  journal= {arXiv preprint arXiv:2502.17751},
  year   = {2026}
}
R2 v1 2026-06-28T21:56:35.535Z