English

Exact ReLU realization of tensor-product refinement iterates

Classical Analysis and ODEs 2026-05-06 v1 Machine Learning

Abstract

We study scalar dyadic refinement operators on R^2 of the form (Vf)(x,y) = sum_{(j,k) in Z^2} c_{j,k} f(2x-j, 2y-k), where only finitely many mask coefficients c_{j,k} are nonzero. Under a fixed support-window hypothesis, we prove that for every compactly supported continuous piecewise linear seed g:R^2->R, the iterates V^n g admit exact ReLU realizations of fixed width and depth O(n). This gives a first genuinely two-dimensional extension of the exact realization theory for refinement cascades. Using the one-dimensional exact loop-controller framework, the proof transports the tensor-product residual dynamics exactly on the product of two polygonal loops and reduces the remaining seam ambiguity to a final readout and selector step. The matrix cascade is then handled by a fixed-depth recursive block, and general compactly supported continuous piecewise linear seeds are reduced to a finite decomposition together with exact clamped gluing on the support window. This identifies the tensor-product dyadic case as a natural first multivariate instance of the loop-controller method for refinement iterates.

Cite

@article{arxiv.2605.03917,
  title  = {Exact ReLU realization of tensor-product refinement iterates},
  author = {Tsogtgerel Gantumur},
  journal= {arXiv preprint arXiv:2605.03917},
  year   = {2026}
}

Comments

22 pages, 2 figures

R2 v1 2026-07-01T12:51:07.079Z