English

HOSC: A Periodic Activation with Saturation Control for High-Fidelity Implicit Neural Representations

Machine Learning 2026-01-14 v1 Computer Vision and Pattern Recognition Graphics

Abstract

Periodic activations such as sine preserve high-frequency information in implicit neural representations (INRs) through their oscillatory structure, but often suffer from gradient instability and limited control over multi-scale behavior. We introduce the Hyperbolic Oscillator with Saturation Control (HOSC) activation, HOSC(x)=tanh(βsin(ω0x))\text{HOSC}(x) = \tanh\bigl(\beta \sin(\omega_0 x)\bigr), which exposes an explicit parameter β\beta that controls the Lipschitz bound of the activation by βω0\beta \omega_0. This provides a direct mechanism to tune gradient magnitudes while retaining a periodic carrier. We provide a mathematical analysis and conduct a comprehensive empirical study across images, audio, video, NeRFs, and SDFs using standardized training protocols. Comparative analysis against SIREN, FINER, and related methods shows where HOSC provides substantial benefits and where it achieves competitive parity. Results establish HOSC as a practical periodic activation for INR applications, with domain-specific guidance on hyperparameter selection. For code visit the project page https://hosc-nn.github.io/ .

Keywords

Cite

@article{arxiv.2601.07870,
  title  = {HOSC: A Periodic Activation with Saturation Control for High-Fidelity Implicit Neural Representations},
  author = {Michal Jan Wlodarczyk and Danzel Serrano and Przemyslaw Musialski},
  journal= {arXiv preprint arXiv:2601.07870},
  year   = {2026}
}

Comments

16 pages including appendices, 12 figures, 15 tables