English

LogHD: Robust Compression of Hyperdimensional Classifiers via Logarithmic Class-Axis Reduction

Machine Learning 2026-02-04 v2

Abstract

Hyperdimensional computing (HDC) suits memory, energy, and reliability-constrained systems, yet the standard "one prototype per class" design requires O(CD)O(CD) memory (with CC classes and dimensionality DD). Prior compaction reduces DD (feature axis), improving storage/compute but weakening robustness. We introduce LogHD, a logarithmic class-axis reduction that replaces the CC per-class prototypes with n ⁣ ⁣logkCn\!\approx\!\lceil\log_k C\rceil bundle hypervectors (alphabet size kk) and decodes in an nn-dimensional activation space, cutting memory to O(DlogkC)O(D\log_k C) while preserving DD. LogHD uses a capacity-aware codebook and profile-based decoding, and composes with feature-axis sparsification. Across datasets and injected bit flips, LogHD attains competitive accuracy with smaller models and higher resilience at matched memory. Under equal memory, it sustains target accuracy at roughly 2.52.5-3.0×3.0\times higher bit-flip rates than feature-axis compression; an ASIC instantiation delivers 498×498\times energy efficiency and 62.6×62.6\times speedup over an AMD Ryzen 9 9950X and 24.3×24.3\times/6.58×6.58\times over an NVIDIA RTX 4090, and is 4.06×4.06\times more energy-efficient and 2.19×2.19\times faster than a feature-axis HDC ASIC baseline.

Keywords

Cite

@article{arxiv.2511.03938,
  title  = {LogHD: Robust Compression of Hyperdimensional Classifiers via Logarithmic Class-Axis Reduction},
  author = {Sanggeon Yun and Hyunwoo Oh and Ryozo Masukawa and Pietro Mercati and Nathaniel D. Bastian and Mohsen Imani},
  journal= {arXiv preprint arXiv:2511.03938},
  year   = {2026}
}

Comments

Accepted to DATE 2026

R2 v1 2026-07-01T07:23:45.836Z