English

HIT-ROCKET: Hadamard-vector Inner-product Transformer for ROCKET

Machine Learning 2025-11-04 v1 Artificial Intelligence

Abstract

Time series classification holds broad application value in communications, information countermeasures, finance, and medicine. However, state-of-the-art (SOTA) methods-including HIVE-COTE, Proximity Forest, and TS-CHIEF-exhibit high computational complexity, coupled with lengthy parameter tuning and training cycles. In contrast, lightweight solutions like ROCKET (Random Convolutional Kernel Transform) offer greater efficiency but leave substantial room for improvement in kernel selection and computational overhead. To address these challenges, we propose a feature extraction approach based on Hadamard convolutional transform, utilizing column or row vectors of Hadamard matrices as convolution kernels with extended lengths of varying sizes. This enhancement maintains full compatibility with existing methods (e.g., ROCKET) while leveraging kernel orthogonality to boost computational efficiency, robustness, and adaptability. Comprehensive experiments on multi-domain datasets-focusing on the UCR time series dataset-demonstrate SOTA performance: F1-score improved by at least 5% vs. ROCKET, with 50% shorter training time than miniROCKET (fastest ROCKET variant) under identical hyperparameters, enabling deployment on ultra-low-power embedded devices. All code is available on GitHub.

Keywords

Cite

@article{arxiv.2511.01572,
  title  = {HIT-ROCKET: Hadamard-vector Inner-product Transformer for ROCKET},
  author = {Wang Hao and Kuang Zhang and Hou Chengyu and Yuan Zhonghao and Tan Chenxing and Fu Weifeng and Zhu Yangying},
  journal= {arXiv preprint arXiv:2511.01572},
  year   = {2025}
}
R2 v1 2026-07-01T07:19:15.953Z