English
Related papers

Related papers: HIT-ROCKET: Hadamard-vector Inner-product Transfor…

200 papers

We present HadaCore, a modified Fast Walsh-Hadamard Transform (FWHT) algorithm optimized for the Tensor Cores present in modern GPU hardware. HadaCore follows the recursive structure of the original FWHT algorithm, achieving the same…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-13 Krish Agarwal , Rishi Astra , Adnan Hoque , Mudhakar Srivatsa , Raghu Ganti , Less Wright , Sijia Chen

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

Linear classifiers with random convolution kernels are computationally efficient methods that need no design or domain knowledge. Unlike deep neural networks, there is no need to hand-craft a network architecture; the kernels are randomly…

Signal Processing · Electrical Eng. & Systems 2021-08-05 Christopher Lundy , John M. O'Toole

We present ROCKET, a training-free model compression method that achieves state-of-the-art performance in comparison with factorization, structured-sparsification and dynamic compression baselines. Operating under a global compression…

Machine Learning · Computer Science 2026-02-12 Ammar Ali , Baher Mohammad , Denis Makhov , Dmitriy Shopkhoev , Magauiya Zhussip , Stamatios Lefkimmiatis

The classification of pixel spectra of hyperspectral images, i.e. spectral classification, is used in many fields ranging from agricultural, over medical to remote sensing applications and is currently also expanding to areas such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Nick Theisen , Kenny Schlegel , Dietrich Paulus , Peer Neubert

Kernel-based methods such as Rocket are among the most effective default approaches for univariate time series classification (TSC), yet they do not perform equally well across all datasets. We revisit the long-standing intuition that…

Machine Learning · Computer Science 2026-01-13 Honey Singh Chauhan , Zahraa S. Abdallah

Shapelets are discriminative subsequences, originally embedded in shapelet-based decision trees but have since been extended to shapelet-based transformations. We propose Castor, a simple, efficient, and accurate time series classification…

Machine Learning · Computer Science 2024-03-21 Isak Samsten , Zed Lee

The growing demand for the internet of things (IoT) makes it necessary to implement computer vision tasks such as object recognition in low-power devices. Convolutional neural networks (CNNs) are a potential approach for object recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Varun Mannam

Vision Transformers (ViT) become widely-adopted architectures for various vision tasks. Masked auto-encoding for feature pretraining and multi-scale hybrid convolution-transformer architectures can further unleash the potentials of ViT,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Peng Gao , Teli Ma , Hongsheng Li , Ziyi Lin , Jifeng Dai , Yu Qiao

Fine-tuning pre-trained language models for downstream tasks has achieved impressive results in NLP. However, fine-tuning all parameters becomes impractical due to the rapidly increasing size of model parameters. To address this, Parameter…

Computation and Language · Computer Science 2024-09-23 Geyuan Zhang , Xiaofei Zhou , Chuheng Chen

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

Machine Learning · Computer Science 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Achieving superior enhancement performance while maintaining a low parameter count and computational complexity remains a challenge in the field of speech enhancement. In this paper, we introduce LORT, a novel architecture that integrates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Junyu Wang , Zizhen Lin , Tianrui Wang , Meng Ge , Longbiao Wang , Jianwu Dang

A regression-based framework for interpretable multi-way data imputation, termed Kernel Regression via Tensor Trains with Hadamard overparametrization (KReTTaH), is introduced. KReTTaH adopts a nonparametric formulation by casting…

Machine Learning · Computer Science 2025-09-29 Duc Thien Nguyen , Konstantinos Slavakis , Eleftherios Kofidis , Dimitris Pados

The Lightweight Integrated Tracking-Feature Extraction (LITE) paradigm is introduced as a novel multi-object tracking (MOT) approach. It enhances ReID-based trackers by eliminating inference, pre-processing, post-processing, and ReID model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Jumabek Alikhanov , Dilshod Obidov , Hakil Kim

Time Series Classification (TSC) has seen enormous progress over the last two decades. HIVE-COTE (Hierarchical Vote Collective of Transformation-based Ensembles) is the current state of the art in terms of classification accuracy. HIVE-COTE…

Machine Learning · Computer Science 2021-02-09 Ahmed Shifaz , Charlotte Pelletier , Francois Petitjean , Geoffrey I. Webb

Hyperdimensional computing (HDC) is a brain-inspired paradigm valued for its noise robustness, parallelism, energy efficiency, and low computational overhead. Hardware accelerators are being explored to further enhance their performance,…

Emerging Technologies · Computer Science 2025-04-29 Md Mizanur Rahaman Nayan , Che-Kai Liu , Zishen Wan , Arijit Raychowdhury , Azad J Naeemi

The proliferation of Internet-of-Things (IoT) devices has led to an unprecedented volume of multivariate time series (MTS) data, requiring efficient and accurate processing for timely decision-making in resource-constrained edge…

Machine Learning · Computer Science 2025-09-30 Jingtao Zhang , Yi Liu , Qi Shen , Changhong Wang

With the development of automatic speech recognition (ASR) and text-to-speech (TTS) technology, high-quality voice conversion (VC) can be achieved by extracting source content information and target speaker information to reconstruct…

Sound · Computer Science 2023-02-24 Houjian Guo , Chaoran Liu , Carlos Toshinori Ishi , Hiroshi Ishiguro

This paper introduces SFSORT, the world's fastest multi-object tracking system based on experiments conducted on MOT Challenge datasets. To achieve an accurate and computationally efficient tracker, this paper employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 M. M. Morsali , Z. Sharifi , F. Fallah , S. Hashembeiki , H. Mohammadzade , S. Bagheri Shouraki

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang