English

Exploiting temporal parallelism for LSTM Autoencoder acceleration on FPGA

Hardware Architecture 2026-03-17 v1 Machine Learning

Abstract

Recurrent Neural Networks (RNNs) are vital for sequential data processing. Long Short-Term Memory Autoencoders (LSTM-AEs) are particularly effective for unsupervised anomaly detection in time-series data. However, inherent sequential dependencies limit parallel computation. While previous work has explored FPGA-based acceleration for LSTM networks, efforts have typically focused on optimizing a single LSTM layer at a time. We introduce a novel FPGA-based accelerator using a dataflow architecture that exploits temporal parallelism for concurrent multi-layer processing of different timesteps within sequences. Experimental evaluations on four representative LSTM-AE models with varying widths and depths, implemented on a Zynq UltraScale+ MPSoC FPGA, demonstrate significant advantages over CPU (Intel Xeon Gold 5218R) and GPU (NVIDIA V100) implementations. Our accelerator achieves latency speedups up to 79.6x vs. CPU and 18.2x vs. GPU, alongside energy-per-timestep reductions of up to 1722x vs. CPU and 59.3x vs. GPU. These results, including superior network depth scalability, highlight our approach's potential for high-performance, real-time, power-efficient LSTM-AE-based anomaly detection on FPGAs.

Keywords

Cite

@article{arxiv.2603.13982,
  title  = {Exploiting temporal parallelism for LSTM Autoencoder acceleration on FPGA},
  author = {Aimilios Leftheriotis and Dimosthenis Masouros and Dimitrios Soudris and George Theodoridis},
  journal= {arXiv preprint arXiv:2603.13982},
  year   = {2026}
}

Comments

25th International Conference on embedded computer Systems: Architectures, MOdeling and Simulation (SAMOS'2025)

R2 v1 2026-07-01T11:20:08.129Z