RTNeural is a neural inferencing library written in C++. RTNeural is designed to be used in systems with hard real-time constraints, with additional emphasis on speed, flexibility, size, and convenience. The motivation and design of the library are described, as well as real-world use-cases, and performance comparisons with other neural inferencing libraries.
Cite
@article{arxiv.2106.03037,
title = {RTNeural: Fast Neural Inferencing for Real-Time Systems},
author = {Jatin Chowdhury},
journal= {arXiv preprint arXiv:2106.03037},
year = {2021}
}