English
Related papers

Related papers: PeleNet: A Reservoir Computing Framework for Loihi

200 papers

In this work we develop a model of predictive learning on neuromorphic hardware. Our model uses the on-chip plasticity capabilities of the Loihi chip to remember observed sequences of events and use this memory to generate predictions of…

Neural and Evolutionary Computing · Computer Science 2022-05-03 Jack Lindsey , James B Aimone

Recurrent Neural Networks (RNNs) are powerful tools for solving sequence-based problems, but their efficacy and execution time are dependent on the size of the network. Following recent work in simplifying these networks with model pruning…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Feiwen Zhu , Jeff Pool , Michael Andersch , Jeremy Appleyard , Fung Xie

Developing intelligent neuromorphic solutions remains a challenging endeavour. It requires a solid conceptual understanding of the hardware's fundamental building blocks. Beyond this, accessible and user-friendly prototyping is crucial to…

Neural and Evolutionary Computing · Computer Science 2021-09-28 Carlo Michaelis , Andrew B. Lehr , Winfried Oed , Christian Tetzlaff

The increasing need for compact and low-power computing solutions for machine learning applications has triggered significant interest in energy-efficient neuromorphic systems. However, most of these architectures rely on spiking neural…

Neural and Evolutionary Computing · Computer Science 2019-12-23 Manu V Nair , Giacomo Indiveri

As deep learning models become popular, there is a lot of need for deploying them to diverse device environments. Because it is costly to develop and optimize a neural network for every single environment, there is a line of research to…

Machine Learning · Computer Science 2023-11-20 Jong-Ryul Lee , Yong-Hyuk Moon

Developing effective learning systems for Machine Learning (ML) applications in the Neuromorphic (NM) field requires extensive experimentation and simulation. Software frameworks aid and ease this process by providing a set of ready-to-use…

Software Engineering · Computer Science 2023-02-16 Davide Liberato Manna , Alex Vicente-Sola , Paul Kirkland , Trevor Joseph Bihl , Gaetano Di Caterina

Reservoir Computing is a relatively new framework created to allow the usage of powerful but complex systems as computational mediums. The basic approach consists in training only a readout layer, exploiting the innate separation and…

Robotics · Computer Science 2022-06-23 Paolo Baldini

Parameter-efficient fine-tuning (PEFT) reduces the training cost of full-parameter fine-tuning for large language models (LLMs) by training only a small set of task-specific parameters while freezing the pretrained backbone. However,…

Computation and Language · Computer Science 2026-04-22 Xianming Li , Zongxi Li , Tsz-fung Andrew Lee , Jing Li , Haoran Xie , Qing Li

This study investigates the realm of liquid neural networks (LNNs) and their deployment on neuromorphic hardware platforms. It provides an in-depth analysis of Liquid State Machines (LSMs) and explores the adaptation of LNN architectures to…

Emerging Technologies · Computer Science 2024-07-31 Wiktoria Agata Pawlak , Murat Isik , Dexter Le , Ismail Can Dikmen

Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated…

Neural and Evolutionary Computing · Computer Science 2021-09-28 Yigit Demirag , Charlotte Frenkel , Melika Payvand , Giacomo Indiveri

Machine learning applications that are implemented with spike-based computation model, e.g., Spiking Neural Network (SNN), have a great potential to lower the energy consumption when they are executed on a neuromorphic hardware. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-13 Shihao Song , Adarsha Balaji , Anup Das , Nagarajan Kandasamy , James Shackleford

Neuromorphic computing systems such as DYNAPs and Loihi have recently been introduced to the computing community to improve performance and energy efficiency of machine learning programs, especially those that are implemented using Spiking…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Twisha Titirsha , Shihao Song , Adarsha Balaji , Anup Das

We present a lightweight Python framework for distributed training of neural networks on multiple GPUs or CPUs. The framework is built on the popular Keras machine learning library. The Message Passing Interface (MPI) protocol is used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-19 Dustin Anderson , Jean-Roch Vlimant , Maria Spiropulu

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are very computationally intensive and reach the hardware limit…

Machine Learning · Computer Science 2020-04-28 Fei Sun , Minghai Qin , Tianyun Zhang , Liu Liu , Yen-Kuang Chen , Yuan Xie

Due to reduced manufacturing yields, traditional monolithic chips cannot keep up with the compute, memory, and communication demands of data-intensive applications, such as rapidly growing deep neural network (DNN) models. Chiplet-based…

Hardware Architecture · Computer Science 2025-10-31 Lukas Pfromm , Alish Kanani , Harsh Sharma , Janardhan Rao Doppa , Partha Pratim Pande , Umit Y. Ogras

To ensure resilient neural network processing on even unreliable hardware, comprehensive reliability analysis against various hardware faults is generally required before the deep neural network models are deployed, and efficient error…

Machine Learning · Computer Science 2023-12-25 Haitong Huang , Cheng Liu , Bo Liu , Xinghua Xue , Huawei Li , Xiaowei Li

The increasing rise in machine learning and deep learning applications is requiring ever more computational resources to successfully meet the growing demands of an always-connected, automated world. Neuromorphic technologies based on…

Neural and Evolutionary Computing · Computer Science 2020-07-14 Philippe Reiter , Geet Rose Jose , Spyridon Bizmpikis , Ionela-Ancuţa Cîrjilă

Neuromorphic computing is henceforth a major research field for both academic and industrial actors. As opposed to Von Neumann machines, brain-inspired processors aim at bringing closer the memory and the computational elements to…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Maxence Bouvier , Alexandre Valentian , Thomas Mesquida , François Rummens , Marina Reyboz , Elisa Vianello , Edith Beigné

Neuromorphic hardware architectures represent a growing family of potential post-Moore's Law Era platforms. Largely due to event-driving processing inspired by the human brain, these computer platforms can offer significant energy benefits…

Neural and Evolutionary Computing · Computer Science 2019-05-30 James B Aimone , William Severa , Craig M Vineyard