English
Related papers

Related papers: A Diagonal Structured State Space Model on Loihi 2…

200 papers

The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical neural networks in…

Neural and Evolutionary Computing · Computer Science 2020-06-17 Bojian Yin , Federico Corradi , Sander M. Bohté

Implantable Brain-machine interfaces (BMIs) are promising for motor rehabilitation and mobility augmentation, and they demand accurate and energy-efficient algorithms. In this paper, we propose a novel spiking neural network (SNN) decoder…

Signal Processing · Electrical Eng. & Systems 2024-05-06 Jiawei Liao , Oscar Toomey , Xiaying Wang , Lars Widmer , Cynthia A. Chestek , Luca Benini , Taekwang Jang

Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular…

Artificial Intelligence · Computer Science 2024-12-03 Jindong Jiang , Fei Deng , Gautam Singh , Minseung Lee , Sungjin Ahn

Convolutional neural networks (CNNs) have achieved great success in performing cognitive tasks. However, execution of CNNs requires a large amount of computing resources and generates heavy memory traffic, which imposes a severe challenge…

Hardware Architecture · Computer Science 2021-06-16 Jianlei Yang , Wenzhi Fu , Xingzhou Cheng , Xucheng Ye , Pengcheng Dai , Weisheng Zhao

Scene understanding is paramount in robotics, self-navigation, augmented reality, and many other fields. To fully accomplish this task, an autonomous agent has to infer the 3D structure of the sensed scene (to know where it looks at) and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Pier Luigi Dovesi , Matteo Poggi , Lorenzo Andraghetti , Miquel Martí , Hedvig Kjellström , Alessandro Pieropan , Stefano Mattoccia

Spiking neural networks (SNNs) are posited as a computationally efficient and biologically plausible alternative to conventional neural architectures, with their core computational framework primarily using the leaky integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2025-03-18 Malyaban Bal , Abhronil Sengupta

Directed graphs are ubiquitous across numerous domains, where the directionality of edges encodes critical causal dependencies. However, existing GNNs and graph Transformers tailored for directed graphs face two major challenges: (1)…

Machine Learning · Computer Science 2025-09-18 Junzhi She , Xunkai Li , Rong-Hua Li , Guoren Wang

The demand for edge artificial intelligence to process event-based, complex data calls for hardware beyond conventional digital, von-Neumann architectures. Neuromorphic computing, using spiking neural networks (SNNs) with emerging…

Applied Physics · Physics 2025-09-08 Zhu Wang , Song Wang , Zhiyuan Du , Ruibin Mao , Yu Xiao , Hayden Kwok-Hay So , Peng Lin , Can Li

Thanks to their parallel and sparse activity features, recurrent neural networks (RNNs) are well-suited for hardware implementation in low-power neuromorphic hardware. However, mapping rate-based RNNs to hardware-compatible spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-07-19 Gauthier Boeshertz , Giacomo Indiveri , Manu Nair , Alpha Renner

State Space Models (SSMs) have emerged as an appealing alternative to Transformers for large language models, achieving state-of-the-art accuracy with constant memory complexity which allows for holding longer context lengths than…

Machine Learning · Computer Science 2024-12-10 Hung-Yueh Chiang , Chi-Chih Chang , Natalia Frumkin , Kai-Chiang Wu , Diana Marculescu

Low-cost FPGA platforms can broaden access to neuromorphic systems research, but current spiking neural network (SNN) workflows remain divided between hardware-first implementations, which are difficult to integrate with PyTorch-style…

Hardware Architecture · Computer Science 2026-04-27 Jiwoon Lee , Souvik Chakraborty , Syed Bahauddin Alam , Cheolsoo Park

As a new paradigm of visual content generation, autoregressive text-to-image models suffer from slow inference due to their sequential token-by-token decoding process, often requiring thousands of model forward passes to generate a single…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yao Teng , Fuyun Wang , Xian Liu , Zhekai Chen , Han Shi , Yu Wang , Zhenguo Li , Weiyang Liu , Difan Zou , Xihui Liu

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm, enabling energy-efficient data processing through spike-based information transmission. Despite notable advancements in hardware for SNNs, spike encoding…

Signal Processing · Electrical Eng. & Systems 2025-06-03 MHD Anas Alsakkal , Runze Wang , Piotr Dudek , Jayawan Wijekoon

State space models (SSMs) leverage linear, time-invariant (LTI) systems to effectively learn sequences with long-range dependencies. By analyzing the transfer functions of LTI systems, we find that SSMs exhibit an implicit bias toward…

Machine Learning · Computer Science 2024-10-04 Annan Yu , Dongwei Lyu , Soon Hoe Lim , Michael W. Mahoney , N. Benjamin Erichson

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient…

Neural and Evolutionary Computing · Computer Science 2020-01-16 Yusuke Sakemi , Kai Morino , Takashi Morie , Kazuyuki Aihara

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a…

Machine Learning · Computer Science 2025-08-01 Sirine Arfa , Bernhard Vogginger , Christian Mayr

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

In this paper, we describe a new neuro-inspired, hardware-friendly readout stage for the liquid state machine (LSM), a popular model for reservoir computing. Compared to the parallel perceptron architecture trained by the p-delta algorithm,…

Emerging Technologies · Computer Science 2014-11-21 Subhrajit Roy , Amitava Banerjee , Arindam Basu

State Space Models (SSMs) have recently emerged as efficient alternatives to Transformer-Based Models (TBMs) for long-sequence processing with linear scaling, yet how contextual information flows across layers in these architectures remains…

Computation and Language · Computer Science 2026-01-08 Nhat M. Hoang , Do Xuan Long , Cong-Duy Nguyen , Min-Yen Kan , Luu Anh Tuan

Spiking Neural Networks (SNNs) are highly energy-efficient during inference, making them particularly suitable for deployment on neuromorphic hardware. Their ability to process event-driven inputs, such as data from dynamic vision sensors…

Machine Learning · Computer Science 2025-04-10 Sirine Arfa , Bernhard Vogginger , Chen Liu , Johannes Partzsch , Mark Schone , Christian Mayr