中文
相关论文

相关论文: A Diagonal Structured State Space Model on Loihi 2…

200 篇论文

The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical neural networks in…

神经与进化计算 · 计算机科学 2020-06-17 Bojian Yin , Federico Corradi , Sander M. Bohté

Implantable Brain-machine interfaces (BMIs) are promising for motor rehabilitation and mobility augmentation, and they demand accurate and energy-efficient algorithms. In this paper, we propose a novel spiking neural network (SNN) decoder…

信号处理 · 电气工程与系统科学 2024-05-06 Jiawei Liao , Oscar Toomey , Xiaying Wang , Lars Widmer , Cynthia A. Chestek , Luca Benini , Taekwang Jang

Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular…

人工智能 · 计算机科学 2024-12-03 Jindong Jiang , Fei Deng , Gautam Singh , Minseung Lee , Sungjin Ahn

Convolutional neural networks (CNNs) have achieved great success in performing cognitive tasks. However, execution of CNNs requires a large amount of computing resources and generates heavy memory traffic, which imposes a severe challenge…

硬件体系结构 · 计算机科学 2021-06-16 Jianlei Yang , Wenzhi Fu , Xingzhou Cheng , Xucheng Ye , Pengcheng Dai , Weisheng Zhao

Scene understanding is paramount in robotics, self-navigation, augmented reality, and many other fields. To fully accomplish this task, an autonomous agent has to infer the 3D structure of the sensed scene (to know where it looks at) and…

计算机视觉与模式识别 · 计算机科学 2020-02-26 Pier Luigi Dovesi , Matteo Poggi , Lorenzo Andraghetti , Miquel Martí , Hedvig Kjellström , Alessandro Pieropan , Stefano Mattoccia

Spiking neural networks (SNNs) are posited as a computationally efficient and biologically plausible alternative to conventional neural architectures, with their core computational framework primarily using the leaky integrate-and-fire…

神经与进化计算 · 计算机科学 2025-03-18 Malyaban Bal , Abhronil Sengupta

Directed graphs are ubiquitous across numerous domains, where the directionality of edges encodes critical causal dependencies. However, existing GNNs and graph Transformers tailored for directed graphs face two major challenges: (1)…

机器学习 · 计算机科学 2025-09-18 Junzhi She , Xunkai Li , Rong-Hua Li , Guoren Wang

The demand for edge artificial intelligence to process event-based, complex data calls for hardware beyond conventional digital, von-Neumann architectures. Neuromorphic computing, using spiking neural networks (SNNs) with emerging…

应用物理 · 物理学 2025-09-08 Zhu Wang , Song Wang , Zhiyuan Du , Ruibin Mao , Yu Xiao , Hayden Kwok-Hay So , Peng Lin , Can Li

Thanks to their parallel and sparse activity features, recurrent neural networks (RNNs) are well-suited for hardware implementation in low-power neuromorphic hardware. However, mapping rate-based RNNs to hardware-compatible spiking neural…

神经与进化计算 · 计算机科学 2024-07-19 Gauthier Boeshertz , Giacomo Indiveri , Manu Nair , Alpha Renner

State Space Models (SSMs) have emerged as an appealing alternative to Transformers for large language models, achieving state-of-the-art accuracy with constant memory complexity which allows for holding longer context lengths than…

机器学习 · 计算机科学 2024-12-10 Hung-Yueh Chiang , Chi-Chih Chang , Natalia Frumkin , Kai-Chiang Wu , Diana Marculescu

Low-cost FPGA platforms can broaden access to neuromorphic systems research, but current spiking neural network (SNN) workflows remain divided between hardware-first implementations, which are difficult to integrate with PyTorch-style…

硬件体系结构 · 计算机科学 2026-04-27 Jiwoon Lee , Souvik Chakraborty , Syed Bahauddin Alam , Cheolsoo Park

As a new paradigm of visual content generation, autoregressive text-to-image models suffer from slow inference due to their sequential token-by-token decoding process, often requiring thousands of model forward passes to generate a single…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Yao Teng , Fuyun Wang , Xian Liu , Zhekai Chen , Han Shi , Yu Wang , Zhenguo Li , Weiyang Liu , Difan Zou , Xihui Liu

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm, enabling energy-efficient data processing through spike-based information transmission. Despite notable advancements in hardware for SNNs, spike encoding…

信号处理 · 电气工程与系统科学 2025-06-03 MHD Anas Alsakkal , Runze Wang , Piotr Dudek , Jayawan Wijekoon

State space models (SSMs) leverage linear, time-invariant (LTI) systems to effectively learn sequences with long-range dependencies. By analyzing the transfer functions of LTI systems, we find that SSMs exhibit an implicit bias toward…

机器学习 · 计算机科学 2024-10-04 Annan Yu , Dongwei Lyu , Soon Hoe Lim , Michael W. Mahoney , N. Benjamin Erichson

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient…

神经与进化计算 · 计算机科学 2020-01-16 Yusuke Sakemi , Kai Morino , Takashi Morie , Kazuyuki Aihara

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a…

机器学习 · 计算机科学 2025-08-01 Sirine Arfa , Bernhard Vogginger , Christian Mayr

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

神经与进化计算 · 计算机科学 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

In this paper, we describe a new neuro-inspired, hardware-friendly readout stage for the liquid state machine (LSM), a popular model for reservoir computing. Compared to the parallel perceptron architecture trained by the p-delta algorithm,…

新兴技术 · 计算机科学 2014-11-21 Subhrajit Roy , Amitava Banerjee , Arindam Basu

State Space Models (SSMs) have recently emerged as efficient alternatives to Transformer-Based Models (TBMs) for long-sequence processing with linear scaling, yet how contextual information flows across layers in these architectures remains…

计算与语言 · 计算机科学 2026-01-08 Nhat M. Hoang , Do Xuan Long , Cong-Duy Nguyen , Min-Yen Kan , Luu Anh Tuan

Spiking Neural Networks (SNNs) are highly energy-efficient during inference, making them particularly suitable for deployment on neuromorphic hardware. Their ability to process event-driven inputs, such as data from dynamic vision sensors…

机器学习 · 计算机科学 2025-04-10 Sirine Arfa , Bernhard Vogginger , Chen Liu , Johannes Partzsch , Mark Schone , Christian Mayr