中文
相关论文

相关论文: Matterhorn: Efficient Analog Sparse Spiking Transf…

200 篇论文

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

信号处理 · 电气工程与系统科学 2026-01-26 Eike-Manuel Edelmann

Foundational models based on the transformer architecture are currently the state-of-the-art in general language modeling, as well as in scientific areas such as material science and climate. However, training and deploying these models is…

机器学习 · 计算机科学 2025-10-16 Adarsha Balaji , Sandeep Madireddy , Prasanna Balaprakash

Machine learning has emerged as the dominant tool for implementing complex cognitive tasks that require supervised, unsupervised, and reinforcement learning. While the resulting machines have demonstrated in some cases even super-human…

新兴技术 · 计算机科学 2019-08-06 Bipin Rajendran , Abu Sebastian , Michael Schmuker , Narayan Srinivasa , Evangelos Eleftheriou

Spiking Neural Networks (SNNs) offer a biologically inspired foundation for low-power, event-driven intelligence, yet their direct on-chip supervised training remains a key hardware challenge. This paper presents a multiplication-free,…

神经与进化计算 · 计算机科学 2026-04-28 Maryam Mirsadeghi , Mojtaba Mirbagheri , Saeed Reza Kheradpisheh

Large Language Models (LLMs) present significant challenges for deployment in energy-constrained environments due to their large model sizes and high inference latency. Spiking Neural Networks (SNNs), inspired by the sparse event-driven…

神经与进化计算 · 计算机科学 2025-08-29 Yi Jiang , Malyaban Bal , Brian Matejek , Susmit Jha , Adam Cobb , Abhronil Sengupta

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

计算机视觉与模式识别 · 计算机科学 2021-12-23 Gourav Datta , Peter A. Beerel

As spiking neural networks receive more attention, we look toward applications of this computing paradigm in fields other than computer vision and signal processing. One major field, underexplored in the neuromorphic setting, is Natural…

计算与语言 · 计算机科学 2024-02-01 R. Alexander Knipper , Kaniz Mishty , Mehdi Sadi , Shubhra Kanti Karmaker Santu

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

机器学习 · 计算机科学 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo

Spiking Neural Networks (SNNs) are promising biologically plausible models of computation which utilize a spiking binary activation function similar to that of biological neurons. SNNs are well positioned to process spatiotemporal data, and…

神经与进化计算 · 计算机科学 2025-05-20 Boxun Xu , Richard Boone , Peng Li

Spiking neural networks (SNNs) offer an inherent ability to process spatial-temporal data, or in other words, realworld sensory data, but suffer from the difficulty of training high accuracy models. A major thread of research on SNNs is on…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Dengyu Wu , Xinping Yi , Xiaowei Huang

Spiking Neural Networks (SNNs) hold promise for energy-efficient, biologically inspired computing. We identify substantial informatio loss during spike transmission, linked to temporal dependencies in traditional Leaky Integrate-and-Fire…

神经与进化计算 · 计算机科学 2025-02-04 Guobin Shen , Jindong Li , Tenglong Li , Dongcheng Zhao , Yi Zeng

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

硬件体系结构 · 计算机科学 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Spiking Neural Networks (SNNs) can reduce energy consumption compared to conventional Artificial Neural Networks (ANNs) when spiking activity is sparse and the neuron model is hardware-friendly. However, biologically faithful models are…

神经与进化计算 · 计算机科学 2026-05-13 Pascal Harmeling , Florent De Geeter , Guillaume Drion

Recently spiking neural networks (SNNs), the third-generation of neural networks has shown remarkable capabilities of energy-efficient computing, which is a promising alternative for deep neural networks (DNNs) with high energy consumption.…

计算机视觉与模式识别 · 计算机科学 2021-06-22 Yihao Luo , Min Xu , Caihong Yuan , Xiang Cao , Liangqi Zhang , Yan Xu , Tianjiang Wang , Qi Feng

Spiking Neural Networks (SNNs) are widely deployed to solve complex pattern recognition, function approximation and image classification tasks. With the growing size and complexity of these networks, hardware implementation becomes…

神经元与认知 · 定量生物学 2019-08-22 Anup Das , Yuefeng Wu , Khanh Huynh , Francesco Dell'Anna , Francky Catthoor , Siebren Schaafsma

Spiking Neural Networks (SNNs) have gained significant research attention in the last decade due to their potential to drive resource-constrained edge devices. Though existing SNN accelerators offer high efficiency in processing sparse…

硬件体系结构 · 计算机科学 2024-09-04 Ruokai Yin , Youngeun Kim , Di Wu , Priyadarshini Panda

Spiking Neural Networks (SNNs) have gained attention for their energy-efficient machine learning capabilities, utilizing bio-inspired activation functions and sparse binary spike-data representations. While recent SNN algorithmic advances…

神经与进化计算 · 计算机科学 2023-09-08 Abhiroop Bhattacharjee , Ruokai Yin , Abhishek Moitra , Priyadarshini Panda

In order to port the performance of trained artificial neural networks (ANNs) to spiking neural networks (SNNs), which can be implemented in neuromorphic hardware with a drastically reduced energy consumption, an efficient ANN to SNN…

神经与进化计算 · 计算机科学 2020-01-22 Christoph Stöckl , Wolfgang Maass

We present a fully memristive spiking neural network (MSNN) consisting of physically-realizable memristive neurons and memristive synapses to implement an unsupervised Spiking Time Dependent Plasticity (STDP) learning rule. The system is…

神经与进化计算 · 计算机科学 2022-03-11 Peng Zhou , Dong-Uk Choi , Jason K. Eshraghian , Sung-Mo Kang

Spiking Neural Networks (SNN) have gained increasing attention for its low power consumption. But training SNN is challenging. Liquid State Machine (LSM), as a major type of Reservoir computing, has been widely recognized for its low…

计算机视觉与模式识别 · 计算机科学 2020-06-01 Shasha Guo , Lianhua Qu , Lei Wang , Shuo Tian , Shiming Li , Weixia Xu