English
Related papers

Related papers: SDiT: Spiking Diffusion Model with Transformer

200 papers

Deep convolutional neural networks (CNNs) have shown great potential for numerous real-world machine learning applications, but performing inference in large CNNs in real-time remains a challenge. We have previously demonstrated that…

Machine Learning · Statistics 2016-12-14 Bodo Rueckauer , Iulia-Alexandra Lungu , Yuhuang Hu , Michael Pfeiffer

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Soumik Mukhopadhyay , Matthew Gwilliam , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Srinidhi Hegde , Tianyi Zhou , Abhinav Shrivastava

Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks…

Machine Learning · Computer Science 2025-08-11 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

Spiking Neural Networks (SNNs) are promising biologically plausible models of computation which utilize a spiking binary activation function similar to that of biological neurons. SNNs are well positioned to process spatiotemporal data, and…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Boxun Xu , Richard Boone , Peng Li

Spiking Neural Networks (SNNs) offer a promising energy-efficient alternative to Artificial Neural Networks (ANNs) by utilizing sparse and asynchronous processing through discrete spike-based computation. However, the performance of deep…

Neural and Evolutionary Computing · Computer Science 2025-10-10 Eric Jahns , Davi Moreno , Michel A. Kinsy

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

Artificial neural networks (ANNs) can help camera-based remote photoplethysmography (rPPG) in measuring cardiac activity and physiological signals from facial videos, such as pulse wave, heart rate and respiration rate with better accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Mingxuan Liu , Jiankai Tang , Yongli Chen , Haoxiang Li , Jiahao Qi , Siwei Li , Kegang Wang , Jie Gan , Yuntao Wang , Hong Chen

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Recently, Spiking Neural Networks (SNNs), enjoying extreme energy efficiency, have drawn much research attention on 2D visual recognition and shown gradually increasing application potential. However, it still remains underexplored whether…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Dayong Ren , Zhe Ma , Yuanpei Chen , Weihang Peng , Xiaode Liu , Yuhan Zhang , Yufei Guo

Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Kinjal Patel , Eric Hunsberger , Sean Batir , Chris Eliasmith

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Larger Spiking Neural Network (SNN) models are typically favorable as they can offer higher accuracy. However, employing such models on the resource- and energy-constrained embedded platforms is inefficient. Towards this, we present a…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

Brain-inspired Spiking Neural Networks (SNNs) have the characteristics of event-driven and high energy-efficient, which are different from traditional Artificial Neural Networks (ANNs) when deployed on edge devices such as neuromorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jue Chen , Huan Yuan , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

By exploiting discrete signal processing and simulating brain neuron communication, Spiking Neural Networks (SNNs) offer a low-energy alternative to Artificial Neural Networks (ANNs). However, existing SNN models, still face high…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Wenxuan Pan , Feifei Zhao , Bing Han , Haibo Tong , Yi Zeng

Event-based semantic segmentation has great potential in autonomous driving and robotics due to the advantages of event cameras, such as high dynamic range, low latency, and low power cost. Unfortunately, current artificial neural network…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xianlei Long , Xiaxin Zhu , Fangming Guo , Wanyi Zhang , Qingyi Gu , Chao Chen , Fuqiang Gu

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman