English
Related papers

Related papers: Adversarially Robust Spiking Neural Networks with …

200 papers

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

Reducing energy consumption is a critical point for neural network models running on edge devices. In this regard, reducing the number of multiply-accumulate (MAC) operations of Deep Neural Networks (DNNs) running on edge hardware…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Simon Narduzzi , Siavash A. Bigdeli , Shih-Chii Liu , L. Andrea Dunbar

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Deep learning models are vulnerable to adversarial examples which are input samples modified in order to maximize the error on the system. We introduce Spartan Networks, resistant deep neural networks that do not require input preprocessing…

Machine Learning · Computer Science 2018-12-18 François Menet , Paul Berthier , José M. Fernandez , Michel Gagnon

The spiking neural networks (SNNs) are considered as one of the most promising artificial neural networks due to their energy efficient computing capability. Recently, conversion of a trained deep neural network to an SNN has improved the…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Seongsik Park , Seijoon Kim , Hyeokjun Choe , Sungroh Yoon

The biological neural network is a vast and diverse structure with high neural heterogeneity. Conventional Artificial Neural Networks (ANNs) primarily focus on modifying the weights of connections through training while modeling neurons as…

Neural and Evolutionary Computing · Computer Science 2023-10-16 Guobin Shen , Dongcheng Zhao , Yiting Dong , Yang Li , Yi Zeng

The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical neural networks in…

Neural and Evolutionary Computing · Computer Science 2020-06-17 Bojian Yin , Federico Corradi , Sander M. Bohté

Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by…

Machine Learning · Computer Science 2018-12-17 Jeremy Kepner , Vijay Gadepally , Hayden Jananthan , Lauren Milechin , Sid Samsi

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Spiking neural networks (SNNs) are becoming a promising alternative to conventional artificial neural networks (ANNs) due to their rich neural dynamics and the implementation of energy-efficient neuromorphic chips. However, the…

Artificial Intelligence · Computer Science 2024-08-27 Jiahao Su , Kang You , Zekai Xu , Weizhi Xu , Zhezhi He

Recurrent Neural Networks (RNNs) are powerful tools for solving sequence-based problems, but their efficacy and execution time are dependent on the size of the network. Following recent work in simplifying these networks with model pruning…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Feiwen Zhu , Jeff Pool , Michael Andersch , Jeremy Appleyard , Fung Xie

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

Machine Learning · Computer Science 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

It is well-known that deep neural networks (DNNs) have shown remarkable success in many fields. However, when adding an imperceptible magnitude perturbation on the model input, the model performance might get rapid decrease. To address this…

Machine Learning · Computer Science 2022-01-04 Hao Yang , Min Wang , Zhengfei Yu , Yun Zhou

Integrating Spiking Neural Networks (SNNs) with Transformer architectures offers a promising pathway to balance energy efficiency and performance, particularly for edge vision applications. However, existing Spiking Transformers face two…

Neural and Evolutionary Computing · Computer Science 2026-03-23 Dehao Zhang , Fukai Guo , Shuai Wang , Jingya Wang , Jieyuan Zhang , Yimeng Shan , Malu Zhang , Yang Yang , Haizhou Li

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

Hardware Architecture · Computer Science 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

Spiking Neural Networks (SNNs) are increasingly studied as energy-efficient alternatives to Convolutional Neural Networks (CNNs), particularly for edge intelligence. However, prior work has largely emphasized large-scale models, leaving the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Radib Bin Kabir , Tawsif Tashwar Dipto , Mehedi Ahamed , Sabbir Ahmed , Md Hasanul Kabir

Sparse attacks are to optimize the magnitude of adversarial perturbations for fooling deep neural networks (DNNs) involving only a few perturbed pixels (i.e., under the l0 constraint), suitable for interpreting the vulnerability of DNNs.…

Machine Learning · Computer Science 2025-06-24 Fudong Lin , Jiadong Lou , Hao Wang , Brian Jalaian , Xu Yuan

We present a new algorithm to train a robust neural network against adversarial attacks. Our algorithm is motivated by the following two ideas. First, although recent work has demonstrated that fusing randomness can improve the robustness…

Machine Learning · Computer Science 2019-05-07 Xuanqing Liu , Yao Li , Chongruo Wu , Cho-Jui Hsieh