English
Related papers

Related papers: Heterogeneous quantization regularizes spiking neu…

200 papers

The binding problem is one of the fundamental challenges that prevent the artificial neural network (ANNs) from a compositional understanding of the world like human perception, because disentangled and distributed representations of…

Artificial Intelligence · Computer Science 2022-11-14 Hao Zheng , Hui Lin , Rong Zhao , Luping Shi

Diffusion models have recently emerged as the dominant approach in visual generation tasks. However, the lengthy denoising chains and the computationally intensive noise estimation networks hinder their applicability in low-latency and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qian Zeng , Jie Song , Yuanyu Wan , Huiqiong Wang , Mingli Song

The increasing need for intelligent sensors in a wide range of everyday objects requires the existence of low power information processing systems which can operate autonomously in their environment. In particular, merging and processing…

Neural and Evolutionary Computing · Computer Science 2019-03-12 Johannes C. Thiele , Olivier Bichler , Antoine Dupret , Sergio Solinas , Giacomo Indiveri

Brain-inspired learning models attempt to mimic the cortical architecture and computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we present…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Neurons and networks in the cerebral cortex must operate reliably despite multiple sources of noise. To evaluate the impact of both input and output noise, we determine the robustness of single-neuron stimulus selective responses, as well…

Neurons and Cognition · Quantitative Biology 2018-01-24 Ran Rubin , L. F. Abbott , Haim Sompolinsky

Spiking Neural Networks (SNNs) and neuromorphic computing offer bio-inspired advantages such as sparsity and ultra-low power consumption, providing a promising alternative to conventional networks. However, training deep SNNs from scratch…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Aurora Micheli , Olaf Booij , Jan van Gemert , Nergis Tömen

Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal…

Hardware Architecture · Computer Science 2021-05-10 Haowen Fang , Brady Taylor , Ziru Li , Zaidao Mei , Hai Li , Qinru Qiu

Spiking Neural Networks are powerful computational modelling tools that have attracted much interest because of the bioinspired modelling of synaptic interactions between neurons. Most of the research employing spiking neurons has been…

Neural and Evolutionary Computing · Computer Science 2019-03-05 Huanneng Qiu , Matthew Garratt , David Howard , Sreenatha Anavatti

Neural network quantization methods often involve simulating the quantization process during training, making the trained model highly dependent on the target bit-width and precise way quantization is performed. Robust quantization offers…

Machine Learning · Computer Science 2020-10-23 Moran Shkolnik , Brian Chmiel , Ron Banner , Gil Shomron , Yury Nahshan , Alex Bronstein , Uri Weiser

Synergies between advanced communications, computing and artificial intelligence are unraveling new directions of coordinated operation and resiliency in microgrids. On one hand, coordination among sources is facilitated by distributed,…

Emerging Technologies · Computer Science 2024-04-16 Xiaoguang Diao , Yubo Song , Subham Sahoo , Yuan Li

Spiking Neural Networks (SNNs) are promising brain-inspired models known for low power consumption and superior potential for temporal processing, but identifying suitable learning mechanisms remains a challenge. Despite the presence of…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yuzhe Liu , Xin Deng , Qiang Yu

The mutual information between stimulus and spike-train response is commonly used to monitor neural coding efficiency, but neuronal computation broadly conceived requires more refined and targeted information measures of input-output joint…

Neurons and Cognition · Quantitative Biology 2015-04-21 Sarah E. Marzen , Michael R. DeWeese , James P. Crutchfield

Every commercially available, state-of-the-art neural network consume plain input data, which is a well-known privacy concern. We propose a new architecture based on homomorphic encryption, which allows the neural network to operate on…

Cryptography and Security · Computer Science 2025-02-28 Marcos Florencio , Luiz Alencar , Bianca Lima

Several techniques have been proposed to address the problem of recognizing activities of daily living from signals. Deep learning techniques applied to inertial signals have proven to be effective, achieving significant classification…

Signal Processing · Electrical Eng. & Systems 2022-01-21 Hamza Amrani , Daniela Micucci , Marco Mobilio , Paolo Napoletano

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Codifying memories is one of the fundamental problems of modern Neuroscience. The functional mechanisms behind this phenomenon remain largely unknown. Experimental evidence suggests that some of the memory functions are performed by…

Neurons and Cognition · Quantitative Biology 2022-05-17 Ivan Y. Tyukin , Alexander N. Gorban , Carlos Calvo , Julia Makarova , Valeri A. Makarov

Although considerable progress has been obtained in neural network quantization for efficient inference, existing methods are not scalable to heterogeneous devices as one dedicated model needs to be trained, transmitted, and stored for one…

Machine Learning · Computer Science 2022-12-13 Hai Wu , Ruifei He , Haoru Tan , Xiaojuan Qi , Kaibin Huang

The calibration and training of a neural network is a complex and time-consuming procedure that requires significant computational resources to achieve satisfactory results. Key obstacles are a large number of hyperparameters to select and…

Machine Learning · Computer Science 2023-09-07 Raffaele Giuseppe Cestari , Gabriele Maroni , Loris Cannelli , Dario Piga , Simone Formentin

We propose a probabilistic framework for dynamic quantization of neural networks that allows for a computationally efficient input-adaptive rescaling of the quantization parameters. Our framework applies a probabilistic model to the…

Machine Learning · Computer Science 2025-05-19 Gabriele Santini , Francesco Paissan , Elisabetta Farella

The dynamics of neural networks is often characterized by collective behavior and quasi-synchronous events, where a large fraction of neurons fire in short time intervals, separated by uncorrelated firing activity. These global temporal…

Disordered Systems and Neural Networks · Physics 2014-10-03 Raffaella Burioni , Mario Casartelli , Matteo di Volo , Roberto Livi , Alessandro Vezzani