English
Related papers

Related papers: Heterogeneous quantization regularizes spiking neu…

200 papers

Neural network quantization has become an important research area due to its great impact on deployment of large models on resource constrained devices. In order to train networks that can be effectively discretized without loss of…

Machine Learning · Computer Science 2018-10-05 Christos Louizos , Matthias Reisser , Tijmen Blankevoort , Efstratios Gavves , Max Welling

The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which…

Neurons and Cognition · Quantitative Biology 2017-03-14 Mihai A. Petrovici , Ilja Bytschok , Johannes Bill , Johannes Schemmel , Karlheinz Meier

Real-world large-scale datasets are heteroskedastic and imbalanced -- labels have varying levels of uncertainty and label distributions are long-tailed. Heteroskedasticity and imbalance challenge deep learning algorithms due to the…

Machine Learning · Computer Science 2021-03-19 Kaidi Cao , Yining Chen , Junwei Lu , Nikos Arechiga , Adrien Gaidon , Tengyu Ma

Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as "neuromorphic engineering". However, analog circuits are sensitive to process-induced variation among…

Machine Learning · Computer Science 2022-09-13 Julian Büchel , Dmitrii Zendrikov , Sergio Solinas , Giacomo Indiveri , Dylan R. Muir

The evolution of the human brain has led to the development of complex synaptic plasticity, enabling dynamic adaptation to a constantly evolving world. This progress inspires our exploration into a new paradigm for Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-02-02 Guobin Shen , Dongcheng Zhao , Yiting Dong , Yang Li , Feifei Zhao , Yi Zeng

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Quantification is a supervised learning task that consists in predicting, given a set of classes C and a set D of unlabelled items, the prevalence (or relative frequency) p(c|D) of each class c in C. Quantification can in principle be…

Machine Learning · Computer Science 2021-09-22 Andrea Esuli , Alejandro Moreo Fernández , Fabrizio Sebastiani

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Biological intelligence emerges from substrates that are slow, noisy, and energetically constrained, yet it performs rapid and coherent inference in open-ended environments. Classical computational theories, built around vector-space…

Neurons and Cognition · Quantitative Biology 2026-05-12 Xin Li

Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of…

Synaptic plasticity poses itself as a powerful method of self-regulated unsupervised learning in neural networks. A recent resurgence of interest has developed in utilizing Artificial Neural Networks (ANNs) together with synaptic plasticity…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Samuel Schmidgall , Joe Hays

Radio Frequency (RF) sensing holds the potential for enabling pervasive monitoring applications. However, modern sensing algorithms imply complex operations, which clash with the energy-constrained nature of edge sensing devices. This calls…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Eleonora Cicciarella , Riccardo Mazzieri , Jacopo Pegoraro , Michele Rossi

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep…

Computation and Language · Computer Science 2024-09-26 Alexandre Bittar , Philip N. Garner

Human cognition emerges from coordinated spiking dynamics in distributed neural circuits, where information is encoded via both firing rates and precise spike timing determined by brain rhythms. Inspired by this notion, we propose a…

Neurons and Cognition · Quantitative Biology 2026-05-05 Tingting Dan , Guorong Wu

Spiking neural networks (SNNs) equipped with latency coding and spike-timing dependent plasticity rules offer an alternative to solve the data and energy bottlenecks of standard computer vision approaches: they can learn visual features…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Pierre Falez , Pierre Tirilly , Ioan Marius Bilasco , Philippe Devienne , Pierre Boulet

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann

Spiking Neural Networks (SNNs), providing more realistic neuronal dynamics, have been shown to achieve performance comparable to Artificial Neural Networks (ANNs) in several machine learning tasks. Information is processed as spikes within…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Jiaqi Lin , Sen Lu , Malyaban Bal , Abhronil Sengupta

Compared to conventional artificial neurons that produce dense and real-valued responses, biologically-inspired spiking neurons transmit sparse and binary information, which can also lead to energy-efficient implementations. Recent research…

Computation and Language · Computer Science 2023-02-17 Alexandre Bittar , Philip N. Garner

Mixed-signal neuromorphic systems represent a promising solution for solving extreme-edge computing tasks without relying on external computing resources. Their spiking neural network circuits are optimized for processing sensory data…

Neural and Evolutionary Computing · Computer Science 2023-07-13 Arianna Rubino , Matteo Cartiglia , Melika Payvand , Giacomo Indiveri

The surge in interest in Artificial Intelligence (AI) over the past decade has been driven almost exclusively by advances in Artificial Neural Networks (ANNs). While ANNs set state-of-the-art performance for many previously intractable…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Peter G. Stratton , Andrew Wabnitz , Chip Essam , Allen Cheung , Tara J. Hamilton