English
Related papers

Related papers: Equilibrium Propagation for Complete Directed Neur…

200 papers

Backpropagation is a cornerstone algorithm in training neural networks for supervised learning, which uses a gradient descent method to update network weights by minimizing the discrepancy between actual and desired outputs. Despite its…

The backpropagation algorithm is an invaluable tool for training artificial neural networks; however, because of a weight sharing requirement, it does not provide a plausible model of brain function. Here, in the context of a two-layer…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Siavash Golkar , David Lipshutz , Yanis Bahroun , Anirvan M. Sengupta , Dmitri B. Chklovskii

Traditional backpropagation of error, though a highly successful algorithm for learning in artificial neural network models, includes features which are biologically implausible for learning in real neural circuits. An alternative called…

Machine Learning · Computer Science 2020-11-06 Nasir Ahmad , Marcel A. J. van Gerven , Luca Ambrogioni

The backpropagation algorithm has experienced remarkable success in training large-scale artificial neural networks; however, its biological plausibility has been strongly criticized, and it remains an open question whether the brain…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Bariscan Bozkurt , Cengiz Pehlevan , Alper T Erdogan

The field of artificial intelligence faces significant challenges in achieving both biological plausibility and computational efficiency, particularly in visual learning tasks. Current artificial neural networks, such as convolutional…

Machine Learning · Computer Science 2024-09-27 Jacobo Ruiz , Manas Gupta

By and large, Backpropagation (BP) is regarded as one of the most important neural computation algorithms at the basis of the progress in machine learning, including the recent advances in deep learning. However, its computational structure…

Artificial Intelligence · Computer Science 2018-08-22 Alessandro Betti , Marco Gori , Giuseppe Marra

The backpropagation algorithm is often debated for its biological plausibility. However, various learning methods for neural architecture have been proposed in search of more biologically plausible learning. Most of them have tried to solve…

Neural and Evolutionary Computing · Computer Science 2020-11-25 Shashi Kant Gupta

The Backpropagation algorithm relies on the abstraction of using a neural model that gets rid of the notion of time, since the input is mapped instantaneously to the output. In this paper, we claim that this abstraction of ignoring time,…

Machine Learning · Computer Science 2020-06-19 Alessandro Betti , Marco Gori

Backpropagation learning algorithm, the workhorse of modern artificial intelligence, is notoriously difficult to implement in physical neural networks. Equilibrium Propagation (EP) is an alternative with comparable efficiency and strong…

Machine Learning · Computer Science 2026-03-17 Karol Sajnok , Michał Matuszewski

Humans excel at continually acquiring, consolidating, and retaining information from an ever-changing environment, whereas artificial neural networks (ANNs) exhibit catastrophic forgetting. There are considerable differences in the…

Neural and Evolutionary Computing · Computer Science 2023-04-17 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Backpropagation is widely used to train artificial neural networks, but its relationship to synaptic plasticity in the brain is unknown. Some biological models of backpropagation rely on feedback projections that are symmetric with…

Neurons and Cognition · Quantitative Biology 2023-02-08 Navid Shervani-Tabar , Robert Rosenbaum

One major criticism of deep learning centers around the biological implausibility of the credit assignment schema used for learning -- backpropagation of errors. This implausibility translates into practical limitations, spanning scientific…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Alexander Ororbia , Ankur Mali , Adam Kohan , Beren Millidge , Tommaso Salvatori

The biological plausibility of the backpropagation algorithm has long been doubted by neuroscientists. Two major reasons are that neurons would need to send two different types of signal in the forward and backward phases, and that pairs of…

Machine Learning · Computer Science 2018-08-16 Benjamin Scellier , Anirudh Goyal , Jonathan Binas , Thomas Mesnard , Yoshua Bengio

Finding biologically plausible alternatives to back-propagation of errors is a fundamentally important challenge in artificial neural network research. In this paper, we propose a learning algorithm called error-driven Local Representation…

Neural and Evolutionary Computing · Computer Science 2018-11-19 Alexander G. Ororbia , Ankur Mali

Neuroscientists have long criticised deep learning algorithms as incompatible with current knowledge of neurobiology. We explore more biologically plausible versions of deep representation learning, focusing here mostly on unsupervised…

Machine Learning · Computer Science 2016-08-10 Yoshua Bengio , Dong-Hyun Lee , Jorg Bornschein , Thomas Mesnard , Zhouhan Lin

It is widely believed that the backpropagation algorithm is essential for learning good feature detectors in early layers of artificial neural networks, so that these detectors are useful for the task performed by the higher layers of that…

Machine Learning · Computer Science 2019-08-30 Dmitry Krotov , John Hopfield

Machine learning algorithms, and more in particular neural networks, arguably experience a revolution in terms of performance. Currently, the best systems we have for speech recognition, computer vision and similar problems are based on…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Michiel Hermans , Michaël Burm , Joni Dambre , Peter Bienstman

The backpropagation (BP) algorithm is often thought to be biologically implausible in the brain. One of the main reasons is that BP requires symmetric weight matrices in the feedforward and feedback pathways. To address this "weight…

Machine Learning · Computer Science 2018-12-24 Will Xiao , Honglin Chen , Qianli Liao , Tomaso Poggio

Inspired by key neuroscience principles, deep learning has driven exponential breakthroughs in developing functional models of perception and other cognitive processes. A key to this success has been the implementation of crucial features…

Neurons and Cognition · Quantitative Biology 2025-11-07 Guillaume Etter

The back-propagation (BP) algorithm has been considered the de-facto method for training deep neural networks. It back-propagates errors from the output layer to the hidden layers in an exact manner using the transpose of the feedforward…

Neural and Evolutionary Computing · Computer Science 2018-05-01 Hongyin Luo , Jie Fu , James Glass
‹ Prev 1 2 3 10 Next ›