English
Related papers

Related papers: Convergence Analysis of Backpropagation Algorithm …

200 papers

The article presents performance analysis of a real valued neuro genetic algorithm applied for the detection of proportion of the gases found in manhole gas mixture. The neural network (NN) trained using genetic algorithm (GA) leads to…

Neural and Evolutionary Computing · Computer Science 2012-09-06 Varun Kumar Ojha , Paramartha Dutta , Hiranmay Saha

Backpropagation (BP) is widely used for calculating gradients in deep neural networks (DNNs). Applied often along with stochastic gradient descent (SGD) or its variants, BP is considered as a de-facto choice in a variety of machine learning…

Machine Learning · Computer Science 2024-01-11 Ziang Li , Yiwen Guo , Haodi Liu , Changshui Zhang

This work presents a novel ensemble of Bayesian Neural Networks (BNNs) for control of safety-critical systems. Decision making for safety-critical systems is challenging due to performance requirements with significant consequences in the…

Robotics · Computer Science 2020-01-10 Keuntaek Lee , Ziyi Wang , Bogdan I. Vlahov , Harleen K. Brar , Evangelos A. Theodorou

A sensorless speed, average temperature and resistance estimation technique based on Neural Network (NN) for brushed DC machines is proposed in this paper. The literature on parameters and state spaces estimations of the Brushed DC…

Signal Processing · Electrical Eng. & Systems 2021-04-12 Hacene Mellah , Kamel Eddine Hemsas , Rachid Taleb

Reinforcement Learning (RL) has demonstrated state-of-the-art results in a number of autonomous system applications, however many of the underlying algorithms rely on black-box predictions. This results in poor explainability of the…

Machine Learning · Computer Science 2019-11-27 Matt Benatan , Edward O. Pyzer-Knapp

While backpropagation (BP) has been applied to spiking neural networks (SNNs) achieving encouraging results, a key challenge involved is to backpropagate a continuous-valued loss over layers of spiking neurons exhibiting discontinuous…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Yukun Yang , Wenrui Zhang , Peng Li

In this paper, we present a novel information processing architecture for safe deep learning-based visual navigation of autonomous systems. The proposed information processing architecture is used to support a perceptual attention-based…

Robotics · Computer Science 2019-10-17 Keuntaek Lee , Gabriel Nakajima An , Viacheslav Zakharov , Evangelos A. Theodorou

By and large, Backpropagation (BP) is regarded as one of the most important neural computation algorithms at the basis of the progress in machine learning, including the recent advances in deep learning. However, its computational structure…

Artificial Intelligence · Computer Science 2018-08-22 Alessandro Betti , Marco Gori , Giuseppe Marra

Predictive coding networks (PCNs) are an influential model for information processing in the brain. They have appealing theoretical interpretations and offer a single mechanism that accounts for diverse perceptual phenomena of the brain. On…

Machine Learning · Computer Science 2021-03-08 Tommaso Salvatori , Yuhang Song , Thomas Lukasiewicz , Rafal Bogacz , Zhenghua Xu

As the effective range of air-to-air missiles increases, it becomes harder for human operators to maintain the situational awareness needed to keep a UAV safe. In this work, we propose a decision support tool to help UAV operators in Beyond…

Machine Learning · Computer Science 2024-02-16 Edvards Scukins , Markus Klein , Lars Kroon , Petter Ögren

Backpropagation (BP) remains the dominant and most successful method for training parameters of deep neural network models. However, BP relies on two computationally distinct phases, does not provide a satisfactory explanation of biological…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Marcel van Gerven , Nasir Ahmad

Neural network learning is usually time-consuming since backpropagation needs to compute full gradients and backpropagate them across multiple layers. Despite its success of existing works in accelerating propagation through sparseness, the…

Machine Learning · Computer Science 2020-10-28 Zhiyuan Zhang , Pengcheng Yang , Xuancheng Ren , Qi Su , Xu Sun

Deep neural networks (DNNs) are widely used in perception systems for safety-critical applications, such as autonomous driving and robotics. However, DNNs remain vulnerable to various safety concerns, including generalization errors,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Albert Schotschneider , Svetlana Pavlitska , J. Marius Zöllner

Rapid detection of gas concentration is important in different domains like gas leakage monitoring, pollution control, and so on, for the prevention of health hazards. Out of different types of gas sensors, Metal oxide (MOx) sensors are…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Shavika Rastogi , Nik Dennler , Michael Schmuker , André van Schaik

Backpropagation (BP) is the standard algorithm for training the deep neural networks that power modern artificial intelligence including large language models. However, BP is energy inefficient and unlikely to be implemented by the brain.…

Machine Learning · Computer Science 2025-10-30 Francesco Innocenti

Olfaction sensing in autonomous robotics faces challenges in dynamic operations, energy efficiency, and edge processing. It necessitates a machine learning algorithm capable of managing real-world odor interference, ensuring resource…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Rizwana Kausar , Fakhreddine Zayer , Jaime Viegas , Jorge Dias

The back-propagation (BP) algorithm has been considered the de-facto method for training deep neural networks. It back-propagates errors from the output layer to the hidden layers in an exact manner using the transpose of the feedforward…

Neural and Evolutionary Computing · Computer Science 2018-05-01 Hongyin Luo , Jie Fu , James Glass

Backpropagation (BP) has long been the predominant method for training neural networks due to its effectiveness. However, numerous alternative approaches, broadly categorized under feedback alignment, have been proposed, many of which are…

Machine Learning · Computer Science 2025-02-11 Aymene Berriche , Mehdi Zakaria Adjal , Riyadh Baghdadi

Large multilayer neural networks trained with backpropagation have recently achieved state-of-the-art results in a wide range of problems. However, using backprop for neural net learning still has some disadvantages, e.g., having to tune a…

Machine Learning · Statistics 2015-07-16 José Miguel Hernández-Lobato , Ryan P. Adams

The increasing need for intelligent sensors in a wide range of everyday objects requires the existence of low power information processing systems which can operate autonomously in their environment. In particular, merging and processing…

Neural and Evolutionary Computing · Computer Science 2019-03-12 Johannes C. Thiele , Olivier Bichler , Antoine Dupret , Sergio Solinas , Giacomo Indiveri
‹ Prev 1 2 3 10 Next ›