English
Related papers

Related papers: Autonomous Reinforcement Learning Robot Control wi…

200 papers

Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids the high training cost of directly trained Spiking…

Machine Learning · Computer Science 2025-12-16 Jingya Wang , Xin Deng , Wenjie Wei , Dehao Zhang , Shuai Wang , Qian Sun , Jieyuan Zhang , Hanwen Liu , Ning Xie , Malu Zhang

Unlike traditional artificial neural networks (ANNs), biological neuronal networks solve complex cognitive tasks with sparse neuronal activity, recurrent connections, and local learning rules. These mechanisms serve as design principles in…

Neural and Evolutionary Computing · Computer Science 2026-02-17 Matteo Saponati , Chiara De Luca , Giacomo Indiveri , Benjamin Grewe

Unmanned autonomous vehicles (UAVs) rely on effective path planning and tracking control to accomplish complex tasks in various domains. Reinforcement Learning (RL) methods are becoming increasingly popular in control applications, as they…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Angela Chen , Konstantinos Mitsopoulos , Raffaele Romagnoli

In this paper we present an algorithm-hardware codesign for camera-based autonomous flight in small drones. We show that the large write-latency and write-energy for nonvolatile memory (NVM) based embedded systems makes them unsuitable for…

Other Computer Science · Computer Science 2019-05-16 Insik Yoon , Aqeel Anwar , Titash Rakshit , Arijit Raychowdhury

Traditional von Neumann architecture based processors become inefficient in terms of energy and throughput as they involve separate processing and memory units, also known as~\textit{memory wall}. The memory wall problem is further…

Signal Processing · Electrical Eng. & Systems 2020-05-20 Abhash Kumar , Jawar Singh , Sai Manohar Beeraka , Bharat Gupta

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

We present our approach for the development, validation and deployment of a data-driven decision-making function for the automated control of a vehicle. The decisionmaking function, based on an artificial neural network is trained to steer…

After several decades of continuously optimizing computing systems, the Moore's law is reaching itsend. However, there is an increasing demand for fast and efficient processing systems that can handlelarge streams of data while decreasing…

Neural and Evolutionary Computing · Computer Science 2022-04-01 Javier López-Randulfe , Nico Reeb , Negin Karimi , Chen Liu , Hector A. Gonzalez , Robin Dietrich , Bernhard Vogginger , Christian Mayr , Alois Knoll

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Lower leg prostheses could improve the life quality of amputees by increasing comfort and reducing energy to locomote, but currently control methods are limited in modulating behaviors based upon the human's experience. This paper describes…

Systems and Control · Electrical Eng. & Systems 2020-09-18 Chang Gao , Rachel Gehlhar , Aaron D. Ames , Shih-Chii Liu , Tobi Delbruck

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Spiking Neural Networks (SNNs) can unleash the full power of analog Resistive Random Access Memories (RRAMs) based circuits for low power signal processing. Their inherent computational sparsity naturally results in energy efficiency…

Neural and Evolutionary Computing · Computer Science 2022-02-11 Filippo Moro , E. Esmanhotto , T. Hirtzlin , N. Castellani , A. Trabelsi , T. Dalgaty , G. Molas , F. Andrieu , S. Brivio , S. Spiga , G. Indiveri , M. Payvand , E. Vianello

The advent of unmanned aerial vehicles (UAVs) has improved a variety of fields by providing a versatile, cost-effective and accessible platform for implementing state-of-the-art algorithms. To accomplish a broader range of tasks, there is a…

Systems and Control · Electrical Eng. & Systems 2024-03-29 Sharif Azem , David Scheunert , Mengguang Li , Jonas Gehrunger , Kai Cui , Christian Hochberger , Heinz Koeppl

Robotic technologies have been an indispensable part for improving human productivity since they have been helping humans in completing diverse, complex, and intensive tasks in a fast yet accurate and efficient way. Therefore, robotic…

We extended the work of proposed activation function, Noisy Softplus, to fit into training of layered up spiking neural networks (SNNs). Thus, any ANN employing Noisy Softplus neurons, even of deep architecture, can be trained simply by the…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Qian Liu , Yunhua Chen , Steve Furber

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy-efficient computing, which is beneficial to mobile robotic applications. However, the…

Neural and Evolutionary Computing · Computer Science 2020-03-11 Zhenshan Bing , Claus Meschede , Guang Chen , Alois Knoll , Kai Huang