English
Related papers

Related papers: Autonomous Reinforcement Learning Robot Control wi…

200 papers

The US Naval Research Laboratory's (NRL's) Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) experiment pioneers the use of reinforcement learning (RL) for control of free-flying robots in the zero-gravity…

Robotics · Computer Science 2026-04-01 Samantha Chapin , Kenneth Stewart , Roxana Leontie , Carl Glen Henshaw

Artificial Neural Networks (ANNs) are currently being used as function approximators in many state-of-the-art Reinforcement Learning (RL) algorithms. Spiking Neural Networks (SNNs) have been shown to drastically reduce the energy…

Machine Learning · Computer Science 2020-01-23 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Although widely used in machine learning, backpropagation cannot directly be applied to SNN training and is not feasible on a neuromorphic processor that emulates biological neuron and synapses. This work presents a spike-based…

Neural and Evolutionary Computing · Computer Science 2021-05-11 Amar Shrestha , Haowen Fang , Daniel Patrick Rider , Zaidao Mei , Qinru Qiu

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

Robotic airships offer significant advantages in terms of safety, mobility, and extended flight times. However, their highly restrictive weight constraints pose a major challenge regarding the available computational resources to perform…

Robotics · Computer Science 2022-03-08 Marina González-Álvarez , Julien Dupeyroux , Federico Corradi , Guido de Croon

Biological sensing and processing is asynchronous and sparse, leading to low-latency and energy-efficient perception and action. In robotics, neuromorphic hardware for event-based vision and spiking neural networks promises to exhibit…

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same…

Machine Learning · Computer Science 2019-08-20 Devdhar Patel , Hananel Hazan , Daniel J. Saunders , Hava Siegelmann , Robert Kozma

Neuromorphic hardware has several promising advantages compared to von Neumann architectures and is highly interesting for robot control. However, despite the high speed and energy efficiency of neuromorphic computing, algorithms utilizing…

Neural and Evolutionary Computing · Computer Science 2020-11-30 Carlo Michaelis , Andrew B. Lehr , Christian Tetzlaff

This paper explores a Deep Reinforcement Learning (DRL) approach for designing image-based control for edge robots to be implemented on Field Programmable Gate Arrays (FPGAs). Although FPGAs are more power-efficient than CPUs and GPUs, a…

Robotics · Computer Science 2021-09-16 Yuki Kadokawa , Yoshihisa Tsurumine , Takamitsu Matsubara

The energy-efficient control of mobile robots is crucial as the complexity of their real-world applications increasingly involves high-dimensional observation and action spaces, which cannot be offset by limited on-board resources. An…

Neural and Evolutionary Computing · Computer Science 2020-10-20 Guangzhi Tang , Neelesh Kumar , Raymond Yoo , Konstantinos P. Michmizos

Programming recurrent spiking neural networks (RSNNs) to robustly perform multi-timescale computation remains a difficult challenge. To address this, we describe a single-shot weight learning scheme to embed robust multi-timescale dynamics…

Neural and Evolutionary Computing · Computer Science 2025-01-14 Madison Cotteret , Hugh Greatorex , Alpha Renner , Junren Chen , Emre Neftci , Huaqiang Wu , Giacomo Indiveri , Martin Ziegler , Elisabetta Chicca

Energy-efficient simultaneous localization and mapping (SLAM) is crucial for mobile robots exploring unknown environments. The mammalian brain solves SLAM via a network of specialized neurons, exhibiting asynchronous computations and…

Robotics · Computer Science 2019-09-20 Guangzhi Tang , Arpit Shah , Konstantinos P. Michmizos

The latest satellite communication (SatCom) missions are characterized by a fully reconfigurable on-board software-defined payload, capable of adapting radio resources to the temporal and spatial variations of the system traffic. As pure…

Robust fitting of geometric models is a fundamental task in many computer vision pipelines. Numerous innovations have been produced on the topic, from improving the efficiency and accuracy of random sampling heuristics to generating novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Tam Ngoc-Bang Nguyen , Anh-Dzung Doan , Zhipeng Cai , Tat-Jun Chin

Achieving energy efficiency in learning is a key challenge for artificial intelligence (AI) computing platforms. Biological systems demonstrate remarkable abilities to learn complex skills quickly and efficiently. Inspired by this, we…

Artificial Intelligence · Computer Science 2024-05-27 Ingo Blakowski , Dmitrii Zendrikov , Cristiano Capone , Giacomo Indiveri

This study proposes a hybrid curriculum reinforcement learning (CRL) framework based on a fully spiking neural network (SNN) for 9-degree-of-freedom robotic arms performing target reaching and grasping tasks. To reduce network complexity…

Robotics · Computer Science 2025-08-19 Liwen Zhang , Heng Deng , Guanghui Sun

In this paper, we develop four spiking neural network (SNN) models for two static American Sign Language (ASL) hand gesture classification tasks, i.e., the ASL Alphabet and ASL Digits. The SNN models are deployed on Intel's neuromorphic…

Machine Learning · Computer Science 2022-10-04 MohammadReza Mohammadi , Peyton Chandarana , James Seekings , Sara Hendrix , Ramtin Zand

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

This paper presents a multimodal control framework based on spiking neural networks (SNNs) for robotic arms aboard space stations. It is designed to cope with the constraints of limited onboard resources while enabling autonomous…

Robotics · Computer Science 2025-08-12 Liwen Zhang , Dong Zhou , Shibo Shao , Zihao Su , Guanghui Sun

Previous studies on automatic berthing systems based on artificial neural network (ANN) showed great berthing performance by training the ANN with ship berthing data as training data. However, because the ANN requires a large amount of…

Machine Learning · Computer Science 2021-12-06 Daesoo Lee