English
Related papers

Related papers: Memristor Hardware-Friendly Reinforcement Learning

200 papers

The development of memristive device technologies has reached a level of maturity to enable the design of complex and large-scale hybrid memristive-CMOS neural processing systems. These systems offer promising solutions for implementing…

Emerging Technologies · Computer Science 2020-04-22 Elisabetta Chicca , Giacomo Indiveri

Multi-step reasoning is a fundamental challenge in artificial intelligence, with applications ranging from mathematical problem-solving to decision-making in dynamic environments. Reinforcement Learning (RL) has shown promise in enabling…

Machine Learning · Computer Science 2025-07-24 Tao Xu , Dung-Yang Lee , Momiao Xiong

Brain-inspired computing proposes a set of algorithmic principles that hold promise for advancing artificial intelligence. They endow systems with self learning capabilities, efficient energy usage, and high storage capacity. A core concept…

Neural and Evolutionary Computing · Computer Science 2022-12-01 Younes Bouhadjar , Sebastian Siegel , Tom Tetzlaff , Markus Diesmann , Rainer Waser , Dirk J. Wouters

Nanoscale resistive switching devices (memristive devices or memristors) have been studied for a number of applications ranging from non-volatile memory, logic to neuromorphic systems. However a major challenge is to address the potentially…

Other Condensed Matter · Physics 2013-07-04 Siddharth Gaba , Patrick Sheridan , Jiantao Zhou , Shinhyun Choi , Wei Lu

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Neuromorphic Multiply-And-Accumulate (MAC) circuits utilizing synaptic weight elements based on SRAM or novel Non-Volatile Memories (NVMs) provide a promising approach for highly efficient hardware representations of neural networks. NVM…

Emerging Technologies · Computer Science 2018-09-14 Borna Obradovic , Titash Rakshit , Ryan Hatcher , Jorge A. Kittl , Mark S. Rodder

This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

Conventional neuro-computing architectures and artificial neural networks have often been developed with no or loose connections to neuroscience. As a consequence, they have largely ignored key features of biological neural processing…

Emerging Technologies · Computer Science 2017-11-08 Giacomo Indiveri , Bernabe Linares-Barranco , Robert Legenstein , George Deligeorgis , Themistoklis Prodromakis

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

Robotics · Computer Science 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel

Despite all the progress of semiconductor integrated circuit technology, the extreme complexity of the human cerebral cortex makes the hardware implementation of neuromorphic networks with a comparable number of devices exceptionally…

Emerging Technologies · Computer Science 2015-05-20 Mirko Prezioso , Farnood Merrikh-Bayat , Brian Hoskins , Gina Adam , Konstantin K. Likharev , Dmitri B. Strukov

Reinforcement Learning (RL) provides a powerful framework for decision-making in complex environments. However, implementing RL in hardware-efficient and bio-inspired ways remains a challenge. This paper presents a novel Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2023-08-09 Sergio F. Chevtchenko , Yeshwanth Bethi , Teresa B. Ludermir , Saeed Afshar

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Reinforcement learning (RL) is a machine learning paradigm where an autonomous agent learns to make an optimal sequence of decisions by interacting with the underlying environment. The promise demonstrated by RL-guided workflows in…

Cryptography and Security · Computer Science 2022-08-31 Satwik Patnaik , Vasudev Gohil , Hao Guo , Jeyavijayan , Rajendran

Dexterous manipulation with anthropomorphic robot hands remains a challenging problem in robotics because of the high-dimensional state and action spaces and complex contacts. Nevertheless, skillful closed-loop manipulation is required to…

Robotics · Computer Science 2022-12-06 Malte Mosbach , Kara Moraw , Sven Behnke

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

The value memristor devices offer to the neuromorphic computing hardware design community rests on the ability to provide effective device models that can enable large scale integrated computing architecture application simulations.…

Mesoscale and Nanoscale Physics · Physics 2016-11-18 Nathan R. McDonald , Robinson E. Pino , Peter J. Rozwood , Bryant T. Wysocki

As the size and ubiquity of artificial intelligence and computational machine learning (ML) models grow, their energy consumption for training and use is rapidly becoming economically and environmentally unsustainable. Neuromorphic…

Disordered Systems and Neural Networks · Physics 2023-10-17 Menachem Stern , Sam Dillavou , Dinesh Jayaraman , Douglas J. Durian , Andrea J. Liu

Learning with physical systems is an emerging paradigm that seeks to harness the intrinsic nonlinear dynamics of physical substrates for learning. The impetus for a paradigm shift in how hardware is used for computational intelligence stems…

Disordered Systems and Neural Networks · Physics 2026-04-28 Francesco Caravelli , Gianluca Milano , Adam Z. Stieg , Carlo Ricciardi , Simon Anthony Brown , Zdenka Kuncic

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang