English
Related papers

Related papers: Memristor Hardware-Friendly Reinforcement Learning

200 papers

Non-Volatile Memories (NVMs) such as Resistive RAM (RRAM) are used in neuromorphic systems to implement high-density and low-power analog synaptic weights. Unfortunately, an RRAM cell can switch its state after reading its content a certain…

Neural and Evolutionary Computing · Computer Science 2021-06-18 Shihao Song , Twisha Titirsha , Anup Das

Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of…

Robotics · Computer Science 2024-05-17 Pascal Goldschmid , Aamir Ahmad

Deep Reinforcement Learning (DRL) agents frequently face challenges in adapting to tasks outside their training distribution, including issues with over-fitting, catastrophic forgetting and sample inefficiency. Although the application of…

Artificial Intelligence · Computer Science 2023-11-21 Yizhao Jin , Greg Slabaugh , Simon Lucas

The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality…

Materials Science · Physics 2022-02-23 Rama K. Vasudevan , Erick Orozco , Sergei V. Kalinin

In this paper, we describe a new neuro-inspired, hardware-friendly readout stage for the liquid state machine (LSM), a popular model for reservoir computing. Compared to the parallel perceptron architecture trained by the p-delta algorithm,…

Emerging Technologies · Computer Science 2014-11-21 Subhrajit Roy , Amitava Banerjee , Arindam Basu

This research focuses on enhancing reinforcement learning (RL) algorithms by integrating penalty functions to guide agents in avoiding unwanted actions while optimizing rewards. The goal is to improve the learning process by ensuring that…

Machine Learning · Computer Science 2025-04-07 Sai Gana Sandeep Pula , Sathish A. P. Kumar , Sumit Jha , Arvind Ramanathan

Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous…

Machine Learning · Computer Science 2023-05-04 Gang Chen , Victoria Huang

We describe an approximation to backpropagation algorithm for training deep neural networks, which is designed to work with synapses implemented with memristors. The key idea is to represent the values of both the input signal and the…

Neural and Evolutionary Computing · Computer Science 2016-07-28 D. V. Negrov , I. M. Karandashev , V. V. Shakirov , Yu. A. Matveyev , W. L. Dunin-Barkowski , A. V. Zenkevich

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

Machine Learning · Computer Science 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

Machine and reinforcement learning (RL) are increasingly being applied to plan and control the behavior of autonomous systems interacting with the physical world. Examples include self-driving vehicles, distributed sensor networks, and…

Optimization and Control · Mathematics 2019-09-24 Nikolai Matni , Alexandre Proutiere , Anders Rantzer , Stephen Tu

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

Neuromorphic computing aims to mimic both the function and structure of biological neural networks to provide artificial intelligence with extreme efficiency. Conventional approaches store synaptic weights in non-volatile memory devices…

Neural and Evolutionary Computing · Computer Science 2023-08-23 Peng Zhou , Alexander J. Edwards , Frederick B. Mancoff , Sanjeev Aggarwal , Stephen K. Heinrich-Barna , Joseph S. Friedman

Connector insertion and many other tasks commonly found in modern manufacturing settings involve complex contact dynamics and friction. Since it is difficult to capture related physical effects with first-order modeling, traditional control…

Memristive neuromorphic systems are designed to emulate human perception and cognition, where the memristor states represent essential historical information to perform both low-level and high-level tasks. However, current systems face…

Applied Physics · Physics 2024-09-17 Shengbo Wang , Cong Li , Tongming Pu , Jian Zhang , Weihao Ma , Luigi Occhipinti , Arokia Nathan , Shuo Gao

Training agents to autonomously learn how to use anthropomorphic robotic hands has the potential to lead to systems capable of performing a multitude of complex manipulation tasks in unstructured and uncertain environments. In this work, we…

Robotics · Computer Science 2021-05-18 Henry Charlesworth , Giovanni Montana

In today's rapidly evolving military landscape, advancing artificial intelligence (AI) in support of wargaming becomes essential. Despite reinforcement learning (RL) showing promise for developing intelligent agents, conventional RL faces…

Machine Learning · Computer Science 2024-08-27 Scotty Black

Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can…

Machine Learning · Computer Science 2025-06-24 Ju-Seung Byun , Andrew Perrault

Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex high precision…

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu