English
Related papers

Related papers: Reinforcement Learning in a Neurally Controlled Ro…

200 papers

The development of artificial intelligence towards real-time interaction with the environment is a key aspect of embodied intelligence and robotics. Inverse dynamics is a fundamental robotics problem, which maps from joint space to torque…

Robotics · Computer Science 2025-04-18 Ziqi Wang , Jingyue Zhao , Jichao Yang , Yaohua Wang , Xun Xiao , Yuan Li , Chao Xiao , Lei Wang

Neuroscientific theory suggests that dopaminergic neurons broadcast global reward prediction errors to large areas of the brain influencing the synaptic plasticity of the neurons in those regions. We build on this theory to propose a…

Machine Learning · Computer Science 2019-11-12 Sneha Aenugu , Abhishek Sharma , Sasikiran Yelamarthi , Hananel Hazan , Philip S. Thomas , Robert Kozma

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes…

Robotics · Computer Science 2021-02-23 Nikola Vulin , Sammy Christen , Stefan Stevsic , Otmar Hilliges

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

Robotics · Computer Science 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Recent advancements in legged robots using deep reinforcement learning have led to significant progress. Quadruped robots can perform complex tasks in challenging environments, while bipedal and humanoid robots have also achieved…

Robotics · Computer Science 2024-09-17 Xiaoyang Jiang , Qiang Zhang , Jingkai Sun , Jiahang Cao , Jingtong Ma , Renjing Xu

This paper presents a constructive algorithm that achieves successful one-shot learning of hidden spike-patterns in a competitive detection task. It has previously been shown (Masquelier et al., 2008) that spike-timing-dependent plasticity…

Neurons and Cognition · Quantitative Biology 2017-08-31 Toby Lightheart , Steven Grainger , Tien-Fu Lu

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

The adaptive fitness of an organism in its ecological niche is highly reliant upon its ability to associate an environmental or internal stimulus with a behavior response through reinforcement. This simple but powerful observation has been…

Neurons and Cognition · Quantitative Biology 2023-12-01 Roy E. Clymer , Sanjeev V. Namjoshi

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

Reinforcement Learning (RL) has been widely used to solve tasks where the environment consistently provides a dense reward value. However, in real-world scenarios, rewards can often be poorly defined or sparse. Auxiliary signals are…

Artificial Intelligence · Computer Science 2024-08-01 David Valencia , Henry Williams , Yuning Xing , Trevor Gee , Minas Liarokapis , Bruce A. MacDonald

Reward machines are an established tool for dealing with reinforcement learning problems in which rewards are sparse and depend on complex sequences of actions. However, existing algorithms for learning reward machines assume an overly…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Ivan Gavran , Daniel Neider

One of the challenges of modern neuroscience is creating a "living computer" based on neural networks grown in vitro. Such an artificial device is supposed to perform neurocomputational tasks and interact with the environment when embodied…

Neurons and Cognition · Quantitative Biology 2023-01-04 Sergey A. Lobov , Alexey N. Mikhaylov , Ekaterina S. Berdnikova , Valeri A. Makarov , Victor B. Kazantsev

Neuronal spikes directly drive muscles and endow animals with agile movements, but applying the spike-based control signals to actuators in artificial sensor-motor systems inevitably causes a collapse of learning. We developed a system that…

Neurons and Cognition · Quantitative Biology 2026-03-03 Takeshi Kobayashi , Shogo Yonekura , Yasuo Kuniyoshi

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may corresponds to a synchronization phase transition. The critical dynamics near such a critical point needs further…

Disordered Systems and Neural Networks · Physics 2022-05-04 Mahsa Khoshkhou , Afshin Montakhab

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen