English
Related papers

Related papers: Towards Crossing the Reality Gap with Evolved Plas…

200 papers

Robotic airships offer significant advantages in terms of safety, mobility, and extended flight times. However, their highly restrictive weight constraints pose a major challenge regarding the available computational resources to perform…

Robotics · Computer Science 2022-03-08 Marina González-Álvarez , Julien Dupeyroux , Federico Corradi , Guido de Croon

This paper presents a vehicle lateral controller based on spiking neural networks capable of replicating the behavior of a model-based controller but with the additional ability to perform online adaptation. By making use of neural…

Systems and Control · Electrical Eng. & Systems 2022-07-06 Javier Pérez , Manuel A. Vargas , Juan A. Cabrera , Juan J. Castillo , Barys Shyrokau

To address the computational challenges of Model Predictive Control (MPC), recent research has studied using imitation learning to approximate MPC with a computationally efficient Deep Neural Network (DNN). However, this introduces a common…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Seungtaek Kim , Jonghyup Lee , Kyoungseok Han , Seibum B. Choi

Developing robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous…

Robotics · Computer Science 2022-11-24 Sirui Chen , Keenon Werling , Albert Wu , C. Karen Liu

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

Navigation and manipulation are core capabilities in Embodied AI, yet training agents with these capabilities in the real world faces high costs and time complexity. Therefore, sim-to-real transfer has emerged as a key approach, yet the…

Robotics · Computer Science 2025-05-06 Lik Hang Kenny Wong , Xueyang Kang , Kaixin Bai , Jianwei Zhang

Drones which can swarm and loiter in a certain area cost hundreds of dollars, but mosquitos can do the same and are essentially worthless. To control swarms of low-cost robots, researchers may end up spending countless hours brainstorming…

Neural and Evolutionary Computing · Computer Science 2024-10-22 Kevin Zhu , Connor Mattson , Shay Snyder , Ricardo Vega , Daniel S. Brown , Maryam Parsa , Cameron Nowzari

The brain can learn to execute a wide variety of tasks quickly and efficiently. Nevertheless, most of the mechanisms that enable us to learn are unclear or incredibly complicated. Recently, considerable efforts have been made in…

Neural and Evolutionary Computing · Computer Science 2023-03-28 Mohammad Modiri

We address the longstanding challenge of producing flexible, realistic humanoid character controllers that can perform diverse whole-body tasks involving object interactions. This challenge is central to a variety of fields, from graphics…

Artificial Intelligence · Computer Science 2020-06-17 Josh Merel , Saran Tunyasuvunakool , Arun Ahuja , Yuval Tassa , Leonard Hasenclever , Vu Pham , Tom Erez , Greg Wayne , Nicolas Heess

Continuous adaptation allows survival in an ever-changing world. Adjustments in the synaptic coupling strength between neurons are essential for this capability, setting us apart from simpler, hard-wired organisms. How these changes can be…

Neurons and Cognition · Quantitative Biology 2021-01-06 Jakob Jordan , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici

Quadruped robots have strong adaptability to extreme environments but may also experience faults. Once these faults occur, robots must be repaired before returning to the task, reducing their practical feasibility. One prevalent concern…

Robotics · Computer Science 2024-01-01 Xinyuan Wu , Wentao Dong , Hang Lai , Yong Yu , Ying Wen

Sim-to-real transfer remains a fundamental challenge in robot manipulation due to the entanglement of perception and control in end-to-end learning. We present a decoupled framework that learns each component where it is most reliable:…

Robotics · Computer Science 2025-10-01 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Shuo Wang , Xingyu Lin , Yang Gao

In this paper, we deal with the reality gap from a novel perspective, targeting transferring Deep Reinforcement Learning (DRL) policies learned in simulated environments to the real-world domain for visual control tasks. Instead of adopting…

Robotics · Computer Science 2019-01-17 Jingwei Zhang , Lei Tai , Peng Yun , Yufeng Xiong , Ming Liu , Joschka Boedecker , Wolfram Burgard

Unlike traditional artificial neural networks (ANNs), biological neuronal networks solve complex cognitive tasks with sparse neuronal activity, recurrent connections, and local learning rules. These mechanisms serve as design principles in…

Neural and Evolutionary Computing · Computer Science 2026-02-17 Matteo Saponati , Chiara De Luca , Giacomo Indiveri , Benjamin Grewe

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of diverse policies that…

Machine Learning · Computer Science 2018-11-15 Ryan Julian , Eric Heiden , Zhanpeng He , Hejia Zhang , Stefan Schaal , Joseph J. Lim , Gaurav Sukhatme , Karol Hausman

Automating the navigation of unmanned aerial vehicles (UAVs) in diverse scenarios has gained much attention in recent years. However, teaching UAVs to fly in challenging environments remains an unsolved problem, mainly due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Matthias Müller , Vincent Casser , Neil Smith , Dominik L. Michels , Bernard Ghanem

Spiking Neural Networks (SNNs) offer a biologically plausible learning mechanism through synaptic plasticity, enabling unsupervised adaptation without the computational overhead of backpropagation. To harness this capability for robotics,…

Hardware Architecture · Computer Science 2026-01-30 Tenglong Li , Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Many swarm robotics tasks consist of multiple conflicting objectives. This research proposes a multi-objective evolutionary neural network approach to developing controllers for swarms of robots. The swarm robot controllers are trained in a…

Robotics · Computer Science 2023-07-27 Karl Mason , Sabine Hauert

Inspired by the natural nervous system, synaptic plasticity rules are applied to train spiking neural networks with local information, making them suitable for online learning on neuromorphic hardware. However, when such rules are…

Neural and Evolutionary Computing · Computer Science 2022-02-28 J. Lu , J. J. Hagenaars , G. C. H. E. de Croon