English
Related papers

Related papers: Residual Model Learning for Microrobot Control

200 papers

We present Residual Policy Learning (RPL): a simple method for improving nondifferentiable policies using model-free deep reinforcement learning. RPL thrives in complex robotic manipulation tasks where good but imperfect controllers are…

Robotics · Computer Science 2019-01-04 Tom Silver , Kelsey Allen , Josh Tenenbaum , Leslie Kaelbling

The sample inefficiency of reinforcement learning (RL) remains a significant challenge in robotics. RL requires large-scale simulation and can still cause long training times, slowing research and innovation. This issue is particularly…

Robotics · Computer Science 2026-01-16 Johannes Heeg , Yunlong Song , Davide Scaramuzza

Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated…

Systems and Control · Electrical Eng. & Systems 2020-11-23 Anubhav Guha , Anuradha Annaswamy

Reinforcement learning (RL) has demonstrated compelling performance in robotic tasks, but its success often hinges on the design of complex, ad hoc reward functions. Researchers have explored how Large Language Models (LLMs) could enable…

Robotics · Computer Science 2025-05-13 Letian Chen , Nina Moorman , Matthew Gombolay

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Reinforcement Learning (RL) has achieved impressive results in robotics, yet high-performing pipelines remain highly task-specific, with little reuse of prior data. Offline Model-based RL (MBRL) offers greater data efficiency by training…

Robotics · Computer Science 2026-01-09 Chenhao Li , Andreas Krause , Marco Hutter

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from…

Robotics · Computer Science 2018-02-08 Risto Kojcev , Nora Etxezarreta , Alejandro Hernández , Víctor Mayoral

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

By combining the agility of legged locomotion with the capabilities of manipulation, loco-manipulation platforms have the potential to perform complex tasks in real-world applications. To this end, state-of-the-art quadrupeds with…

Robotics · Computer Science 2025-09-30 Benjamin Hoffman , Jin Cheng , Chenhao Li , Stelian Coros

Robotic Manipulation (RM) is central to the advancement of autonomous robots, enabling them to interact with and manipulate objects in real-world environments. This survey focuses on RM methodologies that leverage imitation learning, a…

Model-based paradigms for decision-making and control are becoming ubiquitous in robotics. They rely on the ability to efficiently learn a model of the system from data. Structured Mechanical Models (SMMs) are a data-efficient black-box…

Robotics · Computer Science 2021-05-06 Kunal Menda , Jayesh K. Gupta , Zachary Manchester , Mykel J. Kochenderfer

Multimodal perception enables robust autonomous driving but incurs unnecessary computational cost when all sensors remain active. This paper presents PRAM-R, a unified Perception-Reasoning-Action-Memory framework with LLM-Guided Modality…

Robotics · Computer Science 2026-03-05 Yi Zhang , Xian Zhang , Saisi Zhao , Yinglei Song , Chengdong Wu , Nenad Petrovic , Alois Knoll

Reinforcement learning (RL)-based motion imitation methods trained on demonstration data can effectively learn natural and expressive motions with minimal reward engineering but often struggle to generalize to novel environments. We address…

Robotics · Computer Science 2025-09-01 Zewei Zhang , Chenhao Li , Takahiro Miki , Marco Hutter

Humanoid robots with behavioral autonomy have consistently been regarded as ideal collaborators in our daily lives and promising representations of embodied intelligence. Compared to fixed-based robotic arms, humanoid robots offer a larger…

Robotics · Computer Science 2024-09-04 Jin Wang , Nikos Tsagarakis

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

Parameter-efficient methods are able to use a single frozen pre-trained large language model (LLM) to perform many tasks by learning task-specific soft prompts that modulate model behavior when concatenated to the input text. However, these…

Computation and Language · Computer Science 2022-08-12 Brian Lester , Joshua Yurtsever , Siamak Shakeri , Noah Constant

Apprenticeship learning has recently attracted a wide attention due to its capability of allowing robots to learn physical tasks directly from demonstrations provided by human experts. Most previous techniques assumed that the state space…

Robotics · Computer Science 2017-02-27 Fei Han , Xue Yang , Yu Zhang , Hao Zhang

Model-free reinforcement learning (RL) for legged locomotion commonly relies on a physics simulator that can accurately predict the behaviors of every degree of freedom of the robot. In contrast, approximate reduced-order models are…

Robotics · Computer Science 2022-02-17 Zhaoming Xie , Xingye Da , Buck Babich , Animesh Garg , Michiel van de Panne

This article presents a method for learning well-coordinated Human-Robot Interaction (HRI) from Human-Human Interactions (HHI). We devise a hybrid approach using Hidden Markov Models (HMMs) as the latent space priors for a Variational…