English
Related papers

Related papers: DexCtrl: Towards Sim-to-Real Dexterity with Adapti…

200 papers

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

We propose a method to predict the sim-to-real transfer performance of RL policies. Our transfer metric simplifies the selection of training setups (such as algorithm, hyperparameters, randomizations) and policies in simulation, without the…

Machine Learning · Computer Science 2020-09-29 Lei M. Zhang , Matthias Plappert , Wojciech Zaremba

Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated…

Systems and Control · Electrical Eng. & Systems 2020-11-23 Anubhav Guha , Anuradha Annaswamy

For contact-intensive tasks, the ability to generate policies that produce comprehensive tactile-aware motions is essential. However, existing data collection and skill learning systems for dexterous manipulation often suffer from…

Robotics · Computer Science 2026-01-30 Xingyu Zhang , Chaofan Zhang , Boyue Zhang , Zhinan Peng , Shaowei Cui , Shuo Wang

Teaching robots dexterous manipulation skills, such as tool use, presents a significant challenge. Current approaches can be broadly categorized into two strategies: human teleoperation (for imitation learning) and sim-to-real reinforcement…

Adaptive control provides techniques for adjusting control parameters in real time to maintain system performance despite unknown or changing process parameters. These methods use real data to tune controllers and adjust plant models or…

Systems and Control · Electrical Eng. & Systems 2024-06-12 Ioan Doré Landau , Rogelio Lozano , Mohammed M Saad , Alireza Karimi

Learning dexterous locomotion policy for legged robots is becoming increasingly popular due to its ability to handle diverse terrains and resemble intelligent behaviors. However, joint manipulation of moving objects and locomotion with…

Robotics · Computer Science 2024-03-22 Yutong Hu , Kehan Wen , Fisher Yu

Fine-tuning simulation-trained RL agents with real-world data often degrades crucial behaviors due to limited or skewed data distributions. We argue that designer priorities exist not just in reward functions, but also in simulation design…

Robotics · Computer Science 2025-05-02 Bassel El Mabsout , Shahin Roozkhosh , Siddharth Mysore , Kate Saenko , Renato Mancuso

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

Deep Reinforcement Learning has proved to be able to solve many control tasks in different fields, but the behavior of these systems is not always as expected when deployed in real-world scenarios. This is mainly due to the lack of domain…

Robotics · Computer Science 2021-04-29 Alessandro Paolo Capasso , Giulio Bacchiani , Alberto Broggi

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

Achieving human-like dexterity is a longstanding challenge in robotics, in part due to the complexity of planning and control for contact-rich systems. In reinforcement learning (RL), one popular approach has been to use…

Robotics · Computer Science 2025-03-06 Albert H. Li , Preston Culbertson , Vince Kurtz , Aaron D. Ames

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn…

Graphics · Computer Science 2023-05-08 Pei Xu , Xiumin Shang , Victor Zordan , Ioannis Karamouzas

In this work, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynamical systems…

Systems and Control · Electrical Eng. & Systems 2025-06-27 Viet-Anh Le , Andreas A. Malikopoulos

Many real-world manipulation tasks consist of a series of subtasks that are significantly different from one another. Such long-horizon, complex tasks highlight the potential of dexterous hands, which possess adaptability and versatility,…

Robotics · Computer Science 2023-10-17 Yuanpei Chen , Chen Wang , Li Fei-Fei , C. Karen Liu

Constraint-based control approaches offer a flexible way to specify robotic manipulation tasks and execute them on robots with many degrees of freedom. However, the specification of task constraints and their associated priorities usually…

Robotics · Computer Science 2021-04-14 Dennis Mronga , Frank Kirchner

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Automation holds the potential to assist surgeons in robotic interventions, shifting their mental work load from visuomotor control to high level decision making. Reinforcement learning has shown promising results in learning complex…

Vision and learning have made significant progress that could improve robotics policies for complex tasks and environments. Learning deep neural networks for image understanding, however, requires large amounts of domain-specific visual…

Machine Learning · Computer Science 2019-07-31 Alexander Pashevich , Robin Strudel , Igor Kalevatykh , Ivan Laptev , Cordelia Schmid