English
Related papers

Related papers: Quantification before Selection: Active Dynamics P…

200 papers

Domain Randomization (DR) is known to require a significant amount of training data for good performance. We argue that this is due to DR's strategy of random data generation using a uniform distribution over simulation parameters, as a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Rawal Khirodkar , Kris M. Kitani

Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which…

Domain randomization (DR) is a successful technique for learning robust policies for robot systems, when the dynamics of the target robot system are unknown. The success of policies trained with domain randomization however, is highly…

Machine Learning · Computer Science 2019-09-18 Melissa Mozifian , Juan Camilo Gamboa Higuera , David Meger , Gregory Dudek

Soft robots are gaining popularity thanks to their intrinsic safety to contacts and adaptability. However, the potentially infinite number of Degrees of Freedom makes their modeling a daunting task, and in many cases only an approximated…

Robotics · Computer Science 2024-01-26 Gabriele Tiboni , Andrea Protopapa , Tatiana Tommasi , Giuseppe Averta

Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…

Machine Learning · Statistics 2012-05-22 Marek Petrik

Enforcing state and input constraints during reinforcement learning (RL) in continuous state spaces is an open but crucial problem which remains a roadblock to using RL in safety-critical applications. This paper leverages invariant sets to…

Systems and Control · Electrical Eng. & Systems 2019-06-28 Ankush Chakrabarty , Rien Quirynen , Claus Danielson , Weinan Gao

The past decade has seen the rapid development of Reinforcement Learning, which acquires impressive performance with numerous training resources. However, one of the greatest challenges in RL is generalization efficiency (i.e.,…

Machine Learning · Computer Science 2021-08-18 Qi Yang , Peng Yang , Ke Tang

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

Machine Learning · Computer Science 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

Learning domain adaptive policies that can generalize to unseen transition dynamics, remains a fundamental challenge in learning-based control. Substantial progress has been made through domain representation learning to capture…

Machine Learning · Computer Science 2026-03-31 Pengcheng Wang , Qinghang Liu , Haotian Lin , Yiheng Li , Guojian Zhan , Masayoshi Tomizuka , Yixiao Wang

Domain randomization (DR) is widely used in policy learning to improve robustness to modeling error, but remains underexplored in contact-rich sampling-based predictive control (SPC), where rollout quality is highly sensitive to…

Robotics · Computer Science 2026-05-06 Sergio A. Esteban , Junheng Li , Vince Kurtz , Aaron D. Ames

Domain randomization is a popular technique for improving domain transfer, often used in a zero-shot setting when the target domain is unknown or cannot easily be used for training. In this work, we empirically examine the effects of domain…

Machine Learning · Computer Science 2019-07-12 Bhairav Mehta , Manfred Diaz , Florian Golemo , Christopher J. Pal , Liam Paull

Autonomous robot navigation systems often rely on hierarchical planning, where global planners compute collision-free paths without considering dynamics, and local planners enforce dynamics constraints to produce executable commands. This…

Robotics · Computer Science 2025-10-14 Yuanjie Lu , Mingyang Mao , Tong Xu , Linji Wang , Xiaomin Lin , Xuesu Xiao

Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising…

Machine Learning · Computer Science 2019-03-29 Quan Vuong , Sharad Vikram , Hao Su , Sicun Gao , Henrik I. Christensen

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

Trajectory following is one of the complicated control problems when its dynamics are nonlinear, stochastic and include a large number of parameters. The problem has significant difficulties including a large number of trials required for…

Robotics · Computer Science 2019-02-14 Ali Lenjani

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

Machine Learning · Computer Science 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

Standard reinforcement learning (RL) optimizes policies for reward but imposes few constraints on how decisions evolve over time. As a result, policies may achieve high performance while exhibiting temporally incoherent behavior such as…

Machine Learning · Computer Science 2026-04-24 Sukesh Subaharan

Domain randomization (DR), which entails training a policy with randomized dynamics, has proven to be a simple yet effective algorithm for reducing the gap between simulation and the real world. However, DR often requires careful tuning of…

‹ Prev 1 2 3 10 Next ›