English
Related papers

Related papers: Learning Policies for Continuous Control via Trans…

200 papers

When do locomotion controllers require reasoning about nonlinearities? In this work, we show that a whole-body model-predictive controller using a simple linear time-invariant approximation of the whole-body dynamics is able to execute…

Robotic manipulation can greatly benefit from the data efficiency, robustness, and predictability of model-based methods if robots can quickly generate models of novel objects they encounter. This is especially difficult when effects like…

Robotics · Computer Science 2023-10-19 Bibit Bianchini , Mathew Halm , Michael Posa

Being able to transfer existing skills to new situations is a key capability when training robots to operate in unpredictable real-world environments. A successful transfer algorithm should not only minimize the number of samples that the…

Robotics · Computer Science 2020-12-15 Wenhao Yu , C. Karen Liu , Greg Turk

Tilt-rotor aerial robots enable omnidirectional maneuvering through thrust vectoring, but introduce significant control challenges due to the strong coupling between joint and rotor dynamics. While model-based controllers can achieve high…

Robotics · Computer Science 2026-02-26 Wentao Zhang , Zhaoqi Ma , Jinjie Li , Huayi Wang , Haokun Liu , Junichiro Sugihara , Chen Chen , Yicheng Chen , Moju Zhao

This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person. The sub-tasks…

Robotics · Computer Science 2022-03-09 Junchi Liang , Bowen Wen , Kostas Bekris , Abdeslam Boularias

Accurate dynamics models are critical for the design of predictive controller for autonomous mobile robots. Physics-based models are often too simple to capture relevant real-world effects, while data-driven models are data-intensive and…

Robotics · Computer Science 2026-04-07 Abdullah Altawaitan , Nikolay Atanasov

This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory…

Robotics · Computer Science 2022-02-03 Zihao Liang , Wanxin Jin , Shaoshuai Mou

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

Precise trajectory tracking for legged robots can be challenging due to their high degrees of freedom, unmodeled nonlinear dynamics, or random disturbances from the environment. A commonly adopted solution to overcome these challenges is to…

Robotics · Computer Science 2025-09-01 Jing Cheng , Yasser G. Alqaham , Amit K. Sanyal , Zhenyu Gan

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning.…

Robotics · Computer Science 2016-08-02 Nikolas J. Hemion

There is a widespread intuition that model-based control methods should be able to surpass the data efficiency of model-free approaches. In this paper we attempt to evaluate this intuition on various challenging locomotion tasks. We take a…

Neural control of memory-constrained, agile robots requires small, yet highly performant models. We leverage graph hyper networks to learn graph hyper policies trained with off-policy reinforcement learning resulting in networks that are…

Robotics · Computer Science 2022-10-04 Shashank Hegde , Gaurav S. Sukhatme

Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to…

In order to robustly execute a task under environmental uncertainty, a robot needs to be able to reactively adapt to changes arising in its environment. The environment changes are usually reflected in deviation from expected sensory…

Robotics · Computer Science 2018-09-19 Giovanni Sutanto , Zhe Su , Stefan Schaal , Franziska Meier

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

Machine Learning · Computer Science 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

Research on control using models based on machine-learning methods has now shifted to the practical engineering stage. Achieving high performance and theoretically guaranteeing the safety of the system is critical for such applications. In…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Ryuta Moriyasu , Masayuki Kusunoki , Kenji Kashima

Reinforcement learning (RL) has demonstrated remarkable capability in acquiring robot skills, but learning each new skill still requires substantial data collection for training. The pretrain-and-finetune paradigm offers a promising…

Robotics · Computer Science 2025-03-25 Ziang Zheng , Guojian Zhan , Bin Shuai , Shengtao Qin , Jiangtao Li , Tao Zhang , Shengbo Eben Li

We propose an architecture for learning complex controllable behaviors by having simple Policies Modulate Trajectory Generators (PMTG), a powerful combination that can provide both memory and prior knowledge to the controller. The result is…

Robotics · Computer Science 2019-10-08 Atil Iscen , Ken Caluwaerts , Jie Tan , Tingnan Zhang , Erwin Coumans , Vikas Sindhwani , Vincent Vanhoucke

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen