English
Related papers

Related papers: Learning Policies for Continuous Control via Trans…

200 papers

Future sequence represents the outcome after executing the action into the environment (i.e. the trajectory onwards). When driven by the information-theoretic concept of mutual information, it seeks maximally informative consequences.…

Machine Learning · Computer Science 2023-11-15 Jianfei Ma

We study the problem of policy repair for learning-based control policies in safety-critical settings. We consider an architecture where a high-performance learning-based control policy (e.g. one trained as a neural network) is paired with…

Artificial Intelligence · Computer Science 2020-08-19 Weichao Zhou , Ruihan Gao , BaekGyu Kim , Eunsuk Kang , Wenchao Li

This paper proposes a data-driven method for learning convergent control policies from offline data using Contraction theory. Contraction theory enables constructing a policy that makes the closed-loop system trajectories inherently…

Machine Learning · Computer Science 2022-02-04 Navid Rezazadeh , Maxwell Kolarich , Solmaz S. Kia , Negar Mehr

In systems control, the dynamics of a system are governed by modulating its inputs to achieve a desired outcome. For example, to control the thrust of a quad-copter propeller the controller modulates its rotation rate, relying on a…

Artificial Intelligence · Computer Science 2025-02-14 Hadar Sharvit , Raz Karl , Tsevi Beatus

We focus on the problem of learning a single motor module that can flexibly express a range of behaviors for the control of high-dimensional physically simulated humanoids. To do this, we propose a motor architecture that has the general…

Machine Learning · Computer Science 2019-01-16 Josh Merel , Leonard Hasenclever , Alexandre Galashov , Arun Ahuja , Vu Pham , Greg Wayne , Yee Whye Teh , Nicolas Heess

The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks. An important line of research in this regard is that of…

Robotics · Computer Science 2023-11-14 Luca Lach , Robert Haschke , Davide Tateo , Jan Peters , Helge Ritter , Júlia Borràs , Carme Torras

In this paper, we solve the problem of finding a certified control policy that drives a robot from any given initial state and under any bounded disturbance to the desired reference trajectory, with guarantees on the convergence or bounds…

Robotics · Computer Science 2020-11-26 Dawei Sun , Susmit Jha , Chuchu Fan

We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a…

Machine Learning · Computer Science 2023-05-31 Gal Leibovich , Guy Jacob , Or Avner , Gal Novik , Aviv Tamar

Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning…

Machine Learning · Computer Science 2024-11-01 Dean Brandner , Sergio Lucia

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

In this work we explore a new approach for robots to teach themselves about the world simply by observing it. In particular we investigate the effectiveness of learning task-agnostic representations for continuous control tasks. We extend…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Debidatta Dwibedi , Jonathan Tompson , Corey Lynch , Pierre Sermanet

Learning a universal policy across different robot morphologies can significantly improve learning efficiency and generalization in continuous control. However, it poses a challenging multi-task reinforcement learning problem, as the…

Artificial Intelligence · Computer Science 2023-08-07 Zheng Xiong , Jacob Beck , Shimon Whiteson

Machines are a long way from robustly solving open-world perception-control tasks, such as first-person view (FPV) aerial navigation. While recent advances in end-to-end Machine Learning, especially Imitation and Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Rogerio Bonatti , Ratnesh Madaan , Vibhav Vineet , Sebastian Scherer , Ashish Kapoor

In this paper, we propose a new strategy for learning inertial robotic navigation models. The proposed strategy enhances the generalisability of end-to-end inertial modelling, and is aimed at wheeled robotic deployments. Concretely, the…

Machine Learning · Computer Science 2021-09-21 Mohammed Alloulah , Maximilian Arnold , Anton Isopoussu

Existing learning from demonstration algorithms usually assume access to expert demonstrations. However, this assumption is limiting in many real-world applications since the collected demonstrations may be suboptimal or even consist of…

Robotics · Computer Science 2022-03-03 Zhangjie Cao , Zihan Wang , Dorsa Sadigh

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood