English
Related papers

Related papers: Learning Dynamic-Objective Policies from a Class o…

200 papers

This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory…

Robotics · Computer Science 2022-02-03 Zihao Liang , Wanxin Jin , Shaoshuai Mou

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

Robust control policy learning for autonomous driving requires training environments to be both physically realistic and computationally scalable, properties that existing simulators provide only in isolation. We introduce Sim2Sim2Sim, a…

Robotics · Computer Science 2026-05-05 Xunjiang Gu , Kashyap Chitta , Mahsa Golchoubian , Vladimir Suplin , Igor Gilitschenski

We consider the feedback design for stabilizing a rigid body system by making and breaking multiple contacts with the environment without prespecifying the timing or the number of occurrence of the contacts. We model such a system as a…

Systems and Control · Computer Science 2019-05-16 Weiqiao Han , Russ Tedrake

Learning robot control policies from physics simulations is of great interest to the robotics community as it may render the learning process faster, cheaper, and safer by alleviating the need for expensive real-world experiments. However,…

Robotics · Computer Science 2021-06-22 Fabio Muratore , Michael Gienger , Jan Peters

Proximal policy optimization (PPO) is one of the most popular state-of-the-art on-policy algorithms that has become a standard baseline in modern reinforcement learning with applications in numerous fields. Though it delivers stable…

Machine Learning · Computer Science 2025-02-25 Qisai Liu , Zhanhong Jiang , Hsin-Jung Yang , Mahsa Khosravi , Joshua R. Waite , Soumik Sarkar

Training general robotic policies from heterogeneous data for different tasks is a significant challenge. Existing robotic datasets vary in different modalities such as color, depth, tactile, and proprioceptive information, and collected in…

Robotics · Computer Science 2024-12-03 Lirui Wang , Jialiang Zhao , Yilun Du , Edward H. Adelson , Russ Tedrake

Modular robots can be reconfigured to create a variety of designs from a small set of components. But constructing a robot's hardware on its own is not enough -- each robot needs a controller. One could create controllers for some designs…

Robotics · Computer Science 2022-11-01 Julian Whitman , Howie Choset

We study the problem of efficiently estimating policies that simultaneously optimize multiple objectives in reinforcement learning (RL). Given $n$ objectives (or tasks), we seek the optimal partition of these objectives into $k \ll n$…

Machine Learning · Computer Science 2026-02-24 Zhenshuo Zhang , Minxuan Duan , Youran Ye , Hongyang R. Zhang

This study presents the extension of the data-driven optimal prediction approach to the dynamical system with control. The optimal prediction is used to analyze dynamical systems in which the states consist of resolved and unresolved…

Dynamical Systems · Mathematics 2024-06-05 Aleksandr Katrutsa , Ivan Oseledets , Sergey Utyuzhnikov

We present an efficient transcription method for highly oscillatory optimal control problems. For these problems, the optimal state trajectory consists of fast oscillations that change slowly over the time horizon. Out of a large number of…

Optimization and Control · Mathematics 2022-05-19 Jakob Harzer , Jochem De Schutter , Moritz Diehl

In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise…

Robotics · Computer Science 2019-04-05 Rafael Oliveira , Fernando H. M. Rocha , Lionel Ott , Vitor Guizilini , Fabio Ramos , Valdir Grassi

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

We consider the problem of synthesizing resilient and stochastically stable strategies for systems of cooperating agents striving to minimize the expected time between consecutive visits to selected locations in a known environment. A…

Multiagent Systems · Computer Science 2023-05-18 David Klaška , Antonín Kučera , Martin Kurečka , Vít Musil , Petr Novotný , Vojtěch Řehák

This paper presents a machine learning approach for tuning the parameters of a family of stabilizing controllers for orbital tracking. An augmented random search algorithm is deployed, which aims at minimizing a cost function combining…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Gianni Bianchini , Andrea Garulli , Antonio Giannitrapani , Mirko Leomanni , Renato Quartullo

The goal of logical controller synthesis is to automatically compute a control strategy that regulates the discrete, event-driven behavior of a given plant s.t. a temporal logic specification holds over all remaining traces. Standard…

Logic in Computer Science · Computer Science 2025-01-31 Bernd Finkbeiner , Niklas Metzger , Satya Prakash Nayak , Anne-Kathrin Schmuck

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

Machine Learning · Computer Science 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Developing robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous…

Robotics · Computer Science 2022-11-24 Sirui Chen , Keenon Werling , Albert Wu , C. Karen Liu

Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A…

Offline reinforcement learning provides a viable approach to obtain advanced control strategies for dynamical systems, in particular when direct interaction with the environment is not available. In this paper, we introduce a conceptual…

Machine Learning · Computer Science 2024-01-04 Marc Weber , Phillip Swazinna , Daniel Hein , Steffen Udluft , Volkmar Sterzing